-- Logs begin at Sat 2022-07-02 02:26:02 UTC, end at Sat 2022-07-02 03:50:49 UTC. -- Jul 02 03:15:25.120190 dv-cinder-846842-9-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 02 03:15:25.130236 dv-cinder-846842-9-smb devstack@keystone.service[80227]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 02 03:15:25.132251 dv-cinder-846842-9-smb devstack@keystone.service[80227]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Jul 2 03:15:25 2022] *** Jul 02 03:15:25.132251 dv-cinder-846842-9-smb devstack@keystone.service[80227]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 02 03:15:25.132251 dv-cinder-846842-9-smb devstack@keystone.service[80227]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 02 03:15:25.132251 dv-cinder-846842-9-smb devstack@keystone.service[80227]: nodename: dv-cinder-846842-9-smb Jul 02 03:15:25.132251 dv-cinder-846842-9-smb devstack@keystone.service[80227]: machine: x86_64 Jul 02 03:15:25.132251 dv-cinder-846842-9-smb devstack@keystone.service[80227]: clock source: unix Jul 02 03:15:25.132251 dv-cinder-846842-9-smb devstack@keystone.service[80227]: pcre jit disabled Jul 02 03:15:25.132251 dv-cinder-846842-9-smb devstack@keystone.service[80227]: detected number of CPU cores: 4 Jul 02 03:15:25.132251 dv-cinder-846842-9-smb devstack@keystone.service[80227]: current working directory: / Jul 02 03:15:25.132251 dv-cinder-846842-9-smb devstack@keystone.service[80227]: detected binary path: /usr/bin/uwsgi-core Jul 02 03:15:25.132906 dv-cinder-846842-9-smb devstack@keystone.service[80227]: your processes number limit is 47680 Jul 02 03:15:25.132906 dv-cinder-846842-9-smb devstack@keystone.service[80227]: your memory page size is 4096 bytes Jul 02 03:15:25.132906 dv-cinder-846842-9-smb devstack@keystone.service[80227]: detected max file descriptor number: 2048 Jul 02 03:15:25.132906 dv-cinder-846842-9-smb devstack@keystone.service[80227]: lock engine: pthread robust mutexes Jul 02 03:15:25.132906 dv-cinder-846842-9-smb devstack@keystone.service[80227]: thunder lock: enabled Jul 02 03:15:25.132906 dv-cinder-846842-9-smb devstack@keystone.service[80227]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 02 03:15:25.132906 dv-cinder-846842-9-smb devstack@keystone.service[80227]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 02 03:15:25.177916 dv-cinder-846842-9-smb devstack@keystone.service[80227]: Python main interpreter initialized at 0x55cc66f019c0 Jul 02 03:15:25.177916 dv-cinder-846842-9-smb devstack@keystone.service[80227]: python threads support enabled Jul 02 03:15:25.177916 dv-cinder-846842-9-smb devstack@keystone.service[80227]: your server socket listen backlog is limited to 100 connections Jul 02 03:15:25.177916 dv-cinder-846842-9-smb devstack@keystone.service[80227]: your mercy for graceful operations on workers is 90 seconds Jul 02 03:15:25.178258 dv-cinder-846842-9-smb devstack@keystone.service[80227]: mapped 403077 bytes (393 KB) for 2 cores Jul 02 03:15:25.178329 dv-cinder-846842-9-smb devstack@keystone.service[80227]: *** Operational MODE: preforking *** Jul 02 03:15:25.178581 dv-cinder-846842-9-smb devstack@keystone.service[80227]: *** uWSGI is running in multiple interpreter mode *** Jul 02 03:15:25.178581 dv-cinder-846842-9-smb devstack@keystone.service[80227]: spawned uWSGI master process (pid: 80227) Jul 02 03:15:25.178780 dv-cinder-846842-9-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 02 03:15:25.179670 dv-cinder-846842-9-smb devstack@keystone.service[80227]: spawned uWSGI worker 1 (pid: 80233, cores: 1) Jul 02 03:15:25.179670 dv-cinder-846842-9-smb devstack@keystone.service[80227]: spawned uWSGI worker 2 (pid: 80234, cores: 1) Jul 02 03:15:25.179825 dv-cinder-846842-9-smb devstack@keystone.service[80227]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 02 03:15:30.509653 dv-cinder-846842-9-smb devstack@keystone.service[80234]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 02 03:15:30.509653 dv-cinder-846842-9-smb devstack@keystone.service[80234]: from cryptography.utils import int_from_bytes Jul 02 03:15:30.510457 dv-cinder-846842-9-smb devstack@keystone.service[80233]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 02 03:15:30.510457 dv-cinder-846842-9-smb devstack@keystone.service[80233]: from cryptography.utils import int_from_bytes Jul 02 03:15:30.510862 dv-cinder-846842-9-smb devstack@keystone.service[80234]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 02 03:15:30.510862 dv-cinder-846842-9-smb devstack@keystone.service[80234]: from cryptography.utils import int_from_bytes Jul 02 03:15:30.510959 dv-cinder-846842-9-smb devstack@keystone.service[80233]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 02 03:15:30.510959 dv-cinder-846842-9-smb devstack@keystone.service[80233]: from cryptography.utils import int_from_bytes Jul 02 03:15:30.558666 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 02 03:15:30.558860 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 02 03:15:30.558936 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 02 03:15:30.559012 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] command line args: [] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 02 03:15:30.559169 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 02 03:15:30.559316 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 02 03:15:30.559472 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] command line args: [] {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 02 03:15:30.559554 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ================================================================================ {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 02 03:15:30.559637 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 02 03:15:30.559714 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] admin_token = **** {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.559798 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ================================================================================ {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 02 03:15:30.559969 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] config_dir = [] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.560110 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] admin_token = **** {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.560192 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.560261 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] config_dir = [] {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.560320 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] config_source = [] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.560375 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.560430 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] debug = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.560583 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] config_source = [] {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.560667 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.560915 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] debug = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.560915 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.561062 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.561128 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.561185 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.561306 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.561383 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.561528 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.561616 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.561971 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.562194 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] list_limit = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.562358 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] list_limit = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.562463 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] log_config_append = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.562685 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] log_config_append = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.562864 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.562983 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.563078 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] log_dir = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.563173 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] log_dir = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.563235 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] log_file = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.563306 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] log_file = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.563372 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.563430 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.563486 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.563540 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.563600 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.563668 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.563731 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.563792 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.563851 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.563914 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.563983 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.564048 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.564116 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.564175 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.564319 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.564567 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.564654 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.564769 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.564842 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.564953 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.565025 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.565134 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.565215 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.565285 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.565358 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.565510 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.565632 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.565719 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.565944 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.566067 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.566389 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.60/identity {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.566532 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.60/identity {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.566711 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] publish_errors = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.566856 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] publish_errors = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.566994 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.567163 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.567297 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.567411 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.567521 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.567630 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.567740 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.567872 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.567993 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.568105 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.568215 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] standard_threads = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.568323 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] standard_threads = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.568439 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.568672 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.568789 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.568898 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.569008 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.569118 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.569234 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] use_journal = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.569361 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] use_journal = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.569474 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] use_json = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.569584 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] use_json = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.569693 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] use_stderr = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.569808 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] use_stderr = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.569927 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] use_syslog = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.570038 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] use_syslog = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.570154 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.570272 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 03:15:30.570383 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.570492 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.570614 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.570725 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.570834 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.570942 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.571051 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.571176 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.571301 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.571415 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.571530 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.571674 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.571815 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.571934 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.572058 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.572169 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.572286 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.572397 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.572514 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.572624 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.572624 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.572846 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.572955 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.573064 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.573200 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.573312 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.573429 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.573540 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.573654 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.573764 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.573873 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.573982 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.574172 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.574290 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.574411 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.574529 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.574639 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.574748 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.574870 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.574984 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.575093 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.575243 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.575356 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.575473 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.575593 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.575704 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.575812 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.575922 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.576031 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.576141 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.576259 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.576369 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.576479 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.576588 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.576697 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.576806 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.576927 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.577039 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.577148 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.577257 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.577365 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.577485 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.577597 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.577713 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.577823 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.577932 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.578041 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.578159 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.578269 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.578378 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.578493 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.578610 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.578808 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.578932 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.579044 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.579169 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.579281 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.579390 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.579506 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.579700 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.579814 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.579931 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.580041 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.580157 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.580268 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.580386 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.580496 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.580613 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.580731 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.580850 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.580960 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.581078 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.581189 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.581298 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.581406 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.581515 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.581631 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.581753 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.581871 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.581982 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.582091 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.582200 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.582315 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.582438 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.582550 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.582660 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.582770 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.582879 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.583022 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.583199 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.583302 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.583396 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.583488 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.583580 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.583672 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.583773 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.583876 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.583970 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.584064 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.584155 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.584251 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.584335 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.584409 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.584522 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.584634 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.584754 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.584883 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.584997 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.585107 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.585226 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.585344 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.585455 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.585572 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.585689 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.585801 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.585923 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.586035 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.586152 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.586256 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.586365 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.586474 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.586592 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.586703 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.586813 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.586922 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.587023 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.587156 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.587277 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.587388 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.587498 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.587607 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.587708 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.587829 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.587941 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.588042 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.588150 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.588263 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.588372 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.588485 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.588595 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.588705 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.588815 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.588925 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.589034 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.589153 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.589264 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.589374 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.589485 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.589594 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.589704 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.589822 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.589940 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.590051 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.590163 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.590273 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.590382 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.590569 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.590683 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.590799 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.590911 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.591029 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.591184 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.591311 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.591436 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.591560 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.591678 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.591790 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.591901 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.592011 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.592120 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.592239 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.592351 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.592467 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.592578 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.592688 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.592797 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.592915 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.593034 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.593146 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.593269 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.593381 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.593492 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.593610 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.593722 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.593832 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.593942 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.594051 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.594160 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.594278 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] auth.external = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.594391 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] auth.external = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.594500 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.594617 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.594728 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.594876 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.595000 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.595135 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.595249 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] auth.password = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.595364 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] auth.password = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.595475 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] auth.token = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.595585 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] auth.token = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.595695 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.595818 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.595930 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.596042 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.596152 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.596263 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.596373 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.596496 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.596609 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.596720 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.596830 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.596942 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.597052 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.597172 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.597291 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] credential.caching = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.597404 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] credential.caching = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.597516 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.597627 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.597738 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.597857 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.597970 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.597970 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.598179 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.598179 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.598402 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.598402 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.598623 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.598623 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.598831 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.598943 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.599054 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.599054 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.599310 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.599310 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.599518 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.599630 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.599741 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.599741 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.599962 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.599962 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.600181 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.600181 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.600388 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.600508 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.600622 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.600733 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] federation.caching = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.600853 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.600965 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.601077 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] federation.caching = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.601197 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.601309 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.601422 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.601534 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.601654 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.601766 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.601885 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.601999 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.602109 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.602221 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.602332 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.602443 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.602562 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.602676 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.602787 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.602907 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.603018 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.603144 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.603270 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.603383 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.603502 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] identity.caching = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.603614 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.603726 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.603837 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] identity.caching = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.604027 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.604144 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.604255 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.604367 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.604477 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.604597 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.604710 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.604822 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.604937 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.605053 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.605164 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.605284 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.605396 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.605507 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.605618 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.605729 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.605841 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.605980 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.606089 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.606196 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.606307 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.606418 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.606529 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.606648 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.606770 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.606883 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.606995 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.607106 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.607269 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.607394 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.607509 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.607621 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.607732 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.607852 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.607966 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.608086 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.608198 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.608309 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.608427 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.608546 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.608658 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.608778 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.608890 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.609002 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.609113 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.609224 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.609335 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.609454 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.609567 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.609678 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.609789 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.609901 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.610042 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.610165 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.610279 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.610391 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.610502 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.610633 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.610745 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.610865 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.610985 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.610985 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.611211 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.611333 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.611447 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.611567 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.611680 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.611791 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.611910 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.612022 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.612134 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.612254 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.612367 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.612485 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.612597 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.612715 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.612828 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.612949 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.613062 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.613181 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.613294 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.613405 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.613524 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.613645 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.613757 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.613870 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.613983 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.614094 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.614206 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.614325 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.614444 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.614557 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.614668 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.614779 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.614893 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.615013 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.615181 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.615296 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.user = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.615407 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.615518 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.615628 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.615751 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.615865 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.615975 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.616085 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.616196 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.616316 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.616428 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.616538 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.616649 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.616759 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.616869 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.616988 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.617100 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.617210 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.617320 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.617432 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.617542 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.617661 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.617773 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.617884 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.617994 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.618104 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.618214 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.618333 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.618446 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.618556 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.618666 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.618776 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.618886 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.619008 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.619153 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.619278 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.619391 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.619391 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.619599 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.619719 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.619831 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.619942 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.620052 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.620162 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.620275 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.620394 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.620508 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.620619 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.620730 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.620839 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.620950 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.621069 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.621182 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.621293 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.621403 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.621514 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.621625 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.621744 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.621857 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.622007 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.622129 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.622241 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.622353 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.622472 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.622584 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.622695 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.622806 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.622926 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.623039 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.623177 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.623293 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.623403 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.623514 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.623624 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] resource.caching = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.623736 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.623855 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.623967 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.624077 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.624188 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.624298 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.624409 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] resource.caching = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.624527 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.624640 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.624751 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.624866 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.624977 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.625087 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.625206 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.625319 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.625429 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.625540 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.625681 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.625795 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.625978 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] role.caching = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.626093 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.626204 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] role.driver = sql {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.626315 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.626426 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.626538 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.626657 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.626769 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] role.caching = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.626881 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.626992 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] role.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.627109 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.627257 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.627381 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.627495 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.627605 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.627717 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.627828 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.627939 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.628060 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.628173 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.628284 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.628395 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.628505 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.628627 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.628739 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.628850 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.628962 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.629073 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.629184 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.629304 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.629416 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.629527 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.629527 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.629736 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.629847 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.629974 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.630087 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.630198 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.630198 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.630406 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.630518 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.630637 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.630750 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.630863 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.630974 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.631085 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.631238 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.631363 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.631477 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.631587 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.631698 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.631808 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.631919 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.632038 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.632151 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.632263 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.632376 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.632486 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.632596 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.632715 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.632827 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.632937 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.633047 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.633159 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.633278 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.633393 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.633503 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.633613 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.633724 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.633834 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.633952 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] token.caching = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.634064 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.634175 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.634286 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.634396 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.634513 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.634632 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.634745 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] token.caching = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.634855 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.634993 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.635104 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.635265 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.635389 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.635503 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.635613 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.635724 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.635835 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.635945 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.636063 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.636175 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.636287 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.636397 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.636508 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.636656 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.636779 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.636892 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.637003 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.637114 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.637224 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.637337 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.637456 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.637569 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.637680 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.637790 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.637900 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.638011 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.638130 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] database.connection = **** {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.638285 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.638412 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.638527 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.638637 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.638748 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.638858 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.638968 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.connection = **** {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.639092 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.639092 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.639368 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.639483 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.639596 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.639707 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.639818 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.639938 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.640053 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.640164 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.640276 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.640387 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.640500 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.640622 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.640736 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.640855 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.640968 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.641079 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.641191 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.641311 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.641424 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.641537 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.641649 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.641760 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.641872 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.641992 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.642105 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.642223 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.642337 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.642448 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 02 03:15:30.642561 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.642561 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.642561 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.642561 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 03:15:30.642975 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 02 03:15:30.672291 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 03:15:30.672554 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 03:15:30.672789 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 03:15:30.672879 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 03:15:30.673064 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 03:15:30.673294 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 03:15:30.681170 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 03:15:30.681755 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 03:15:30.709240 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 03:15:30.709461 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 03:15:30.709585 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 03:15:30.709850 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 03:15:30.851211 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 03:15:30.852692 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 03:15:30.899884 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 03:15:30.900021 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 03:15:30.900143 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 03:15:30.900246 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 03:15:30.964504 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 03:15:30.964657 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 03:15:30.964781 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 03:15:30.964864 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 03:15:30.964949 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 03:15:30.965066 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 03:15:30.965158 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 03:15:30.965308 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 03:15:30.965434 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 03:15:30.965572 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 03:15:30.965665 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 03:15:30.965665 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 03:15:30.990616 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 03:15:30.991052 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 03:15:30.991313 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 03:15:30.991571 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 03:15:30.992093 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 03:15:30.992186 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 03:15:30.992262 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 03:15:30.992329 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 03:15:30.992413 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 03:15:30.992489 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 03:15:30.992561 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 03:15:30.992642 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 03:15:30.992717 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 03:15:30.992789 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 03:15:31.003186 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 03:15:31.003525 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 03:15:31.015857 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 03:15:31.016106 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 03:15:31.016373 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 03:15:31.016594 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 03:15:31.016720 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 03:15:31.016862 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 03:15:31.016944 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 03:15:31.017006 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 03:15:31.017141 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 03:15:31.017221 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 03:15:31.017283 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 03:15:31.017400 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 03:15:31.017634 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 03:15:31.017844 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 03:15:31.034465 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.034596 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.034733 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 02 03:15:31.034818 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 02 03:15:31.034995 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.035178 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.035267 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 02 03:15:31.035334 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 02 03:15:31.035458 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.035578 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.035704 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.035810 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.035928 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.036133 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.036259 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.036396 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.047334 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.047526 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.047613 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.047759 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.047905 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.048057 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.048147 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.048284 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.056394 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 03:15:31.056523 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 03:15:31.059712 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 03:15:31.059860 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 03:15:31.060000 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.060084 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.060206 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.060323 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.060525 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.060663 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.060844 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.060971 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.061116 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.061264 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.061395 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.061518 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.061679 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.061816 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.061943 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.062082 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.062213 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.062342 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.062466 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.062595 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.088744 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.088871 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.090346 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 03:15:31.090475 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 03:15:31.090605 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.090709 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.095912 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 03:15:31.096041 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 03:15:31.096171 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.096259 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.096568 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.096715 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.103840 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 03:15:31.103969 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 03:15:31.104109 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.104190 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.108570 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 03:15:31.108697 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 03:15:31.108828 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.108913 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.109113 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.109261 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.109401 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.109482 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.109643 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.109770 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.109953 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.110058 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.110188 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.110266 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.110451 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.110579 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.129269 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.129553 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.130673 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.130955 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.134127 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 03:15:31.136513 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 03:15:31.137788 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.138082 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.140155 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.140446 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.143352 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 03:15:31.145977 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 03:15:31.146943 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 03:15:31.149583 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 03:15:31.150674 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.150908 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.151211 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.151490 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.151779 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.152056 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.153263 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.153553 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.153832 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.154111 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.154400 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.154656 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.171374 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 03:15:31.171657 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.171920 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.172190 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.174213 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 03:15:31.174494 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.174756 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.175012 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.180224 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.181939 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.182183 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.182895 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.184628 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.184899 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.185584 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 03:15:31.185866 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.186143 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.186424 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.186715 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.188124 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 03:15:31.188402 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.188676 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.189300 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.189555 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.199987 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 03:15:31.200263 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.200546 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.200823 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.201099 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.202716 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.202856 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 03:15:31.202996 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.203078 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.203364 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.203659 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.203994 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.205615 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.205912 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.220925 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 03:15:31.223665 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 03:15:31.224214 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 03:15:31.226889 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 03:15:31.227580 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.229324 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.230223 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.230950 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 03:15:31.231249 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.231526 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.231982 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.233606 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 03:15:31.233880 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.234153 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.239010 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.240642 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 03:15:31.241663 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.243287 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 03:15:31.243898 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.244187 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.244577 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.244852 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.246487 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.246772 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.247163 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.247456 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.253978 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 03:15:31.254265 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.254549 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.256553 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 03:15:31.256836 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.257112 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.262411 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 03:15:31.262688 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.262961 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.263251 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.263517 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.263885 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.264179 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.264447 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.264776 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.264921 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 03:15:31.265061 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.265184 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.265302 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.265423 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.265548 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.265690 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.265815 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.265944 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.266114 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.266398 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.266657 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.266919 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.267253 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.267496 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.267762 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.268015 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.268286 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.268547 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 03:15:31.303997 dv-cinder-846842-9-smb devstack@keystone.service[80234]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cc66f019c0 pid: 80234 (default app) Jul 02 03:15:31.306488 dv-cinder-846842-9-smb devstack@keystone.service[80233]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cc66f019c0 pid: 80233 (default app) Jul 02 03:15:31.307423 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d770d-1b3b-4417-9deb-3f947a9d12ae None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:31.307715 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d770d-1b3b-4417-9deb-3f947a9d12ae None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:31.307995 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d770d-1b3b-4417-9deb-3f947a9d12ae None None] PATH_INFO: `/v3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:31.312195 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1/1] 10.222.0.60 () {50 vars in 791 bytes} [Sat Jul 2 03:15:31 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:15:39.073232 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baecb09-e2b2-4227-a1e6-6b4c59a20051 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:39.073837 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baecb09-e2b2-4227-a1e6-6b4c59a20051 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:39.073837 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baecb09-e2b2-4227-a1e6-6b4c59a20051 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:39.081406 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1/2] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:15:39 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 03:15:39.090498 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46be6c-9353-4f0b-aa32-1771af6cf97b None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:39.090999 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46be6c-9353-4f0b-aa32-1771af6cf97b None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:39.090999 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46be6c-9353-4f0b-aa32-1771af6cf97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:39.176269 dv-cinder-846842-9-smb devstack@keystone.service[80234]: INFO dbcounter [None req-5d46be6c-9353-4f0b-aa32-1771af6cf97b None None] Registered counter for database keystone Jul 02 03:15:39.201406 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG oslo_db.sqlalchemy.engines [None req-5d46be6c-9353-4f0b-aa32-1771af6cf97b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80234) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 02 03:15:39.213625 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writer thread running {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 02 03:15:39.400653 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG passlib.handlers.bcrypt [None req-5d46be6c-9353-4f0b-aa32-1771af6cf97b None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80234) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 02 03:15:39.401082 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG passlib.handlers.bcrypt [None req-5d46be6c-9353-4f0b-aa32-1771af6cf97b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80234) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 02 03:15:39.456917 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-5d46be6c-9353-4f0b-aa32-1771af6cf97b None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:15:39.458531 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5d46be6c-9353-4f0b-aa32-1771af6cf97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:15:39.585037 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 2/3] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:15:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 495 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 02 03:15:39.834311 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baecb09-e2b2-4227-a1e6-6b4c59a20051 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:15:39.909315 dv-cinder-846842-9-smb devstack@keystone.service[80233]: INFO dbcounter [None req-4baecb09-e2b2-4227-a1e6-6b4c59a20051 None None] Registered counter for database keystone Jul 02 03:15:39.931008 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG oslo_db.sqlalchemy.engines [None req-4baecb09-e2b2-4227-a1e6-6b4c59a20051 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80233) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 02 03:15:39.940143 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writer thread running {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 02 03:15:40.058341 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baecb09-e2b2-4227-a1e6-6b4c59a20051 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:15:40.063753 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2008d25-4b9e-455f-904e-ef357245d851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:15:40.064403 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2008d25-4b9e-455f-904e-ef357245d851 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:40.064686 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2008d25-4b9e-455f-904e-ef357245d851 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:40.064955 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2008d25-4b9e-455f-904e-ef357245d851 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:40.074037 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2008d25-4b9e-455f-904e-ef357245d851 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:15:40.125718 dv-cinder-846842-9-smb devstack@keystone.service[80233]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a2008d25-4b9e-455f-904e-ef357245d851 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 02 03:15:40.126211 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2008d25-4b9e-455f-904e-ef357245d851 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:15:40.138873 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 2/4] 10.222.0.60 () {58 vars in 1324 bytes} [Sat Jul 2 03:15:39 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 03:15:40.148845 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d46be6c-9353-4f0b-aa32-1771af6cf97b None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:15:40.173135 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d46be6c-9353-4f0b-aa32-1771af6cf97b None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:15:40.178991 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b830ec-3458-4223-930f-ba068da20361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:15:40.180156 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b830ec-3458-4223-930f-ba068da20361 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:40.180442 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b830ec-3458-4223-930f-ba068da20361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:40.180718 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b830ec-3458-4223-930f-ba068da20361 admin admin] PATH_INFO: `/v3/projects/b5b36ebb11744ee2a29802eb5f4d8e11` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:40.182395 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b830ec-3458-4223-930f-ba068da20361 admin admin] RBAC: Authorizing `identity:get_project(project_id=b5b36ebb11744ee2a29802eb5f4d8e11)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:15:40.235449 dv-cinder-846842-9-smb devstack@keystone.service[80234]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b6b830ec-3458-4223-930f-ba068da20361 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 02 03:15:40.235792 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b830ec-3458-4223-930f-ba068da20361 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:15:40.240470 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 3/5] 10.222.0.60 () {56 vars in 1207 bytes} [Sat Jul 2 03:15:40 2022] GET /identity/v3/projects/b5b36ebb11744ee2a29802eb5f4d8e11 => generated 344 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:15:42.227300 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab2f57-d3f7-4224-9726-e04baa429e46 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:42.227868 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab2f57-d3f7-4224-9726-e04baa429e46 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:42.227868 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab2f57-d3f7-4224-9726-e04baa429e46 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:42.232008 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 3/6] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:15:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:15:42.238666 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760da7b6-ed17-40fa-9f4d-a306add0c57f None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:42.239412 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760da7b6-ed17-40fa-9f4d-a306add0c57f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:42.239600 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760da7b6-ed17-40fa-9f4d-a306add0c57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:42.263900 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-760da7b6-ed17-40fa-9f4d-a306add0c57f None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:15:42.265432 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-760da7b6-ed17-40fa-9f4d-a306add0c57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:15:42.274950 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 4/7] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:15:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 02 03:15:42.306169 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab2f57-d3f7-4224-9726-e04baa429e46 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:15:42.320555 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab2f57-d3f7-4224-9726-e04baa429e46 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:15:42.325990 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585ee425-69a6-4322-b19a-157e2b20920c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:15:42.326614 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ee425-69a6-4322-b19a-157e2b20920c admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:42.326894 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ee425-69a6-4322-b19a-157e2b20920c admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:42.327179 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ee425-69a6-4322-b19a-157e2b20920c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:42.335858 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585ee425-69a6-4322-b19a-157e2b20920c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:15:42.337630 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585ee425-69a6-4322-b19a-157e2b20920c admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:15:42.347266 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 4/8] 10.222.0.60 () {58 vars in 1324 bytes} [Sat Jul 2 03:15:42 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 03:15:42.352971 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760da7b6-ed17-40fa-9f4d-a306add0c57f None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:15:42.365423 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760da7b6-ed17-40fa-9f4d-a306add0c57f None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:15:42.371229 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c201c2c-a572-44fd-b84a-9fc1a1e87da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:15:42.372078 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c201c2c-a572-44fd-b84a-9fc1a1e87da5 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:42.372383 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c201c2c-a572-44fd-b84a-9fc1a1e87da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:42.372655 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c201c2c-a572-44fd-b84a-9fc1a1e87da5 admin admin] PATH_INFO: `/v3/users/6fcf66469a4a46abb312bd46ef8e4455` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:42.374284 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c201c2c-a572-44fd-b84a-9fc1a1e87da5 admin admin] RBAC: Authorizing `identity:get_user(user_id=6fcf66469a4a46abb312bd46ef8e4455)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:15:42.376182 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c201c2c-a572-44fd-b84a-9fc1a1e87da5 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:15:42.377789 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 5/9] 10.222.0.60 () {56 vars in 1198 bytes} [Sat Jul 2 03:15:42 2022] GET /identity/v3/users/6fcf66469a4a46abb312bd46ef8e4455 => generated 247 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:15:44.432037 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9cc5f-dd99-4f2d-9fd8-9e32a823f18d None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:44.432595 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9cc5f-dd99-4f2d-9fd8-9e32a823f18d None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:44.432595 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9cc5f-dd99-4f2d-9fd8-9e32a823f18d None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:44.433933 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 5/10] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:15:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:15:44.439408 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6882ca94-df40-479e-a341-cfe2bfb35b4f None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:44.439862 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6882ca94-df40-479e-a341-cfe2bfb35b4f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:44.439990 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6882ca94-df40-479e-a341-cfe2bfb35b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:44.456964 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-6882ca94-df40-479e-a341-cfe2bfb35b4f None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:15:44.458138 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-6882ca94-df40-479e-a341-cfe2bfb35b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:15:44.484779 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e320f3-f180-4a21-a552-08716ebdf391 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:44.485067 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e320f3-f180-4a21-a552-08716ebdf391 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:44.485344 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e320f3-f180-4a21-a552-08716ebdf391 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:44.486690 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 6/11] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:15:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:15:44.491736 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ebae55-9f36-4a75-82f1-fc28e123fccf None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:44.492025 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ebae55-9f36-4a75-82f1-fc28e123fccf None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:44.492301 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ebae55-9f36-4a75-82f1-fc28e123fccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:44.532578 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG passlib.handlers.bcrypt [None req-c2ebae55-9f36-4a75-82f1-fc28e123fccf None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80233) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 02 03:15:44.532998 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG passlib.handlers.bcrypt [None req-c2ebae55-9f36-4a75-82f1-fc28e123fccf None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80233) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 02 03:15:44.540737 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 6/12] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:15:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 03:15:44.563938 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6882ca94-df40-479e-a341-cfe2bfb35b4f None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:15:44.578529 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-c2ebae55-9f36-4a75-82f1-fc28e123fccf None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:15:44.580153 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-c2ebae55-9f36-4a75-82f1-fc28e123fccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:15:44.587675 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:15:44.667064 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6882ca94-df40-479e-a341-cfe2bfb35b4f None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:15:44.678894 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 7/13] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:15:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 03:15:44.700929 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4468f97a-93ce-4212-b26f-1e6c1369bd75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:15:44.701173 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ebae55-9f36-4a75-82f1-fc28e123fccf None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:15:44.701861 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468f97a-93ce-4212-b26f-1e6c1369bd75 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:44.702202 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468f97a-93ce-4212-b26f-1e6c1369bd75 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:44.702535 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468f97a-93ce-4212-b26f-1e6c1369bd75 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:44.714345 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4468f97a-93ce-4212-b26f-1e6c1369bd75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:15:44.725530 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-4468f97a-93ce-4212-b26f-1e6c1369bd75 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 03:15:44.725530 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:15:44.725530 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:15:44.725530 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:15:44.725530 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:15:44.725530 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:15:44.725530 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:15:44.725530 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:15:44.725530 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:15:44.725530 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:15:44.725530 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:15:44.725530 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:15:44.725530 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:15:44.725530 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:15:44.725530 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:15:44.725530 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:15:44.726408 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:15:44.726408 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:15:44.726408 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:15:44.726408 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:15:44.726408 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:15:44.726408 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:15:44.726408 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:15:44.726408 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:15:44.726408 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:15:44.726408 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:15:44.726408 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:15:44.726408 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:15:44.726408 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:15:44.726408 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:15:44.726408 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:15:44.726408 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:15:44.727479 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:15:44.727479 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:15:44.727479 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:15:44.727479 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:15:44.727479 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:15:44.727479 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:15:44.727479 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:15:44.727479 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:15:44.727479 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:15:44.727479 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:15:44.727479 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 03:15:44.727479 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:15:44.727479 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 7/14] 10.222.0.60 () {56 vars in 1096 bytes} [Sat Jul 2 03:15:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 03:15:44.732550 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4468f97a-93ce-4212-b26f-1e6c1369bd75 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:15:44.802630 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ebae55-9f36-4a75-82f1-fc28e123fccf None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:15:44.804919 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:15:44.813104 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:15:44.831837 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4468f97a-93ce-4212-b26f-1e6c1369bd75 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:15:44.841739 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a448bf-e76f-4993-8aef-adb301f32458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:15:44.842651 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a448bf-e76f-4993-8aef-adb301f32458 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:44.842940 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a448bf-e76f-4993-8aef-adb301f32458 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:44.843257 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a448bf-e76f-4993-8aef-adb301f32458 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:44.863883 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf901dd-c7be-4cc0-82a5-bb582442c45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:15:44.864544 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf901dd-c7be-4cc0-82a5-bb582442c45f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:44.864822 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf901dd-c7be-4cc0-82a5-bb582442c45f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:44.865094 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf901dd-c7be-4cc0-82a5-bb582442c45f None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:44.865845 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf901dd-c7be-4cc0-82a5-bb582442c45f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:15:44.866148 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf901dd-c7be-4cc0-82a5-bb582442c45f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:15:44.867590 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf901dd-c7be-4cc0-82a5-bb582442c45f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:15:44.878989 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 8/15] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Jul 2 03:15:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:15:44.884535 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf901dd-c7be-4cc0-82a5-bb582442c45f None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:15:44.912072 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a448bf-e76f-4993-8aef-adb301f32458 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:15:44.913596 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a448bf-e76f-4993-8aef-adb301f32458 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:15:44.983276 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf901dd-c7be-4cc0-82a5-bb582442c45f None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:15:45.011585 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 8/16] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Jul 2 03:15:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 03:15:45.015885 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e9a6c-a8a7-4b7b-8986-c15be4b5089d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:15:45.016796 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e9a6c-a8a7-4b7b-8986-c15be4b5089d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:45.017050 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a448bf-e76f-4993-8aef-adb301f32458 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:15:45.017143 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e9a6c-a8a7-4b7b-8986-c15be4b5089d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:45.017333 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e9a6c-a8a7-4b7b-8986-c15be4b5089d None admin] PATH_INFO: `/v3/users/6fcf66469a4a46abb312bd46ef8e4455` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:45.018556 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019e9a6c-a8a7-4b7b-8986-c15be4b5089d None admin] RBAC: Authorizing `identity:get_user(user_id=6fcf66469a4a46abb312bd46ef8e4455)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:15:45.019868 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:15:45.020044 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019e9a6c-a8a7-4b7b-8986-c15be4b5089d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:15:45.021672 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 9/17] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Jul 2 03:15:44 2022] GET /identity/v3/users/6fcf66469a4a46abb312bd46ef8e4455 => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:15:45.027327 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e9a6c-a8a7-4b7b-8986-c15be4b5089d None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:15:45.041663 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:15:45.128309 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e9a6c-a8a7-4b7b-8986-c15be4b5089d None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:15:45.131644 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a448bf-e76f-4993-8aef-adb301f32458 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:15:45.162769 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba9b35-47b7-4fb5-8b71-8cee59c9d164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:15:45.163808 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba9b35-47b7-4fb5-8b71-8cee59c9d164 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:45.164075 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba9b35-47b7-4fb5-8b71-8cee59c9d164 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:45.164342 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba9b35-47b7-4fb5-8b71-8cee59c9d164 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:45.164609 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f7b486-534b-48fd-b740-d0977241a21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:15:45.165400 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f7b486-534b-48fd-b740-d0977241a21b None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:45.165567 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ba9b35-47b7-4fb5-8b71-8cee59c9d164 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:15:45.165665 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f7b486-534b-48fd-b740-d0977241a21b None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:45.165941 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f7b486-534b-48fd-b740-d0977241a21b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:45.166966 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ba9b35-47b7-4fb5-8b71-8cee59c9d164 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:15:45.168918 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 10/18] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:15:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:15:45.174719 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba9b35-47b7-4fb5-8b71-8cee59c9d164 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:15:45.186252 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f7b486-534b-48fd-b740-d0977241a21b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:15:45.187850 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f7b486-534b-48fd-b740-d0977241a21b None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:15:45.207918 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-15f7b486-534b-48fd-b740-d0977241a21b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:15:45.207918 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:15:45.207918 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:15:45.207918 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:15:45.207918 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:15:45.207918 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:15:45.207918 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:15:45.207918 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:15:45.207918 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:15:45.207918 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:15:45.207918 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:15:45.207918 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:15:45.207918 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:15:45.207918 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:15:45.207918 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:15:45.208740 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:15:45.208740 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:15:45.208740 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:15:45.208740 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:15:45.208740 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:15:45.208740 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:15:45.208740 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:15:45.208740 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:15:45.208740 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:15:45.208740 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:15:45.208740 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:15:45.208740 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:15:45.208740 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:15:45.208740 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:15:45.208740 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:15:45.208740 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:15:45.208740 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:15:45.209509 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:15:45.209509 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:15:45.209509 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:15:45.209509 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:15:45.209509 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 9/19] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:15:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 03:15:45.215277 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f7b486-534b-48fd-b740-d0977241a21b None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:15:45.257510 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:15:45.271698 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:15:45.277994 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba9b35-47b7-4fb5-8b71-8cee59c9d164 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:15:45.316710 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1539e3-3fc7-4938-81db-cfb4ecfc735a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:15:45.317443 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1539e3-3fc7-4938-81db-cfb4ecfc735a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:45.317723 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1539e3-3fc7-4938-81db-cfb4ecfc735a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:45.317994 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1539e3-3fc7-4938-81db-cfb4ecfc735a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:45.319009 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f7b486-534b-48fd-b740-d0977241a21b None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:15:45.319100 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1539e3-3fc7-4938-81db-cfb4ecfc735a None admin] RBAC: Adding query filter params (role.id=5dcd130cda6c490595e862dc2348e83d, scope.domain.id=default, user.id=6fcf66469a4a46abb312bd46ef8e4455) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:15:45.319492 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1539e3-3fc7-4938-81db-cfb4ecfc735a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:15:45.320969 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1539e3-3fc7-4938-81db-cfb4ecfc735a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:15:45.328024 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 11/20] 10.222.0.60 () {56 vars in 1322 bytes} [Sat Jul 2 03:15:45 2022] GET /identity/v3/role_assignments?user.id=6fcf66469a4a46abb312bd46ef8e4455&scope.domain.id=default&role.id=5dcd130cda6c490595e862dc2348e83d => generated 233 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:15:45.365073 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca7439f-2cd0-41c8-9b06-747271c10b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:15:45.365757 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7439f-2cd0-41c8-9b06-747271c10b09 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:45.366043 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7439f-2cd0-41c8-9b06-747271c10b09 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:45.366318 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7439f-2cd0-41c8-9b06-747271c10b09 None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:45.367061 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca7439f-2cd0-41c8-9b06-747271c10b09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:15:45.367404 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca7439f-2cd0-41c8-9b06-747271c10b09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:15:45.368850 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca7439f-2cd0-41c8-9b06-747271c10b09 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:15:45.389830 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 10/21] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:15:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:15:47.630343 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de05df2f-812a-421e-8dbc-2bfd7601a94a None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:47.630844 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de05df2f-812a-421e-8dbc-2bfd7601a94a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:47.630844 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de05df2f-812a-421e-8dbc-2bfd7601a94a None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:47.632243 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 12/22] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:15:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:15:47.637736 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3c671-f6ca-4b13-83fb-f455a6b842c7 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:47.638136 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3c671-f6ca-4b13-83fb-f455a6b842c7 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:47.638299 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3c671-f6ca-4b13-83fb-f455a6b842c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:47.674011 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-61e3c671-f6ca-4b13-83fb-f455a6b842c7 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:15:47.675225 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-61e3c671-f6ca-4b13-83fb-f455a6b842c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:15:47.762855 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 11/23] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:15:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 02 03:15:47.794121 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff612d6-ad00-4849-a28c-040aa8199af0 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:47.794418 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff612d6-ad00-4849-a28c-040aa8199af0 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:47.794682 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff612d6-ad00-4849-a28c-040aa8199af0 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:47.796290 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 13/24] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:15:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:15:47.805235 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff612d6-ad00-4849-a28c-040aa8199af0 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:15:47.816767 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3256112-841e-4a7f-ab26-3dfd9c7a5493 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:47.817154 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3256112-841e-4a7f-ab26-3dfd9c7a5493 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:47.817376 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3256112-841e-4a7f-ab26-3dfd9c7a5493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:47.854966 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-f3256112-841e-4a7f-ab26-3dfd9c7a5493 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:15:47.856204 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-f3256112-841e-4a7f-ab26-3dfd9c7a5493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:15:47.947563 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:15:47.997920 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 12/25] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:15:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 03:15:48.008061 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff612d6-ad00-4849-a28c-040aa8199af0 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:15:48.038631 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3256112-841e-4a7f-ab26-3dfd9c7a5493 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:15:48.065208 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a946358c-b7ee-4c12-be88-90ee6b816f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:15:48.066343 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a946358c-b7ee-4c12-be88-90ee6b816f01 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:48.066817 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a946358c-b7ee-4c12-be88-90ee6b816f01 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:48.067301 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a946358c-b7ee-4c12-be88-90ee6b816f01 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:48.099411 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a946358c-b7ee-4c12-be88-90ee6b816f01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:15:48.115457 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-a946358c-b7ee-4c12-be88-90ee6b816f01 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 03:15:48.115457 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:15:48.115457 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:15:48.115457 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:15:48.115457 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:15:48.115457 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:15:48.115457 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:15:48.115457 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:15:48.115457 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:15:48.115457 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:15:48.115457 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:15:48.115457 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:15:48.115457 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:15:48.115457 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:15:48.115457 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:15:48.115457 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:15:48.116306 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:15:48.116306 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:15:48.116306 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:15:48.116306 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:15:48.116306 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:15:48.116306 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:15:48.116306 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:15:48.116306 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:15:48.116306 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:15:48.116306 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:15:48.116306 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:15:48.116306 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:15:48.116306 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:15:48.116306 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:15:48.116306 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:15:48.116306 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:15:48.117046 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:15:48.117046 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:15:48.117046 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:15:48.117046 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:15:48.117046 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:15:48.117046 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:15:48.117046 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:15:48.117046 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:15:48.117046 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:15:48.117046 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:15:48.117046 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 03:15:48.117046 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:15:48.119781 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 14/26] 10.222.0.60 () {56 vars in 1096 bytes} [Sat Jul 2 03:15:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 03:15:48.121250 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432441bd-d9d6-4362-9fc7-41a63ac5b077 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:48.121742 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432441bd-d9d6-4362-9fc7-41a63ac5b077 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:48.122256 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432441bd-d9d6-4362-9fc7-41a63ac5b077 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:48.129163 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 15/27] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:15:48 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:15:48.136359 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3836f8b4-8a33-4999-911f-cb19739339e6 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:48.136916 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3836f8b4-8a33-4999-911f-cb19739339e6 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:48.137401 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3836f8b4-8a33-4999-911f-cb19739339e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:48.147151 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3256112-841e-4a7f-ab26-3dfd9c7a5493 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:15:48.164196 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:15:48.177198 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67643e9c-2571-4c84-ad8e-4366703a30a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:15:48.178004 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67643e9c-2571-4c84-ad8e-4366703a30a6 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:48.178293 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67643e9c-2571-4c84-ad8e-4366703a30a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:48.178569 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67643e9c-2571-4c84-ad8e-4366703a30a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:48.188102 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-3836f8b4-8a33-4999-911f-cb19739339e6 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:15:48.189199 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67643e9c-2571-4c84-ad8e-4366703a30a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:15:48.189766 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3836f8b4-8a33-4999-911f-cb19739339e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:15:48.190668 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67643e9c-2571-4c84-ad8e-4366703a30a6 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:15:48.209768 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-67643e9c-2571-4c84-ad8e-4366703a30a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:15:48.209768 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:15:48.209768 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:15:48.209768 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:15:48.209768 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:15:48.209768 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:15:48.209768 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:15:48.209768 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:15:48.209768 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:15:48.209768 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:15:48.209768 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:15:48.209768 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:15:48.209768 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:15:48.209768 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:15:48.209768 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:15:48.210560 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:15:48.210560 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:15:48.210560 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:15:48.210560 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:15:48.210560 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:15:48.210560 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:15:48.210560 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:15:48.210560 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:15:48.210560 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:15:48.210560 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:15:48.210560 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:15:48.210560 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:15:48.210560 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:15:48.210560 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:15:48.210560 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:15:48.210560 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:15:48.210560 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:15:48.211369 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:15:48.211369 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:15:48.211369 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:15:48.211369 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:15:48.211369 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 13/28] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:15:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 03:15:48.212343 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67643e9c-2571-4c84-ad8e-4366703a30a6 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:15:48.247518 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:15:48.342590 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67643e9c-2571-4c84-ad8e-4366703a30a6 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:15:48.362953 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 16/29] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:15:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 03:15:48.363656 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3836f8b4-8a33-4999-911f-cb19739339e6 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:15:48.378185 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a5ee6-b817-4e42-ba18-acedcc925779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:15:48.378860 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a5ee6-b817-4e42-ba18-acedcc925779 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:48.379322 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a5ee6-b817-4e42-ba18-acedcc925779 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:48.379736 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a5ee6-b817-4e42-ba18-acedcc925779 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:48.381118 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430a5ee6-b817-4e42-ba18-acedcc925779 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:15:48.381676 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430a5ee6-b817-4e42-ba18-acedcc925779 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:15:48.383251 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430a5ee6-b817-4e42-ba18-acedcc925779 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:15:48.396999 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 14/30] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Jul 2 03:15:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:15:48.404328 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a5ee6-b817-4e42-ba18-acedcc925779 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:15:48.505255 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:15:48.515832 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a5ee6-b817-4e42-ba18-acedcc925779 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:15:48.532343 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3836f8b4-8a33-4999-911f-cb19739339e6 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:15:48.551607 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87979ef0-5e38-42e1-8ff1-f0792d55a41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:15:48.552859 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87979ef0-5e38-42e1-8ff1-f0792d55a41b None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:48.553352 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87979ef0-5e38-42e1-8ff1-f0792d55a41b None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:48.553919 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87979ef0-5e38-42e1-8ff1-f0792d55a41b None admin] PATH_INFO: `/v3/users/6fcf66469a4a46abb312bd46ef8e4455` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:48.555715 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87979ef0-5e38-42e1-8ff1-f0792d55a41b None admin] RBAC: Authorizing `identity:get_user(user_id=6fcf66469a4a46abb312bd46ef8e4455)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:15:48.557363 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87979ef0-5e38-42e1-8ff1-f0792d55a41b None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:15:48.559326 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 15/31] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Jul 2 03:15:48 2022] GET /identity/v3/users/6fcf66469a4a46abb312bd46ef8e4455 => generated 247 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:15:48.560266 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87979ef0-5e38-42e1-8ff1-f0792d55a41b None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:15:48.569069 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd7c31c-f819-46e4-8153-c7151306792f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:15:48.569999 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd7c31c-f819-46e4-8153-c7151306792f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:48.570520 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd7c31c-f819-46e4-8153-c7151306792f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:48.570938 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd7c31c-f819-46e4-8153-c7151306792f None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:48.571931 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd7c31c-f819-46e4-8153-c7151306792f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:15:48.572408 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd7c31c-f819-46e4-8153-c7151306792f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:15:48.574240 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd7c31c-f819-46e4-8153-c7151306792f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:15:48.579433 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:15:48.594951 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 17/32] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:15:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:15:48.596696 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa225dda-a8fc-474e-939b-deb0a5a5024a None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:48.597425 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa225dda-a8fc-474e-939b-deb0a5a5024a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:48.597878 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa225dda-a8fc-474e-939b-deb0a5a5024a None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:48.599485 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 18/33] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:15:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:15:48.604361 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa225dda-a8fc-474e-939b-deb0a5a5024a None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:15:48.663537 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87979ef0-5e38-42e1-8ff1-f0792d55a41b None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:15:48.697648 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30f1370-0e2a-445d-bd2e-4737afebaf3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:15:48.698408 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f1370-0e2a-445d-bd2e-4737afebaf3f None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:48.698585 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f1370-0e2a-445d-bd2e-4737afebaf3f None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:48.698861 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f1370-0e2a-445d-bd2e-4737afebaf3f None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:48.699658 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30f1370-0e2a-445d-bd2e-4737afebaf3f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:15:48.701052 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30f1370-0e2a-445d-bd2e-4737afebaf3f None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:15:48.718088 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa225dda-a8fc-474e-939b-deb0a5a5024a None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:15:48.754326 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12654407-cd08-4434-be57-aa2cc785b901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:15:48.755569 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12654407-cd08-4434-be57-aa2cc785b901 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:48.756124 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12654407-cd08-4434-be57-aa2cc785b901 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:48.756607 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12654407-cd08-4434-be57-aa2cc785b901 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:48.758336 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12654407-cd08-4434-be57-aa2cc785b901 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:15:48.760056 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12654407-cd08-4434-be57-aa2cc785b901 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:15:48.762539 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 19/34] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:15:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:15:48.763647 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12654407-cd08-4434-be57-aa2cc785b901 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:15:48.830754 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:15:48.834863 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 16/35] 10.222.0.60 () {60 vars in 1131 bytes} [Sat Jul 2 03:15:48 2022] POST /identity/v3/roles => generated 219 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:15:48.836626 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10570b-5101-412d-8b50-c28865597fa1 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:48.836918 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10570b-5101-412d-8b50-c28865597fa1 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:48.837206 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10570b-5101-412d-8b50-c28865597fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:48.856986 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-fe10570b-5101-412d-8b50-c28865597fa1 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:15:48.858588 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-fe10570b-5101-412d-8b50-c28865597fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:15:48.873990 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:15:48.885048 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12654407-cd08-4434-be57-aa2cc785b901 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:15:48.927327 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72d2394-1ef6-40b8-8d85-72fc2a3966e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:15:48.928445 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d2394-1ef6-40b8-8d85-72fc2a3966e2 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:48.929038 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d2394-1ef6-40b8-8d85-72fc2a3966e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:48.929600 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d2394-1ef6-40b8-8d85-72fc2a3966e2 None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:48.930637 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72d2394-1ef6-40b8-8d85-72fc2a3966e2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:15:48.932641 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72d2394-1ef6-40b8-8d85-72fc2a3966e2 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:15:48.937477 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 17/36] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:15:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 03:15:48.938506 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe10570b-5101-412d-8b50-c28865597fa1 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:15:49.058165 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe10570b-5101-412d-8b50-c28865597fa1 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:15:49.100822 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431fca56-50e3-4413-9fca-aa7b0a47ba51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:15:49.101725 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431fca56-50e3-4413-9fca-aa7b0a47ba51 None admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:49.102006 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431fca56-50e3-4413-9fca-aa7b0a47ba51 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:49.102282 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431fca56-50e3-4413-9fca-aa7b0a47ba51 None admin] PATH_INFO: `/v3/domains/default/users/6fcf66469a4a46abb312bd46ef8e4455/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:49.104757 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431fca56-50e3-4413-9fca-aa7b0a47ba51 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=6fcf66469a4a46abb312bd46ef8e4455, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:15:49.106395 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431fca56-50e3-4413-9fca-aa7b0a47ba51 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:15:49.128985 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 18/37] 10.222.0.60 () {58 vars in 1361 bytes} [Sat Jul 2 03:15:48 2022] PUT /identity/v3/domains/default/users/6fcf66469a4a46abb312bd46ef8e4455/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:15:49.130592 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58196d75-5a61-4161-a8de-9d96a8990015 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:49.130890 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58196d75-5a61-4161-a8de-9d96a8990015 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:49.131220 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58196d75-5a61-4161-a8de-9d96a8990015 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:49.133171 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 19/38] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:15:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:15:49.134073 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58196d75-5a61-4161-a8de-9d96a8990015 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:15:49.148364 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:15:49.202217 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 20/39] 10.222.0.60 () {60 vars in 1141 bytes} [Sat Jul 2 03:15:48 2022] POST /identity/v3/projects => generated 301 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:15:49.204388 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee0b20-9a1a-495e-ae28-ad11617f3797 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:49.204903 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee0b20-9a1a-495e-ae28-ad11617f3797 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:49.205427 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee0b20-9a1a-495e-ae28-ad11617f3797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:49.226398 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-f9ee0b20-9a1a-495e-ae28-ad11617f3797 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:15:49.228437 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f9ee0b20-9a1a-495e-ae28-ad11617f3797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:15:49.268020 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58196d75-5a61-4161-a8de-9d96a8990015 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:15:49.306576 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 21/40] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:15:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 03:15:49.311234 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa43f7-0860-46ac-9656-4254d5a5d7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:15:49.311234 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa43f7-0860-46ac-9656-4254d5a5d7c0 None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:49.311234 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa43f7-0860-46ac-9656-4254d5a5d7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:49.311234 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa43f7-0860-46ac-9656-4254d5a5d7c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:49.311572 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fa43f7-0860-46ac-9656-4254d5a5d7c0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:15:49.311572 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fa43f7-0860-46ac-9656-4254d5a5d7c0 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:15:49.329458 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 20/41] 10.222.0.60 () {60 vars in 1131 bytes} [Sat Jul 2 03:15:49 2022] POST /identity/v3/roles => generated 225 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:15:49.340295 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ee0b20-9a1a-495e-ae28-ad11617f3797 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:15:49.410644 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:15:49.475863 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ee0b20-9a1a-495e-ae28-ad11617f3797 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:15:49.495007 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ebb022-faa1-4eee-b7e9-5adc64a47b07 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:49.495347 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ebb022-faa1-4eee-b7e9-5adc64a47b07 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:49.495602 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ebb022-faa1-4eee-b7e9-5adc64a47b07 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:49.497012 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 21/42] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:15:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 03:15:49.503484 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759f5c3-0d9f-4869-a3fd-b3dfa6c07424 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:49.503806 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759f5c3-0d9f-4869-a3fd-b3dfa6c07424 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:49.504056 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759f5c3-0d9f-4869-a3fd-b3dfa6c07424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:49.530174 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-c759f5c3-0d9f-4869-a3fd-b3dfa6c07424 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:15:49.531269 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1461ac-522f-4c53-bf60-74794d42a3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:15:49.532014 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1461ac-522f-4c53-bf60-74794d42a3b7 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:49.532303 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1461ac-522f-4c53-bf60-74794d42a3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:49.532507 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-c759f5c3-0d9f-4869-a3fd-b3dfa6c07424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:15:49.532621 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1461ac-522f-4c53-bf60-74794d42a3b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:49.533355 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1461ac-522f-4c53-bf60-74794d42a3b7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:15:49.534916 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1461ac-522f-4c53-bf60-74794d42a3b7 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:15:49.560966 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 22/43] 10.222.0.60 () {60 vars in 1131 bytes} [Sat Jul 2 03:15:49 2022] POST /identity/v3/roles => generated 223 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:15:49.613547 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:15:49.620397 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 22/44] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:15:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 02 03:15:49.645091 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1461ac-522f-4c53-bf60-74794d42a3b7 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:15:49.752375 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1461ac-522f-4c53-bf60-74794d42a3b7 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:15:49.754716 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:15:49.789501 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d74588-7dd4-415d-a14d-33c1a5b769a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:15:49.790301 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d74588-7dd4-415d-a14d-33c1a5b769a4 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:49.790592 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d74588-7dd4-415d-a14d-33c1a5b769a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:49.790867 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d74588-7dd4-415d-a14d-33c1a5b769a4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:49.792176 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d74588-7dd4-415d-a14d-33c1a5b769a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:15:49.793961 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d74588-7dd4-415d-a14d-33c1a5b769a4 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:15:49.795639 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 23/45] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:15:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:15:49.801419 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c759f5c3-0d9f-4869-a3fd-b3dfa6c07424 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:15:49.905005 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c759f5c3-0d9f-4869-a3fd-b3dfa6c07424 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:15:49.939790 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79751cc5-34a2-4cf7-bf90-c60767785a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:15:49.940451 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79751cc5-34a2-4cf7-bf90-c60767785a7f None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:49.940732 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79751cc5-34a2-4cf7-bf90-c60767785a7f None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:49.941008 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79751cc5-34a2-4cf7-bf90-c60767785a7f None admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:49.941708 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79751cc5-34a2-4cf7-bf90-c60767785a7f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:15:49.943212 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79751cc5-34a2-4cf7-bf90-c60767785a7f None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:15:49.972232 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 23/46] 10.222.0.60 () {60 vars in 1141 bytes} [Sat Jul 2 03:15:49 2022] POST /identity/v3/projects => generated 312 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:15:51.347365 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce301a2d-2065-4152-8c22-b1afd085e432 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:51.347906 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce301a2d-2065-4152-8c22-b1afd085e432 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:51.347906 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce301a2d-2065-4152-8c22-b1afd085e432 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:51.349289 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 24/47] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:15:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:15:51.354693 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6127038d-d0f0-4093-9421-232a15d29f1f None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:51.355106 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6127038d-d0f0-4093-9421-232a15d29f1f None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:51.355362 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6127038d-d0f0-4093-9421-232a15d29f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:51.373583 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-6127038d-d0f0-4093-9421-232a15d29f1f None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:15:51.374780 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-6127038d-d0f0-4093-9421-232a15d29f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:15:51.424748 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:15:51.447184 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 24/48] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:15:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 03:15:51.473085 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce301a2d-2065-4152-8c22-b1afd085e432 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:15:51.578114 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce301a2d-2065-4152-8c22-b1afd085e432 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:15:51.612212 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f08fdcc-212e-4ec1-a182-a425bf362c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:15:51.612925 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f08fdcc-212e-4ec1-a182-a425bf362c9c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:51.613166 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f08fdcc-212e-4ec1-a182-a425bf362c9c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:51.613471 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f08fdcc-212e-4ec1-a182-a425bf362c9c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:51.623974 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f08fdcc-212e-4ec1-a182-a425bf362c9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:15:51.631681 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-8f08fdcc-212e-4ec1-a182-a425bf362c9c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 03:15:51.631681 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:15:51.631681 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:15:51.631681 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:15:51.631681 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:15:51.631681 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:15:51.631681 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:15:51.631681 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:15:51.631681 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:15:51.631681 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:15:51.631681 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:15:51.631681 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:15:51.631681 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:15:51.631681 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:15:51.631681 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:15:51.631681 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:15:51.632644 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:15:51.632644 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:15:51.632644 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:15:51.632644 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:15:51.632644 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:15:51.632644 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:15:51.632644 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:15:51.632644 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:15:51.632644 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:15:51.632644 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:15:51.632644 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:15:51.632644 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:15:51.632644 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:15:51.632644 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:15:51.632644 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:15:51.632644 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:15:51.633465 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:15:51.633465 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:15:51.633465 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:15:51.633465 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:15:51.633465 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:15:51.633465 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:15:51.633465 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:15:51.633465 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:15:51.633465 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:15:51.633465 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:15:51.633465 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 03:15:51.633465 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:15:51.633465 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 25/49] 10.222.0.60 () {56 vars in 1096 bytes} [Sat Jul 2 03:15:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:15:51.638888 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6127038d-d0f0-4093-9421-232a15d29f1f None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:15:51.740930 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6127038d-d0f0-4093-9421-232a15d29f1f None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:15:51.776616 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dfb543-02ba-4c53-a983-611157b0b200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:15:51.777277 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dfb543-02ba-4c53-a983-611157b0b200 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:51.777565 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dfb543-02ba-4c53-a983-611157b0b200 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:51.777843 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dfb543-02ba-4c53-a983-611157b0b200 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:51.778599 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dfb543-02ba-4c53-a983-611157b0b200 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:15:51.778908 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dfb543-02ba-4c53-a983-611157b0b200 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:15:51.780332 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dfb543-02ba-4c53-a983-611157b0b200 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:15:51.788762 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 25/50] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Jul 2 03:15:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:15:51.794763 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f08fdcc-212e-4ec1-a182-a425bf362c9c None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:15:51.826880 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:15:51.895364 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f08fdcc-212e-4ec1-a182-a425bf362c9c None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:15:51.929970 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300187f1-bf6b-4174-a4bb-b4db23f97a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:15:51.930831 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300187f1-bf6b-4174-a4bb-b4db23f97a6e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:51.931112 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300187f1-bf6b-4174-a4bb-b4db23f97a6e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:51.931412 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300187f1-bf6b-4174-a4bb-b4db23f97a6e None admin] PATH_INFO: `/v3/users/6fcf66469a4a46abb312bd46ef8e4455` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:51.932655 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300187f1-bf6b-4174-a4bb-b4db23f97a6e None admin] RBAC: Authorizing `identity:get_user(user_id=6fcf66469a4a46abb312bd46ef8e4455)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:15:51.934113 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300187f1-bf6b-4174-a4bb-b4db23f97a6e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:15:51.935760 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 26/51] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Jul 2 03:15:51 2022] GET /identity/v3/users/6fcf66469a4a46abb312bd46ef8e4455 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:15:51.941536 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dfb543-02ba-4c53-a983-611157b0b200 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:15:51.991459 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f2c60-ac6f-4fc2-a658-fc0c82a3c015 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:51.991707 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f2c60-ac6f-4fc2-a658-fc0c82a3c015 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:51.992015 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f2c60-ac6f-4fc2-a658-fc0c82a3c015 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:51.993433 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 27/52] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:15:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:15:51.999348 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a89a18-a318-49ce-b151-682d4cae4f18 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:51.999695 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a89a18-a318-49ce-b151-682d4cae4f18 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:51.999978 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a89a18-a318-49ce-b151-682d4cae4f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:52.018914 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-f9a89a18-a318-49ce-b151-682d4cae4f18 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:15:52.020179 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f9a89a18-a318-49ce-b151-682d4cae4f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:15:52.092564 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 28/53] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:15:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 03:15:52.093285 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:15:52.115677 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a89a18-a318-49ce-b151-682d4cae4f18 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:15:52.146323 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:15:52.154018 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dfb543-02ba-4c53-a983-611157b0b200 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:15:52.188727 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e93939-c5b2-46ca-8e6e-8dd35f2d67b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:15:52.189523 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e93939-c5b2-46ca-8e6e-8dd35f2d67b2 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:52.189799 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e93939-c5b2-46ca-8e6e-8dd35f2d67b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:52.190064 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e93939-c5b2-46ca-8e6e-8dd35f2d67b2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:52.191378 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e93939-c5b2-46ca-8e6e-8dd35f2d67b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:15:52.192842 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e93939-c5b2-46ca-8e6e-8dd35f2d67b2 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:15:52.194480 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 26/54] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:15:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:15:52.200270 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e93939-c5b2-46ca-8e6e-8dd35f2d67b2 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:15:52.216171 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a89a18-a318-49ce-b151-682d4cae4f18 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:15:52.248724 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4b4bb9-76a1-4c11-a308-4ea8a6d7506b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:15:52.249545 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b4bb9-76a1-4c11-a308-4ea8a6d7506b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:52.249835 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b4bb9-76a1-4c11-a308-4ea8a6d7506b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:52.250113 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b4bb9-76a1-4c11-a308-4ea8a6d7506b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:52.251324 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4b4bb9-76a1-4c11-a308-4ea8a6d7506b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:15:52.252797 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4b4bb9-76a1-4c11-a308-4ea8a6d7506b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:15:52.254437 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 29/55] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:15:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:15:52.260072 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4b4bb9-76a1-4c11-a308-4ea8a6d7506b None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:15:52.301700 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e93939-c5b2-46ca-8e6e-8dd35f2d67b2 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:15:52.312261 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:15:52.336812 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6577be5e-127a-440a-89e9-034d3916ca60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:15:52.337474 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6577be5e-127a-440a-89e9-034d3916ca60 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:52.337761 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6577be5e-127a-440a-89e9-034d3916ca60 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:52.338038 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6577be5e-127a-440a-89e9-034d3916ca60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:52.338873 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6577be5e-127a-440a-89e9-034d3916ca60 None admin] RBAC: Adding query filter params (role.id=5dcd130cda6c490595e862dc2348e83d, scope.domain.id=default, user.id=6fcf66469a4a46abb312bd46ef8e4455) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:15:52.339215 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6577be5e-127a-440a-89e9-034d3916ca60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:15:52.340677 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6577be5e-127a-440a-89e9-034d3916ca60 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:15:52.349485 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 27/56] 10.222.0.60 () {56 vars in 1322 bytes} [Sat Jul 2 03:15:52 2022] GET /identity/v3/role_assignments?user.id=6fcf66469a4a46abb312bd46ef8e4455&scope.domain.id=default&role.id=5dcd130cda6c490595e862dc2348e83d => generated 530 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:15:52.356764 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:15:52.361853 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4b4bb9-76a1-4c11-a308-4ea8a6d7506b None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:15:52.403932 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e29cae-6772-4d3f-b0c3-a26aa8818d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:15:52.404568 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e29cae-6772-4d3f-b0c3-a26aa8818d9d None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:52.404855 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e29cae-6772-4d3f-b0c3-a26aa8818d9d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:52.405135 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e29cae-6772-4d3f-b0c3-a26aa8818d9d None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:52.405964 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e29cae-6772-4d3f-b0c3-a26aa8818d9d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:15:52.407522 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e29cae-6772-4d3f-b0c3-a26aa8818d9d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:15:52.435267 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 30/57] 10.222.0.60 () {60 vars in 1140 bytes} [Sat Jul 2 03:15:52 2022] POST /identity/v3/projects => generated 298 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 03:15:54.474269 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4328bc-af43-48ac-9840-ebd28601452e None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:54.475086 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4328bc-af43-48ac-9840-ebd28601452e None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:54.475219 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4328bc-af43-48ac-9840-ebd28601452e None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:54.477509 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 28/58] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:15:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:15:54.482896 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e871e76c-d2ad-4a50-9da0-5ccdad9c01c2 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:54.483334 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e871e76c-d2ad-4a50-9da0-5ccdad9c01c2 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:54.483455 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e871e76c-d2ad-4a50-9da0-5ccdad9c01c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:54.500801 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-e871e76c-d2ad-4a50-9da0-5ccdad9c01c2 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:15:54.501969 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e871e76c-d2ad-4a50-9da0-5ccdad9c01c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:15:54.577854 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 31/59] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:15:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 03:15:54.602838 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4328bc-af43-48ac-9840-ebd28601452e None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:15:54.723393 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4328bc-af43-48ac-9840-ebd28601452e None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:15:54.757624 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4e13b-3160-45b3-87d3-ce73150ef237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:15:54.758396 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4e13b-3160-45b3-87d3-ce73150ef237 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:54.758675 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4e13b-3160-45b3-87d3-ce73150ef237 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:54.758945 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4e13b-3160-45b3-87d3-ce73150ef237 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:54.760260 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a4e13b-3160-45b3-87d3-ce73150ef237 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:15:54.761714 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a4e13b-3160-45b3-87d3-ce73150ef237 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:15:54.763330 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 29/60] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:15:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:15:54.769376 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e871e76c-d2ad-4a50-9da0-5ccdad9c01c2 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:15:54.854875 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:15:54.876767 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e871e76c-d2ad-4a50-9da0-5ccdad9c01c2 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:15:54.909828 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b782b9d-650d-43b9-8021-92bf0a3a3a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:15:54.910488 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b782b9d-650d-43b9-8021-92bf0a3a3a54 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:54.910770 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b782b9d-650d-43b9-8021-92bf0a3a3a54 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:54.911048 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b782b9d-650d-43b9-8021-92bf0a3a3a54 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:54.911790 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b782b9d-650d-43b9-8021-92bf0a3a3a54 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:15:54.913259 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b782b9d-650d-43b9-8021-92bf0a3a3a54 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:15:54.943265 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 32/61] 10.222.0.60 () {60 vars in 1132 bytes} [Sat Jul 2 03:15:54 2022] POST /identity/v3/users => generated 275 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:15:58.125604 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92849151-9ca1-45d4-b86d-802fe48a41e3 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:58.126615 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92849151-9ca1-45d4-b86d-802fe48a41e3 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:58.127142 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92849151-9ca1-45d4-b86d-802fe48a41e3 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:58.128983 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 30/62] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:15:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:15:58.134488 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce258418-5b11-42f6-a3b0-1d2dd145f5bf None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:58.135324 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce258418-5b11-42f6-a3b0-1d2dd145f5bf None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:58.135801 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce258418-5b11-42f6-a3b0-1d2dd145f5bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:58.156659 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-ce258418-5b11-42f6-a3b0-1d2dd145f5bf None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:15:58.157857 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ce258418-5b11-42f6-a3b0-1d2dd145f5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:15:58.227054 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7704097c-ba67-4991-86bb-ceea4501b437 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:58.227917 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7704097c-ba67-4991-86bb-ceea4501b437 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:58.228480 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7704097c-ba67-4991-86bb-ceea4501b437 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:58.230096 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 31/63] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:15:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:15:58.237321 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337babf4-8d73-40e3-bde5-782b2b6b5b1f None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:58.237878 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337babf4-8d73-40e3-bde5-782b2b6b5b1f None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:58.238351 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337babf4-8d73-40e3-bde5-782b2b6b5b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:58.256993 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-337babf4-8d73-40e3-bde5-782b2b6b5b1f None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:15:58.258548 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-337babf4-8d73-40e3-bde5-782b2b6b5b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:15:58.261777 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 33/64] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:15:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 03:15:58.310848 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce258418-5b11-42f6-a3b0-1d2dd145f5bf None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:15:58.316270 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:15:58.355388 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 32/65] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:15:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 03:15:58.363162 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e51128-a9ba-41eb-9dfd-424c8f4fa3cf None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:58.363162 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e51128-a9ba-41eb-9dfd-424c8f4fa3cf None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:58.363162 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e51128-a9ba-41eb-9dfd-424c8f4fa3cf None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:58.363162 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 33/66] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:15:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:15:58.376223 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a24ee-4c0b-40e2-9cb3-a9cdbefa2884 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:58.376451 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a24ee-4c0b-40e2-9cb3-a9cdbefa2884 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:58.376729 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a24ee-4c0b-40e2-9cb3-a9cdbefa2884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:58.405959 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-697a24ee-4c0b-40e2-9cb3-a9cdbefa2884 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:15:58.407363 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:15:58.408173 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-697a24ee-4c0b-40e2-9cb3-a9cdbefa2884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:15:58.448234 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce258418-5b11-42f6-a3b0-1d2dd145f5bf None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:15:58.482039 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 34/67] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:15:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 03:15:58.487213 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd952f5-3363-4df5-9eba-0f6ac69e7470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:15:58.487213 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd952f5-3363-4df5-9eba-0f6ac69e7470 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:58.487213 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd952f5-3363-4df5-9eba-0f6ac69e7470 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:58.487213 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd952f5-3363-4df5-9eba-0f6ac69e7470 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:58.488564 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a24ee-4c0b-40e2-9cb3-a9cdbefa2884 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:15:58.498078 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd952f5-3363-4df5-9eba-0f6ac69e7470 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:15:58.506306 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-9dd952f5-3363-4df5-9eba-0f6ac69e7470 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 02 03:15:58.506306 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:15:58.506306 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:15:58.506306 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:15:58.506306 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:15:58.506306 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:15:58.506306 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:15:58.506306 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:15:58.506306 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:15:58.506306 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:15:58.506306 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:15:58.506306 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:15:58.506306 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:15:58.506306 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:15:58.506306 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:15:58.506306 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:15:58.507502 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:15:58.507502 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:15:58.507502 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:15:58.507502 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:15:58.507502 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:15:58.507502 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:15:58.507502 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:15:58.507502 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:15:58.507502 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:15:58.507502 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:15:58.507502 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:15:58.507502 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:15:58.507502 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:15:58.507502 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:15:58.507502 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:15:58.507502 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:15:58.508259 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:15:58.508259 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:15:58.508259 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:15:58.508259 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:15:58.508259 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:15:58.508259 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:15:58.508259 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:15:58.508259 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:15:58.508259 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:15:58.508259 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:15:58.508259 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 02 03:15:58.508259 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:15:58.510628 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 34/68] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Jul 2 03:15:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 03:15:58.516504 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd952f5-3363-4df5-9eba-0f6ac69e7470 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:15:58.607936 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a24ee-4c0b-40e2-9cb3-a9cdbefa2884 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:15:58.609529 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:15:58.624294 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd952f5-3363-4df5-9eba-0f6ac69e7470 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:15:58.642849 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7980663-4234-4859-840c-1678d60dd8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:15:58.643635 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7980663-4234-4859-840c-1678d60dd8f1 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:58.644327 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7980663-4234-4859-840c-1678d60dd8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:58.644611 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7980663-4234-4859-840c-1678d60dd8f1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:58.649684 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:15:58.656223 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7980663-4234-4859-840c-1678d60dd8f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:15:58.658960 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5927b7-3585-4630-b12c-9636f120f37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:15:58.659665 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5927b7-3585-4630-b12c-9636f120f37d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:58.659959 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5927b7-3585-4630-b12c-9636f120f37d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:58.660237 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5927b7-3585-4630-b12c-9636f120f37d None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:58.661003 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5927b7-3585-4630-b12c-9636f120f37d None admin] RBAC: Adding query filter params (name=member) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:15:58.661343 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5927b7-3585-4630-b12c-9636f120f37d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:15:58.662750 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5927b7-3585-4630-b12c-9636f120f37d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:15:58.665004 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-d7980663-4234-4859-840c-1678d60dd8f1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 03:15:58.665004 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:15:58.665004 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:15:58.665004 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:15:58.665004 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:15:58.665004 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:15:58.665004 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:15:58.665004 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:15:58.665004 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:15:58.665004 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:15:58.665004 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:15:58.665004 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:15:58.665004 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:15:58.665004 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:15:58.665004 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:15:58.665004 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:15:58.665865 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:15:58.665865 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:15:58.665865 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:15:58.665865 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:15:58.665865 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:15:58.665865 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:15:58.665865 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:15:58.665865 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:15:58.665865 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:15:58.665865 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:15:58.665865 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:15:58.665865 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:15:58.665865 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:15:58.665865 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:15:58.665865 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:15:58.665865 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:15:58.666613 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:15:58.666613 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:15:58.666613 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:15:58.666613 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:15:58.666613 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:15:58.666613 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:15:58.666613 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:15:58.666613 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:15:58.666613 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:15:58.666613 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:15:58.666613 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 03:15:58.666613 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:15:58.666613 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 35/69] 10.222.0.60 () {56 vars in 1096 bytes} [Sat Jul 2 03:15:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:15:58.667878 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb8e01-0bcf-410b-8b7d-d7deec9991fa None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:58.668117 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb8e01-0bcf-410b-8b7d-d7deec9991fa None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:58.668398 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb8e01-0bcf-410b-8b7d-d7deec9991fa None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:58.669660 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 36/70] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:15:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:15:58.670483 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb8e01-0bcf-410b-8b7d-d7deec9991fa None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:15:58.681408 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 35/71] 10.222.0.60 () {56 vars in 1101 bytes} [Sat Jul 2 03:15:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:15:58.681408 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa9d0b4-4a70-4840-863c-6fd25876774a None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:58.681408 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa9d0b4-4a70-4840-863c-6fd25876774a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:58.681408 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa9d0b4-4a70-4840-863c-6fd25876774a None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:58.681408 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 36/72] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:15:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:15:58.681408 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa9d0b4-4a70-4840-863c-6fd25876774a None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:15:58.776469 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb8e01-0bcf-410b-8b7d-d7deec9991fa None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:15:58.779929 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa9d0b4-4a70-4840-863c-6fd25876774a None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:15:58.809476 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec577d-103f-4478-b431-900cdce4d3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:15:58.810276 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec577d-103f-4478-b431-900cdce4d3ab None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:58.810553 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec577d-103f-4478-b431-900cdce4d3ab None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:58.810820 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec577d-103f-4478-b431-900cdce4d3ab None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:58.813414 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaa8f37-1050-4026-9db8-9434c433d4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:15:58.814075 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa8f37-1050-4026-9db8-9434c433d4eb None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:58.814362 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa8f37-1050-4026-9db8-9434c433d4eb None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:58.814643 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa8f37-1050-4026-9db8-9434c433d4eb None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:58.815430 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaa8f37-1050-4026-9db8-9434c433d4eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:15:58.815742 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaa8f37-1050-4026-9db8-9434c433d4eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:15:58.817138 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaa8f37-1050-4026-9db8-9434c433d4eb None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:15:58.820746 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ec577d-103f-4478-b431-900cdce4d3ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:15:58.825085 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 37/73] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Jul 2 03:15:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:15:58.826245 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d89925-80f3-46c8-8314-951be7cd5779 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:58.826537 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d89925-80f3-46c8-8314-951be7cd5779 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:58.826815 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d89925-80f3-46c8-8314-951be7cd5779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:58.828935 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-a1ec577d-103f-4478-b431-900cdce4d3ab None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 02 03:15:58.828935 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:15:58.828935 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:15:58.828935 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:15:58.828935 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:15:58.828935 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:15:58.828935 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:15:58.828935 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:15:58.828935 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:15:58.828935 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:15:58.828935 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:15:58.828935 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:15:58.828935 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:15:58.828935 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:15:58.828935 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:15:58.828935 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:15:58.829727 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:15:58.829727 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:15:58.829727 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:15:58.829727 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:15:58.829727 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:15:58.829727 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:15:58.829727 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:15:58.829727 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:15:58.829727 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:15:58.829727 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:15:58.829727 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:15:58.829727 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:15:58.829727 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:15:58.829727 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:15:58.829727 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:15:58.829727 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:15:58.830473 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:15:58.830473 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:15:58.830473 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:15:58.830473 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:15:58.830473 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:15:58.830473 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:15:58.830473 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:15:58.830473 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:15:58.830473 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:15:58.830473 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:15:58.830473 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 02 03:15:58.830473 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:15:58.831065 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 37/74] 10.222.0.60 () {56 vars in 1114 bytes} [Sat Jul 2 03:15:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:15:58.831392 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec577d-103f-4478-b431-900cdce4d3ab None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:15:58.847585 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-b3d89925-80f3-46c8-8314-951be7cd5779 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:15:58.848794 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b3d89925-80f3-46c8-8314-951be7cd5779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:15:58.856762 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:15:58.894238 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:15:58.914329 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 38/75] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:15:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 03:15:58.927277 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e5a32-faeb-4757-bb51-1a948f8f3ff2 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:58.927277 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e5a32-faeb-4757-bb51-1a948f8f3ff2 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:58.927277 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e5a32-faeb-4757-bb51-1a948f8f3ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:58.931892 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec577d-103f-4478-b431-900cdce4d3ab None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:15:58.944946 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-b65e5a32-faeb-4757-bb51-1a948f8f3ff2 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:15:58.946112 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b65e5a32-faeb-4757-bb51-1a948f8f3ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:15:58.966746 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfab73dd-bbbe-403e-b854-3f831d9311b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:15:58.967693 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab73dd-bbbe-403e-b854-3f831d9311b7 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:58.968283 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab73dd-bbbe-403e-b854-3f831d9311b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:58.968572 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab73dd-bbbe-403e-b854-3f831d9311b7 None admin] PATH_INFO: `/v3/users/f1c7660050c245549b3aa8237868945a` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:58.984164 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfab73dd-bbbe-403e-b854-3f831d9311b7 None admin] RBAC: Authorizing `identity:get_user(user_id=f1c7660050c245549b3aa8237868945a)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:15:58.985631 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfab73dd-bbbe-403e-b854-3f831d9311b7 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:15:58.987347 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 38/76] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Jul 2 03:15:58 2022] GET /identity/v3/users/f1c7660050c245549b3aa8237868945a => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:15:58.988140 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfab73dd-bbbe-403e-b854-3f831d9311b7 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:15:59.011835 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 39/77] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:15:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 03:15:59.012667 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e5a32-faeb-4757-bb51-1a948f8f3ff2 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:15:59.073974 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:15:59.093324 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfab73dd-bbbe-403e-b854-3f831d9311b7 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:15:59.113689 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e5a32-faeb-4757-bb51-1a948f8f3ff2 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:15:59.123997 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:15:59.126816 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6556dc04-90e3-473e-bce2-10d2df323a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:15:59.127736 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6556dc04-90e3-473e-bce2-10d2df323a31 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:59.128039 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6556dc04-90e3-473e-bce2-10d2df323a31 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:59.128315 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6556dc04-90e3-473e-bce2-10d2df323a31 None admin] PATH_INFO: `/v3/users/6fcf66469a4a46abb312bd46ef8e4455` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:59.129530 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6556dc04-90e3-473e-bce2-10d2df323a31 None admin] RBAC: Authorizing `identity:get_user(user_id=6fcf66469a4a46abb312bd46ef8e4455)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:15:59.130984 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6556dc04-90e3-473e-bce2-10d2df323a31 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:15:59.132654 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 39/78] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Jul 2 03:15:58 2022] GET /identity/v3/users/6fcf66469a4a46abb312bd46ef8e4455 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:15:59.133422 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6556dc04-90e3-473e-bce2-10d2df323a31 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:15:59.153282 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58af0376-c9c4-4526-bddc-0d482a69998e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:15:59.153888 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af0376-c9c4-4526-bddc-0d482a69998e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:59.154167 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af0376-c9c4-4526-bddc-0d482a69998e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:59.154436 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af0376-c9c4-4526-bddc-0d482a69998e None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:59.155302 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58af0376-c9c4-4526-bddc-0d482a69998e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:15:59.155609 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58af0376-c9c4-4526-bddc-0d482a69998e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:15:59.156984 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58af0376-c9c4-4526-bddc-0d482a69998e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:15:59.164860 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 40/79] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Jul 2 03:15:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:15:59.165693 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58af0376-c9c4-4526-bddc-0d482a69998e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:15:59.236189 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6556dc04-90e3-473e-bce2-10d2df323a31 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:15:59.264222 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58af0376-c9c4-4526-bddc-0d482a69998e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:15:59.271702 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29171df2-ee32-400e-a450-054dcd2c148b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:15:59.272507 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29171df2-ee32-400e-a450-054dcd2c148b None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:59.272792 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29171df2-ee32-400e-a450-054dcd2c148b None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:59.273092 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29171df2-ee32-400e-a450-054dcd2c148b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:59.274300 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29171df2-ee32-400e-a450-054dcd2c148b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:15:59.275810 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29171df2-ee32-400e-a450-054dcd2c148b None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:15:59.277431 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 40/80] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:15:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:15:59.278193 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29171df2-ee32-400e-a450-054dcd2c148b None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:15:59.296332 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:15:59.303233 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c56677-7b93-4134-b0e3-9f43f8da08f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:15:59.303892 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c56677-7b93-4134-b0e3-9f43f8da08f3 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:59.304170 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c56677-7b93-4134-b0e3-9f43f8da08f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:59.304434 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c56677-7b93-4134-b0e3-9f43f8da08f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:59.345215 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:15:59.372769 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c56677-7b93-4134-b0e3-9f43f8da08f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:15:59.374059 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c56677-7b93-4134-b0e3-9f43f8da08f3 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:15:59.380369 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29171df2-ee32-400e-a450-054dcd2c148b None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:15:59.415040 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b48c0a8-8347-4514-bdda-e920346ada75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:15:59.415787 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48c0a8-8347-4514-bdda-e920346ada75 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:59.416066 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48c0a8-8347-4514-bdda-e920346ada75 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:59.416338 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48c0a8-8347-4514-bdda-e920346ada75 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:59.426690 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b48c0a8-8347-4514-bdda-e920346ada75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:15:59.434347 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-4b48c0a8-8347-4514-bdda-e920346ada75 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 02 03:15:59.434347 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:15:59.434347 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:15:59.434347 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:15:59.434347 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:15:59.434347 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:15:59.434347 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:15:59.434347 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:15:59.434347 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:15:59.434347 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:15:59.434347 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:15:59.434347 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:15:59.434347 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:15:59.434347 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:15:59.434347 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:15:59.434347 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:15:59.435355 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:15:59.435355 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:15:59.435355 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:15:59.435355 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:15:59.435355 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:15:59.435355 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:15:59.435355 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:15:59.435355 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:15:59.435355 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:15:59.435355 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:15:59.435355 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:15:59.435355 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:15:59.435355 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:15:59.435355 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:15:59.435355 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:15:59.435355 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:15:59.436115 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:15:59.436115 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:15:59.436115 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:15:59.436115 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:15:59.436115 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:15:59.436115 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:15:59.436115 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:15:59.436115 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:15:59.436115 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:15:59.436115 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:15:59.436115 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 02 03:15:59.436115 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:15:59.436115 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 41/81] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Jul 2 03:15:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:15:59.439409 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b48c0a8-8347-4514-bdda-e920346ada75 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:15:59.472503 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 41/82] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Jul 2 03:15:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 03:15:59.473344 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c56677-7b93-4134-b0e3-9f43f8da08f3 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:15:59.515250 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:15:59.539661 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b48c0a8-8347-4514-bdda-e920346ada75 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:15:59.541172 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:15:59.572207 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c56677-7b93-4134-b0e3-9f43f8da08f3 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:15:59.573115 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3317e5bf-f18b-49bd-96f3-c6347b177ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:15:59.573768 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3317e5bf-f18b-49bd-96f3-c6347b177ca4 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:59.574345 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3317e5bf-f18b-49bd-96f3-c6347b177ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:59.574627 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3317e5bf-f18b-49bd-96f3-c6347b177ca4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:59.607328 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2251fb2-ab1e-4a77-975a-fd564fb2673c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:15:59.608228 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2251fb2-ab1e-4a77-975a-fd564fb2673c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:59.608580 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2251fb2-ab1e-4a77-975a-fd564fb2673c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:59.608855 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2251fb2-ab1e-4a77-975a-fd564fb2673c None admin] PATH_INFO: `/v3/users/f1c7660050c245549b3aa8237868945a` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:59.610198 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2251fb2-ab1e-4a77-975a-fd564fb2673c None admin] RBAC: Authorizing `identity:get_user(user_id=f1c7660050c245549b3aa8237868945a)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:15:59.611733 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2251fb2-ab1e-4a77-975a-fd564fb2673c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:15:59.613394 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 42/83] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Jul 2 03:15:59 2022] GET /identity/v3/users/f1c7660050c245549b3aa8237868945a => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:15:59.614142 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2251fb2-ab1e-4a77-975a-fd564fb2673c None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:15:59.639469 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3317e5bf-f18b-49bd-96f3-c6347b177ca4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:15:59.641015 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3317e5bf-f18b-49bd-96f3-c6347b177ca4 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:15:59.709508 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2251fb2-ab1e-4a77-975a-fd564fb2673c None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:15:59.716098 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:15:59.739005 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 42/84] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Jul 2 03:15:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 03:15:59.744130 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3317e5bf-f18b-49bd-96f3-c6347b177ca4 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:15:59.746089 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2da0552-8fac-423b-a36f-6dba8ed30055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:15:59.746766 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da0552-8fac-423b-a36f-6dba8ed30055 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:59.747054 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da0552-8fac-423b-a36f-6dba8ed30055 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:59.747363 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da0552-8fac-423b-a36f-6dba8ed30055 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:59.748086 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2da0552-8fac-423b-a36f-6dba8ed30055 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:15:59.749573 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2da0552-8fac-423b-a36f-6dba8ed30055 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:15:59.758979 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:15:59.772253 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 43/85] 10.222.0.60 () {60 vars in 1132 bytes} [Sat Jul 2 03:15:59 2022] POST /identity/v3/users => generated 289 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:15:59.773045 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2da0552-8fac-423b-a36f-6dba8ed30055 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:15:59.862357 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3317e5bf-f18b-49bd-96f3-c6347b177ca4 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:15:59.889388 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2da0552-8fac-423b-a36f-6dba8ed30055 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:15:59.897740 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a79160-5175-444f-b39b-118846688b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:15:59.898413 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a79160-5175-444f-b39b-118846688b7a None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:59.898703 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a79160-5175-444f-b39b-118846688b7a None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:59.898967 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a79160-5175-444f-b39b-118846688b7a None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:59.899759 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a79160-5175-444f-b39b-118846688b7a None admin] RBAC: Adding query filter params (name=member) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:15:59.900064 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a79160-5175-444f-b39b-118846688b7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:15:59.901489 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a79160-5175-444f-b39b-118846688b7a None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:15:59.911157 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 43/86] 10.222.0.60 () {56 vars in 1101 bytes} [Sat Jul 2 03:15:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:15:59.916803 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a79160-5175-444f-b39b-118846688b7a None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:15:59.932210 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b45b9b-8759-4d00-9855-4315fea3c5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:15:59.933514 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b45b9b-8759-4d00-9855-4315fea3c5f0 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:15:59.933870 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b45b9b-8759-4d00-9855-4315fea3c5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:15:59.934147 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b45b9b-8759-4d00-9855-4315fea3c5f0 None admin] PATH_INFO: `/v3/projects/73025fb6edfa43b88c0c690d55906c19` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:15:59.935470 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b45b9b-8759-4d00-9855-4315fea3c5f0 None admin] RBAC: Authorizing `identity:get_project(project_id=73025fb6edfa43b88c0c690d55906c19)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:15:59.937717 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b45b9b-8759-4d00-9855-4315fea3c5f0 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:15:59.942464 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 44/87] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Jul 2 03:15:59 2022] GET /identity/v3/projects/73025fb6edfa43b88c0c690d55906c19 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:15:59.942464 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b45b9b-8759-4d00-9855-4315fea3c5f0 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:15:59.964368 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:00.019471 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:00.040890 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a79160-5175-444f-b39b-118846688b7a None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:00.066216 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b45b9b-8759-4d00-9855-4315fea3c5f0 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:00.079187 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e281e-e895-44a0-89ca-24e2a8f73dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:00.079847 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e281e-e895-44a0-89ca-24e2a8f73dd4 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:00.080128 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e281e-e895-44a0-89ca-24e2a8f73dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:00.080402 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e281e-e895-44a0-89ca-24e2a8f73dd4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:00.109899 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175943aa-1c7f-48de-862d-3100a7478fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:00.111044 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175943aa-1c7f-48de-862d-3100a7478fc9 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:00.111375 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175943aa-1c7f-48de-862d-3100a7478fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:00.111655 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175943aa-1c7f-48de-862d-3100a7478fc9 None admin] PATH_INFO: `/v3/projects/73025fb6edfa43b88c0c690d55906c19` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:00.113459 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175943aa-1c7f-48de-862d-3100a7478fc9 None admin] RBAC: Authorizing `identity:get_project(project_id=73025fb6edfa43b88c0c690d55906c19)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:00.115235 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175943aa-1c7f-48de-862d-3100a7478fc9 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:00.119231 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 45/88] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Jul 2 03:15:59 2022] GET /identity/v3/projects/73025fb6edfa43b88c0c690d55906c19 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:00.120151 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175943aa-1c7f-48de-862d-3100a7478fc9 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:00.161539 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235e281e-e895-44a0-89ca-24e2a8f73dd4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:00.163063 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235e281e-e895-44a0-89ca-24e2a8f73dd4 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:00.251978 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175943aa-1c7f-48de-862d-3100a7478fc9 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:00.259501 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:00.273702 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 44/89] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Jul 2 03:15:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 03:16:00.273702 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e281e-e895-44a0-89ca-24e2a8f73dd4 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:00.297115 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:00.305641 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1d6ed3-18f5-4e0e-9803-baea5afe262e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:00.306999 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d6ed3-18f5-4e0e-9803-baea5afe262e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:00.307449 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d6ed3-18f5-4e0e-9803-baea5afe262e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:00.307867 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d6ed3-18f5-4e0e-9803-baea5afe262e None admin] PATH_INFO: `/v3/users/f1c7660050c245549b3aa8237868945a` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:00.310341 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1d6ed3-18f5-4e0e-9803-baea5afe262e None admin] RBAC: Authorizing `identity:get_user(user_id=f1c7660050c245549b3aa8237868945a)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:00.312022 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1d6ed3-18f5-4e0e-9803-baea5afe262e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:00.318983 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 46/90] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Jul 2 03:16:00 2022] GET /identity/v3/users/f1c7660050c245549b3aa8237868945a => generated 275 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:00.318983 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1d6ed3-18f5-4e0e-9803-baea5afe262e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:00.404571 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e281e-e895-44a0-89ca-24e2a8f73dd4 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:00.440930 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e8547a-b512-4d5a-8dc7-c6a4c47c3e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:00.441618 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8547a-b512-4d5a-8dc7-c6a4c47c3e45 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:00.441903 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8547a-b512-4d5a-8dc7-c6a4c47c3e45 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:00.442184 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8547a-b512-4d5a-8dc7-c6a4c47c3e45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:00.442660 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1d6ed3-18f5-4e0e-9803-baea5afe262e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:00.443030 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e8547a-b512-4d5a-8dc7-c6a4c47c3e45 None admin] RBAC: Adding query filter params (role.id=c43aada0326446c4ade0ab1262918fa4, scope.project.id=73025fb6edfa43b88c0c690d55906c19, user.id=f1c7660050c245549b3aa8237868945a) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:00.443375 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e8547a-b512-4d5a-8dc7-c6a4c47c3e45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:00.445074 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e8547a-b512-4d5a-8dc7-c6a4c47c3e45 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:00.452516 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 45/91] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Jul 2 03:16:00 2022] GET /identity/v3/role_assignments?user.id=f1c7660050c245549b3aa8237868945a&scope.project.id=73025fb6edfa43b88c0c690d55906c19&role.id=c43aada0326446c4ade0ab1262918fa4 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:00.453335 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e8547a-b512-4d5a-8dc7-c6a4c47c3e45 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:00.457357 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:00.492913 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012edd0a-a03d-41e2-b8f4-31f2dac53706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:00.494172 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012edd0a-a03d-41e2-b8f4-31f2dac53706 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:00.494886 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012edd0a-a03d-41e2-b8f4-31f2dac53706 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:00.495794 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012edd0a-a03d-41e2-b8f4-31f2dac53706 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:00.497139 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012edd0a-a03d-41e2-b8f4-31f2dac53706 None admin] RBAC: Adding query filter params (role.id=5dcd130cda6c490595e862dc2348e83d, scope.project.id=73025fb6edfa43b88c0c690d55906c19, user.id=6fcf66469a4a46abb312bd46ef8e4455) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:00.497653 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012edd0a-a03d-41e2-b8f4-31f2dac53706 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:00.500601 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012edd0a-a03d-41e2-b8f4-31f2dac53706 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:00.515160 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 47/92] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Jul 2 03:16:00 2022] GET /identity/v3/role_assignments?user.id=6fcf66469a4a46abb312bd46ef8e4455&scope.project.id=73025fb6edfa43b88c0c690d55906c19&role.id=5dcd130cda6c490595e862dc2348e83d => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:00.515160 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012edd0a-a03d-41e2-b8f4-31f2dac53706 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:00.628917 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e8547a-b512-4d5a-8dc7-c6a4c47c3e45 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:00.633235 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:00.681738 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5648f1a7-eef6-469c-b380-4504e4c1c61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:00.683236 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5648f1a7-eef6-469c-b380-4504e4c1c61b None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:00.683559 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5648f1a7-eef6-469c-b380-4504e4c1c61b None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:00.683847 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5648f1a7-eef6-469c-b380-4504e4c1c61b None admin] PATH_INFO: `/v3/projects/73025fb6edfa43b88c0c690d55906c19` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:00.685274 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5648f1a7-eef6-469c-b380-4504e4c1c61b None admin] RBAC: Authorizing `identity:get_project(project_id=73025fb6edfa43b88c0c690d55906c19)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:00.687277 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5648f1a7-eef6-469c-b380-4504e4c1c61b None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:00.689692 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 46/93] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Jul 2 03:16:00 2022] GET /identity/v3/projects/73025fb6edfa43b88c0c690d55906c19 => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:00.696888 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5648f1a7-eef6-469c-b380-4504e4c1c61b None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:00.725645 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012edd0a-a03d-41e2-b8f4-31f2dac53706 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:00.783850 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:00.790361 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5327ca32-6793-41bc-a4c7-23c6240bd4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:00.791432 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5327ca32-6793-41bc-a4c7-23c6240bd4ea None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:00.791845 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5327ca32-6793-41bc-a4c7-23c6240bd4ea None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:00.792688 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5327ca32-6793-41bc-a4c7-23c6240bd4ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:00.818768 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5648f1a7-eef6-469c-b380-4504e4c1c61b None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:00.859340 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ba3759-b29f-44a9-84fa-673e5c88dc89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:00.860018 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba3759-b29f-44a9-84fa-673e5c88dc89 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:00.860308 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba3759-b29f-44a9-84fa-673e5c88dc89 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:00.860593 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba3759-b29f-44a9-84fa-673e5c88dc89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:00.861442 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ba3759-b29f-44a9-84fa-673e5c88dc89 None admin] RBAC: Adding query filter params (role.id=a9792a930e0c4e139f287a712dfc7d4d, scope.project.id=73025fb6edfa43b88c0c690d55906c19, user.id=f1c7660050c245549b3aa8237868945a) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:00.861759 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ba3759-b29f-44a9-84fa-673e5c88dc89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:00.863232 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ba3759-b29f-44a9-84fa-673e5c88dc89 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:00.870101 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 47/94] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Jul 2 03:16:00 2022] GET /identity/v3/role_assignments?user.id=f1c7660050c245549b3aa8237868945a&scope.project.id=73025fb6edfa43b88c0c690d55906c19&role.id=a9792a930e0c4e139f287a712dfc7d4d => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:16:00.925597 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5327ca32-6793-41bc-a4c7-23c6240bd4ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:00.927559 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5327ca32-6793-41bc-a4c7-23c6240bd4ea None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:01.005595 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:01.056248 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 48/95] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Jul 2 03:16:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 03:16:01.062237 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ba3759-b29f-44a9-84fa-673e5c88dc89 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:01.219102 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ba3759-b29f-44a9-84fa-673e5c88dc89 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:01.281232 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0d30e4-bb82-4b8b-a3e0-f808042a492a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:01.282113 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d30e4-bb82-4b8b-a3e0-f808042a492a None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:01.282399 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d30e4-bb82-4b8b-a3e0-f808042a492a None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:01.282677 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d30e4-bb82-4b8b-a3e0-f808042a492a None admin] PATH_INFO: `/v3/projects/8c6c0204b3d747f7874d3177babba295` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:01.287841 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0d30e4-bb82-4b8b-a3e0-f808042a492a None admin] RBAC: Authorizing `identity:get_project(project_id=8c6c0204b3d747f7874d3177babba295)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:01.289322 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0d30e4-bb82-4b8b-a3e0-f808042a492a None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:01.291402 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 48/96] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Jul 2 03:16:01 2022] GET /identity/v3/projects/8c6c0204b3d747f7874d3177babba295 => generated 312 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:01.300228 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5327ca32-6793-41bc-a4c7-23c6240bd4ea None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:01.459013 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5327ca32-6793-41bc-a4c7-23c6240bd4ea None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:01.506736 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec884116-388c-48c3-ab53-49507b33b8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:01.507745 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec884116-388c-48c3-ab53-49507b33b8d7 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:01.508156 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec884116-388c-48c3-ab53-49507b33b8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:01.508645 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec884116-388c-48c3-ab53-49507b33b8d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:01.509559 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec884116-388c-48c3-ab53-49507b33b8d7 None admin] RBAC: Adding query filter params (role.id=c43aada0326446c4ade0ab1262918fa4, scope.project.id=8c6c0204b3d747f7874d3177babba295, user.id=f1c7660050c245549b3aa8237868945a) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:01.509876 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec884116-388c-48c3-ab53-49507b33b8d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:01.511381 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec884116-388c-48c3-ab53-49507b33b8d7 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:01.523425 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 49/97] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Jul 2 03:16:01 2022] GET /identity/v3/role_assignments?user.id=f1c7660050c245549b3aa8237868945a&scope.project.id=8c6c0204b3d747f7874d3177babba295&role.id=c43aada0326446c4ade0ab1262918fa4 => generated 259 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:02.193581 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2398dd8-c7ec-4837-a1a6-761f4984518c None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:02.193950 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2398dd8-c7ec-4837-a1a6-761f4984518c None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:02.194261 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2398dd8-c7ec-4837-a1a6-761f4984518c None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:02.195694 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 49/98] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:16:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:16:02.201424 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd00e51-3bfc-4f40-bfa6-8b9d45897e95 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:02.201712 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd00e51-3bfc-4f40-bfa6-8b9d45897e95 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:02.202017 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd00e51-3bfc-4f40-bfa6-8b9d45897e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:02.218816 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-7fd00e51-3bfc-4f40-bfa6-8b9d45897e95 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:16:02.220016 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7fd00e51-3bfc-4f40-bfa6-8b9d45897e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:16:02.258131 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:02.315499 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 50/99] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:16:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 03:16:02.337973 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2398dd8-c7ec-4837-a1a6-761f4984518c None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:02.340966 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:02.475939 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2398dd8-c7ec-4837-a1a6-761f4984518c None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:02.518165 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea5b6c9-c486-405e-aa17-ce7c14743282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:02.518969 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea5b6c9-c486-405e-aa17-ce7c14743282 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:02.519285 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea5b6c9-c486-405e-aa17-ce7c14743282 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:02.519563 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea5b6c9-c486-405e-aa17-ce7c14743282 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:02.532872 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea5b6c9-c486-405e-aa17-ce7c14743282 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:16:02.540579 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-3ea5b6c9-c486-405e-aa17-ce7c14743282 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 02 03:16:02.540579 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:02.540579 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:02.540579 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:02.540579 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:02.540579 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:02.540579 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:02.540579 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:02.540579 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:02.540579 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:02.540579 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:02.540579 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:02.540579 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:16:02.540579 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:16:02.540579 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:16:02.540579 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:16:02.541413 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:16:02.541413 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:16:02.541413 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:16:02.541413 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:16:02.541413 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:02.541413 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:02.541413 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:02.541413 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:02.541413 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:02.541413 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:02.541413 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:02.541413 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:02.541413 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:02.541413 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:02.541413 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:02.541413 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:02.542871 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:02.542871 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:02.542871 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:02.542871 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:02.542871 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:16:02.542871 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:16:02.542871 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:16:02.542871 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:16:02.542871 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:16:02.542871 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:16:02.542871 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 02 03:16:02.542871 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:16:02.542871 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 50/100] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Jul 2 03:16:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:16:02.547937 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd00e51-3bfc-4f40-bfa6-8b9d45897e95 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:02.712293 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd00e51-3bfc-4f40-bfa6-8b9d45897e95 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:02.747262 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b513a929-b05b-48c6-b7af-7f3806d3f1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:02.747942 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513a929-b05b-48c6-b7af-7f3806d3f1c1 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:02.748230 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513a929-b05b-48c6-b7af-7f3806d3f1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:02.748511 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513a929-b05b-48c6-b7af-7f3806d3f1c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:02.749305 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b513a929-b05b-48c6-b7af-7f3806d3f1c1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:02.749616 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b513a929-b05b-48c6-b7af-7f3806d3f1c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:02.751012 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b513a929-b05b-48c6-b7af-7f3806d3f1c1 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:02.759576 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 51/101] 10.222.0.60 () {56 vars in 1101 bytes} [Sat Jul 2 03:16:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:02.765144 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea5b6c9-c486-405e-aa17-ce7c14743282 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:02.833641 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:02.868919 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea5b6c9-c486-405e-aa17-ce7c14743282 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:02.903561 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff995c7a-834d-47e2-9de5-a0833313b4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:02.904454 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff995c7a-834d-47e2-9de5-a0833313b4f6 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:02.904743 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff995c7a-834d-47e2-9de5-a0833313b4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:02.905086 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff995c7a-834d-47e2-9de5-a0833313b4f6 None admin] PATH_INFO: `/v3/users/750caf97b9a44ca782e182ac8b7d3fce` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:02.919400 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff995c7a-834d-47e2-9de5-a0833313b4f6 None admin] RBAC: Authorizing `identity:get_user(user_id=750caf97b9a44ca782e182ac8b7d3fce)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:02.920924 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff995c7a-834d-47e2-9de5-a0833313b4f6 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:02.922643 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 51/102] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Jul 2 03:16:02 2022] GET /identity/v3/users/750caf97b9a44ca782e182ac8b7d3fce => generated 289 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:02.928183 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b513a929-b05b-48c6-b7af-7f3806d3f1c1 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:02.936572 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e48b56-db31-407f-a0e1-a37e64d36885 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:02.936872 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e48b56-db31-407f-a0e1-a37e64d36885 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:02.937153 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e48b56-db31-407f-a0e1-a37e64d36885 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:02.939061 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 52/103] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:16:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:16:02.945284 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946bebfb-a12e-4dd3-9020-d9c329d29ff1 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:02.945581 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946bebfb-a12e-4dd3-9020-d9c329d29ff1 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:02.946159 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946bebfb-a12e-4dd3-9020-d9c329d29ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:02.971942 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:02.973622 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-946bebfb-a12e-4dd3-9020-d9c329d29ff1 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:16:02.974906 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-946bebfb-a12e-4dd3-9020-d9c329d29ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:16:03.086751 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 53/104] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:16:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 02 03:16:03.130824 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946bebfb-a12e-4dd3-9020-d9c329d29ff1 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:03.152042 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b513a929-b05b-48c6-b7af-7f3806d3f1c1 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:03.229398 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:03.251863 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a155f-8edf-4940-aa26-421609b56ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:03.252539 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a155f-8edf-4940-aa26-421609b56ad3 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:03.252826 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a155f-8edf-4940-aa26-421609b56ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:03.253107 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a155f-8edf-4940-aa26-421609b56ad3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:03.304110 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946bebfb-a12e-4dd3-9020-d9c329d29ff1 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:03.364529 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94a155f-8edf-4940-aa26-421609b56ad3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:03.365952 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94a155f-8edf-4940-aa26-421609b56ad3 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:03.377290 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f9864-2801-4c4a-a182-e9f76be1e825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:03.378109 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f9864-2801-4c4a-a182-e9f76be1e825 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:03.378395 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f9864-2801-4c4a-a182-e9f76be1e825 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:03.378673 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f9864-2801-4c4a-a182-e9f76be1e825 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:03.383884 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1f9864-2801-4c4a-a182-e9f76be1e825 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:03.385372 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1f9864-2801-4c4a-a182-e9f76be1e825 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:03.387099 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 54/105] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:16:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:16:03.392899 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f9864-2801-4c4a-a182-e9f76be1e825 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:03.402470 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:03.483138 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 52/106] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Jul 2 03:16:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 03:16:03.489612 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a155f-8edf-4940-aa26-421609b56ad3 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:03.600015 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a155f-8edf-4940-aa26-421609b56ad3 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:03.629568 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f9864-2801-4c4a-a182-e9f76be1e825 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:03.632085 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:03.641328 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b139f59-d8c9-449f-ba88-79796a26027b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:03.642202 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b139f59-d8c9-449f-ba88-79796a26027b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:03.642482 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b139f59-d8c9-449f-ba88-79796a26027b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:03.642756 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b139f59-d8c9-449f-ba88-79796a26027b None admin] PATH_INFO: `/v3/projects/73025fb6edfa43b88c0c690d55906c19` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:03.644088 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b139f59-d8c9-449f-ba88-79796a26027b None admin] RBAC: Authorizing `identity:get_project(project_id=73025fb6edfa43b88c0c690d55906c19)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:03.645646 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b139f59-d8c9-449f-ba88-79796a26027b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:03.647709 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 53/107] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Jul 2 03:16:03 2022] GET /identity/v3/projects/73025fb6edfa43b88c0c690d55906c19 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:16:03.657646 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b139f59-d8c9-449f-ba88-79796a26027b None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:03.670742 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:03.702468 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0359b556-fe7b-4cd5-b044-88309987440c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:03.703162 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359b556-fe7b-4cd5-b044-88309987440c None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:03.703452 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359b556-fe7b-4cd5-b044-88309987440c None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:03.703731 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359b556-fe7b-4cd5-b044-88309987440c None admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:03.704452 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0359b556-fe7b-4cd5-b044-88309987440c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:03.705911 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0359b556-fe7b-4cd5-b044-88309987440c None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:03.749081 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 55/108] 10.222.0.60 () {60 vars in 1141 bytes} [Sat Jul 2 03:16:03 2022] POST /identity/v3/projects => generated 302 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:16:03.773241 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f34a40-b293-4acf-a8f3-41710689182e None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:03.773592 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f34a40-b293-4acf-a8f3-41710689182e None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:03.773801 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f34a40-b293-4acf-a8f3-41710689182e None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:03.775349 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 56/109] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:16:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:16:03.781098 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6b612-f3d3-4807-8b4f-5fe67d4965ff None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:03.781756 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6b612-f3d3-4807-8b4f-5fe67d4965ff None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:03.782282 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6b612-f3d3-4807-8b4f-5fe67d4965ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:03.802001 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-85f6b612-f3d3-4807-8b4f-5fe67d4965ff None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:16:03.803796 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-85f6b612-f3d3-4807-8b4f-5fe67d4965ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:16:03.817020 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b139f59-d8c9-449f-ba88-79796a26027b None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:03.861425 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173c97a6-01cd-49c4-83e2-a4b35a51764b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:03.862113 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c97a6-01cd-49c4-83e2-a4b35a51764b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:03.862400 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c97a6-01cd-49c4-83e2-a4b35a51764b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:03.862676 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c97a6-01cd-49c4-83e2-a4b35a51764b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:03.863571 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173c97a6-01cd-49c4-83e2-a4b35a51764b None admin] RBAC: Adding query filter params (role.id=e7cdb23960ca4be7a9cd4c7685029db0, scope.project.id=73025fb6edfa43b88c0c690d55906c19, user.id=750caf97b9a44ca782e182ac8b7d3fce) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:03.863881 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173c97a6-01cd-49c4-83e2-a4b35a51764b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:03.865383 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173c97a6-01cd-49c4-83e2-a4b35a51764b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:03.879946 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 54/110] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Jul 2 03:16:03 2022] GET /identity/v3/role_assignments?user.id=750caf97b9a44ca782e182ac8b7d3fce&scope.project.id=73025fb6edfa43b88c0c690d55906c19&role.id=e7cdb23960ca4be7a9cd4c7685029db0 => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:03.881401 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ada7a7-c218-401e-9d82-d26a705d63f1 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:03.881693 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ada7a7-c218-401e-9d82-d26a705d63f1 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:03.881971 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ada7a7-c218-401e-9d82-d26a705d63f1 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:03.883641 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 55/111] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:16:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:16:03.889195 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a0ad5-d5d1-47f7-aaa8-ee6e2c4c872f None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:03.889537 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a0ad5-d5d1-47f7-aaa8-ee6e2c4c872f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:03.889797 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a0ad5-d5d1-47f7-aaa8-ee6e2c4c872f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:03.897983 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 57/112] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:16:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 02 03:16:03.922460 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6b612-f3d3-4807-8b4f-5fe67d4965ff None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:03.929338 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-0b4a0ad5-d5d1-47f7-aaa8-ee6e2c4c872f None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:16:03.929690 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0b4a0ad5-d5d1-47f7-aaa8-ee6e2c4c872f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:16:03.993167 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:04.017154 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 56/113] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:16:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 03:16:04.058917 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4a0ad5-d5d1-47f7-aaa8-ee6e2c4c872f None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:04.096187 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6b612-f3d3-4807-8b4f-5fe67d4965ff None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:04.097946 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:04.159017 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d31bc3-8513-4e2e-aa39-c902767f027b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:04.159781 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d31bc3-8513-4e2e-aa39-c902767f027b None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:04.160063 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d31bc3-8513-4e2e-aa39-c902767f027b None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:04.160339 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d31bc3-8513-4e2e-aa39-c902767f027b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:04.181808 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d31bc3-8513-4e2e-aa39-c902767f027b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:16:04.190195 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-43d31bc3-8513-4e2e-aa39-c902767f027b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 02 03:16:04.190195 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:04.190195 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:04.190195 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:04.190195 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:04.190195 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:04.190195 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:04.190195 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:04.190195 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:04.190195 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:04.190195 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:04.190195 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:04.190195 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:16:04.190195 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:16:04.190195 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:16:04.190195 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:16:04.191040 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:16:04.191040 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:16:04.191040 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:16:04.191040 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:16:04.191040 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:04.191040 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:04.191040 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:04.191040 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:04.191040 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:04.191040 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:04.191040 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:04.191040 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:04.191040 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:04.191040 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:04.191040 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:04.191040 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:04.191798 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:04.191798 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:04.191798 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:04.191798 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:04.191798 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:16:04.191798 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:16:04.191798 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:16:04.191798 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:16:04.191798 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:16:04.191798 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:16:04.191798 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 02 03:16:04.191798 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:16:04.191798 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 58/114] 10.222.0.60 () {56 vars in 1114 bytes} [Sat Jul 2 03:16:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:16:04.193127 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aef12d-9f2f-4ce5-8902-0df303f5d512 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:04.193127 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aef12d-9f2f-4ce5-8902-0df303f5d512 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:04.193286 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aef12d-9f2f-4ce5-8902-0df303f5d512 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:04.194535 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 59/115] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:16:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:16:04.201357 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f8ed4-3e4e-475a-8033-ecdc13d6a1ce None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:04.201654 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f8ed4-3e4e-475a-8033-ecdc13d6a1ce None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:04.202004 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f8ed4-3e4e-475a-8033-ecdc13d6a1ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:04.215068 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4a0ad5-d5d1-47f7-aaa8-ee6e2c4c872f None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:04.238395 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-733f8ed4-3e4e-475a-8033-ecdc13d6a1ce None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:16:04.241419 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-733f8ed4-3e4e-475a-8033-ecdc13d6a1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:16:04.275506 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a372123d-9811-458b-9a03-b08bd353b404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:04.276654 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372123d-9811-458b-9a03-b08bd353b404 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:04.277143 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372123d-9811-458b-9a03-b08bd353b404 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:04.277599 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372123d-9811-458b-9a03-b08bd353b404 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:04.306574 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a372123d-9811-458b-9a03-b08bd353b404 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:16:04.320849 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-a372123d-9811-458b-9a03-b08bd353b404 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 02 03:16:04.320849 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:04.320849 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:04.320849 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:04.320849 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:04.320849 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:04.320849 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:04.320849 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:04.320849 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:04.320849 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:04.320849 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:04.320849 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:04.320849 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:16:04.320849 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:16:04.320849 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:16:04.320849 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:16:04.321705 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:16:04.321705 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:16:04.321705 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:16:04.321705 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:16:04.321705 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:04.321705 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:04.321705 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:04.321705 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:04.321705 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:04.321705 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:04.321705 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:04.321705 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:04.321705 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:04.321705 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:04.321705 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:04.321705 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:04.322437 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:04.322437 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:04.322437 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:04.322437 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:04.322437 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:16:04.322437 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:16:04.322437 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:16:04.322437 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:16:04.322437 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:16:04.322437 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:16:04.322437 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 02 03:16:04.322437 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:16:04.324659 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 57/116] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Jul 2 03:16:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:16:04.326413 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a372123d-9811-458b-9a03-b08bd353b404 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:04.342417 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 60/117] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:16:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 02 03:16:04.343212 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f8ed4-3e4e-475a-8033-ecdc13d6a1ce None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:04.416547 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:04.506111 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a372123d-9811-458b-9a03-b08bd353b404 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:04.507471 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:04.518770 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f8ed4-3e4e-475a-8033-ecdc13d6a1ce None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:04.572448 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed1ec8d-e770-4b01-8d3f-4c76ea8efbc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:04.573213 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed1ec8d-e770-4b01-8d3f-4c76ea8efbc0 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:04.573547 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed1ec8d-e770-4b01-8d3f-4c76ea8efbc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:04.573913 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed1ec8d-e770-4b01-8d3f-4c76ea8efbc0 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:04.579526 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed1ec8d-e770-4b01-8d3f-4c76ea8efbc0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:04.580026 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed1ec8d-e770-4b01-8d3f-4c76ea8efbc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:04.581596 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed1ec8d-e770-4b01-8d3f-4c76ea8efbc0 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:04.583878 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511185db-3dd8-4ba2-bdc3-4f82d4586a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:04.584749 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511185db-3dd8-4ba2-bdc3-4f82d4586a42 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:04.585227 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511185db-3dd8-4ba2-bdc3-4f82d4586a42 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:04.585670 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511185db-3dd8-4ba2-bdc3-4f82d4586a42 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:04.586602 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511185db-3dd8-4ba2-bdc3-4f82d4586a42 None admin] RBAC: Adding query filter params (name=member) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:04.587080 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511185db-3dd8-4ba2-bdc3-4f82d4586a42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:04.588635 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511185db-3dd8-4ba2-bdc3-4f82d4586a42 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:04.598460 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 58/118] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Jul 2 03:16:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:04.602771 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed1ec8d-e770-4b01-8d3f-4c76ea8efbc0 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:04.606450 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 61/119] 10.222.0.60 () {56 vars in 1101 bytes} [Sat Jul 2 03:16:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:04.609549 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511185db-3dd8-4ba2-bdc3-4f82d4586a42 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:04.792967 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed1ec8d-e770-4b01-8d3f-4c76ea8efbc0 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:04.803470 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:04.813299 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511185db-3dd8-4ba2-bdc3-4f82d4586a42 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:04.834789 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ebceef-922d-4853-b8c9-60fff054a979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:04.835618 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ebceef-922d-4853-b8c9-60fff054a979 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:04.835902 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ebceef-922d-4853-b8c9-60fff054a979 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:04.836177 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ebceef-922d-4853-b8c9-60fff054a979 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:04.846514 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ebceef-922d-4853-b8c9-60fff054a979 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:16:04.853197 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e5b15e-e957-4100-8650-a1f2cd4b7915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:04.854215 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-45ebceef-922d-4853-b8c9-60fff054a979 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 03:16:04.854215 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:04.854215 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:04.854215 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:04.854215 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:04.854215 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:04.854215 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:04.854215 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:04.854215 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:04.854215 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:04.854215 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:04.854215 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:04.854215 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:16:04.854215 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:16:04.854215 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:16:04.854215 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:16:04.855032 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:16:04.855032 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:16:04.855032 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:16:04.855032 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:16:04.855032 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:04.855032 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:04.855032 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:04.855032 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:04.855032 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:04.855032 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:04.855032 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:04.855032 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:04.855032 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:04.855032 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:04.855032 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:04.855032 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:04.855830 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:04.855830 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:04.855830 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:04.855830 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:04.855830 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:16:04.855830 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:16:04.855830 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:16:04.855830 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:16:04.855830 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:16:04.855830 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:16:04.855830 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 03:16:04.855830 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:16:04.855830 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 59/120] 10.222.0.60 () {56 vars in 1096 bytes} [Sat Jul 2 03:16:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:16:04.856461 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ebceef-922d-4853-b8c9-60fff054a979 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:04.857422 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5b15e-e957-4100-8650-a1f2cd4b7915 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:04.857947 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5b15e-e957-4100-8650-a1f2cd4b7915 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:04.858536 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5b15e-e957-4100-8650-a1f2cd4b7915 None admin] PATH_INFO: `/v3/users/f1c7660050c245549b3aa8237868945a` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:04.861230 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e5b15e-e957-4100-8650-a1f2cd4b7915 None admin] RBAC: Authorizing `identity:get_user(user_id=f1c7660050c245549b3aa8237868945a)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:04.863083 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e5b15e-e957-4100-8650-a1f2cd4b7915 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:04.865217 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 62/121] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Jul 2 03:16:04 2022] GET /identity/v3/users/f1c7660050c245549b3aa8237868945a => generated 275 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:04.867174 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc5a4dc-13a2-47d7-92f5-585396ec2ca2 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:04.868125 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc5a4dc-13a2-47d7-92f5-585396ec2ca2 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:04.868622 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc5a4dc-13a2-47d7-92f5-585396ec2ca2 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:04.870783 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 63/122] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:16:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:16:04.871714 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc5a4dc-13a2-47d7-92f5-585396ec2ca2 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:04.900803 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:04.966898 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ebceef-922d-4853-b8c9-60fff054a979 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:05.003059 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca7b0c1-30cd-495e-a5c8-fa9dbc4bb6b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:05.004065 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7b0c1-30cd-495e-a5c8-fa9dbc4bb6b9 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:05.004401 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7b0c1-30cd-495e-a5c8-fa9dbc4bb6b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:05.004761 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7b0c1-30cd-495e-a5c8-fa9dbc4bb6b9 None admin] PATH_INFO: `/v3/users/f1c7660050c245549b3aa8237868945a` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:05.006090 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca7b0c1-30cd-495e-a5c8-fa9dbc4bb6b9 None admin] RBAC: Authorizing `identity:get_user(user_id=f1c7660050c245549b3aa8237868945a)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:05.007731 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca7b0c1-30cd-495e-a5c8-fa9dbc4bb6b9 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:05.009532 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 60/123] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Jul 2 03:16:04 2022] GET /identity/v3/users/f1c7660050c245549b3aa8237868945a => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:05.014254 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca7b0c1-30cd-495e-a5c8-fa9dbc4bb6b9 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:05.017767 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc5a4dc-13a2-47d7-92f5-585396ec2ca2 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:05.045650 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:05.065581 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2ffe9a-046c-49bb-a12f-4d88ab0c5f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:05.066952 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ffe9a-046c-49bb-a12f-4d88ab0c5f4a None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:05.067454 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ffe9a-046c-49bb-a12f-4d88ab0c5f4a None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:05.067922 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ffe9a-046c-49bb-a12f-4d88ab0c5f4a None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:05.069395 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2ffe9a-046c-49bb-a12f-4d88ab0c5f4a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:05.069919 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2ffe9a-046c-49bb-a12f-4d88ab0c5f4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:05.072108 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2ffe9a-046c-49bb-a12f-4d88ab0c5f4a None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:05.085303 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 64/124] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Jul 2 03:16:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:05.087696 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac79d5f-7cea-4ebc-810a-bb09d68bafbb None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:05.088185 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac79d5f-7cea-4ebc-810a-bb09d68bafbb None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:05.088886 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac79d5f-7cea-4ebc-810a-bb09d68bafbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:05.109156 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-dac79d5f-7cea-4ebc-810a-bb09d68bafbb None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:16:05.110685 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-dac79d5f-7cea-4ebc-810a-bb09d68bafbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:16:05.120810 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca7b0c1-30cd-495e-a5c8-fa9dbc4bb6b9 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:05.156141 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2750c41-e6ea-4e8b-a333-54b09ce74a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:05.156545 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2750c41-e6ea-4e8b-a333-54b09ce74a91 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:05.156875 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2750c41-e6ea-4e8b-a333-54b09ce74a91 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:05.157161 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2750c41-e6ea-4e8b-a333-54b09ce74a91 None admin] PATH_INFO: `/v3/projects/73025fb6edfa43b88c0c690d55906c19` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:05.158545 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2750c41-e6ea-4e8b-a333-54b09ce74a91 None admin] RBAC: Authorizing `identity:get_project(project_id=73025fb6edfa43b88c0c690d55906c19)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:05.160126 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2750c41-e6ea-4e8b-a333-54b09ce74a91 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:05.162097 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 61/125] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Jul 2 03:16:05 2022] GET /identity/v3/projects/73025fb6edfa43b88c0c690d55906c19 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:05.163102 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2750c41-e6ea-4e8b-a333-54b09ce74a91 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:05.187838 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 65/126] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:16:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 03:16:05.189009 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac79d5f-7cea-4ebc-810a-bb09d68bafbb None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:05.205143 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:05.286898 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:05.289854 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2750c41-e6ea-4e8b-a333-54b09ce74a91 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:05.301883 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac79d5f-7cea-4ebc-810a-bb09d68bafbb None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:05.324824 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed7dfa7-21d3-4452-b607-6051f3d92086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:05.325695 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed7dfa7-21d3-4452-b607-6051f3d92086 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:05.325967 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed7dfa7-21d3-4452-b607-6051f3d92086 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:05.326245 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed7dfa7-21d3-4452-b607-6051f3d92086 None admin] PATH_INFO: `/v3/projects/73025fb6edfa43b88c0c690d55906c19` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:05.327503 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed7dfa7-21d3-4452-b607-6051f3d92086 None admin] RBAC: Authorizing `identity:get_project(project_id=73025fb6edfa43b88c0c690d55906c19)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:05.329014 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed7dfa7-21d3-4452-b607-6051f3d92086 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:05.335150 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 62/127] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Jul 2 03:16:05 2022] GET /identity/v3/projects/73025fb6edfa43b88c0c690d55906c19 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:05.335150 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed7dfa7-21d3-4452-b607-6051f3d92086 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:05.344896 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1fecdf-1208-4187-a0ac-bdf144c3599f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:05.346054 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1fecdf-1208-4187-a0ac-bdf144c3599f None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:05.346602 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1fecdf-1208-4187-a0ac-bdf144c3599f None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:05.347149 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1fecdf-1208-4187-a0ac-bdf144c3599f None admin] PATH_INFO: `/v3/users/6fcf66469a4a46abb312bd46ef8e4455` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:05.348626 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1fecdf-1208-4187-a0ac-bdf144c3599f None admin] RBAC: Authorizing `identity:get_user(user_id=6fcf66469a4a46abb312bd46ef8e4455)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:05.350460 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1fecdf-1208-4187-a0ac-bdf144c3599f None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:05.352344 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 66/128] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Jul 2 03:16:05 2022] GET /identity/v3/users/6fcf66469a4a46abb312bd46ef8e4455 => generated 247 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:05.353468 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1fecdf-1208-4187-a0ac-bdf144c3599f None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:05.441300 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed7dfa7-21d3-4452-b607-6051f3d92086 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:05.443902 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:05.464985 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1fecdf-1208-4187-a0ac-bdf144c3599f None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:05.476300 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e0152d-85b2-4c55-b3e6-0a73bf1b124a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:05.477296 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e0152d-85b2-4c55-b3e6-0a73bf1b124a None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:05.477579 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e0152d-85b2-4c55-b3e6-0a73bf1b124a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:05.477851 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e0152d-85b2-4c55-b3e6-0a73bf1b124a None admin] PATH_INFO: `/v3/projects/73025fb6edfa43b88c0c690d55906c19/users/f1c7660050c245549b3aa8237868945a/roles/a9792a930e0c4e139f287a712dfc7d4d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:05.480147 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e0152d-85b2-4c55-b3e6-0a73bf1b124a None admin] RBAC: Authorizing `identity:create_grant(project_id=73025fb6edfa43b88c0c690d55906c19, user_id=f1c7660050c245549b3aa8237868945a, role_id=a9792a930e0c4e139f287a712dfc7d4d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:05.481871 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e0152d-85b2-4c55-b3e6-0a73bf1b124a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:05.498873 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 63/129] 10.222.0.60 () {58 vars in 1439 bytes} [Sat Jul 2 03:16:05 2022] PUT /identity/v3/projects/73025fb6edfa43b88c0c690d55906c19/users/f1c7660050c245549b3aa8237868945a/roles/a9792a930e0c4e139f287a712dfc7d4d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:16:05.499921 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e0152d-85b2-4c55-b3e6-0a73bf1b124a None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:05.503955 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8d04c0-5573-4152-9cc5-d508859ae76f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:05.505217 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d04c0-5573-4152-9cc5-d508859ae76f None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:05.505695 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d04c0-5573-4152-9cc5-d508859ae76f None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:05.506163 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d04c0-5573-4152-9cc5-d508859ae76f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:05.519341 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8d04c0-5573-4152-9cc5-d508859ae76f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:16:05.528687 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-6a8d04c0-5573-4152-9cc5-d508859ae76f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 02 03:16:05.528687 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:05.528687 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:05.528687 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:05.528687 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:05.528687 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:05.528687 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:05.528687 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:05.528687 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:05.528687 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:05.528687 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:05.528687 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:05.528687 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:16:05.528687 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:16:05.528687 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:16:05.528687 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:16:05.529562 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:16:05.529562 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:16:05.529562 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:16:05.529562 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:16:05.529562 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:05.529562 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:05.529562 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:05.529562 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:05.529562 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:05.529562 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:05.529562 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:05.529562 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:05.529562 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:05.529562 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:05.529562 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:05.529562 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:05.530487 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:05.530487 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:05.530487 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:05.530487 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:05.530487 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:16:05.530487 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:16:05.530487 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:16:05.530487 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:16:05.530487 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:16:05.530487 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:16:05.530487 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 02 03:16:05.530487 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:16:05.531905 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:05.534402 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 67/130] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Jul 2 03:16:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:16:05.535764 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8d04c0-5573-4152-9cc5-d508859ae76f None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:05.630876 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e0152d-85b2-4c55-b3e6-0a73bf1b124a None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:05.667879 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd6694-fd3f-4465-bf8a-b87915820d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:05.668705 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd6694-fd3f-4465-bf8a-b87915820d0a None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:05.668988 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd6694-fd3f-4465-bf8a-b87915820d0a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:05.669266 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd6694-fd3f-4465-bf8a-b87915820d0a None admin] PATH_INFO: `/v3/projects/73025fb6edfa43b88c0c690d55906c19/users/f1c7660050c245549b3aa8237868945a/roles/c43aada0326446c4ade0ab1262918fa4` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:05.671688 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd6694-fd3f-4465-bf8a-b87915820d0a None admin] RBAC: Authorizing `identity:create_grant(project_id=73025fb6edfa43b88c0c690d55906c19, user_id=f1c7660050c245549b3aa8237868945a, role_id=c43aada0326446c4ade0ab1262918fa4)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:05.673190 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd6694-fd3f-4465-bf8a-b87915820d0a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:05.678109 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8d04c0-5573-4152-9cc5-d508859ae76f None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:05.709215 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 64/131] 10.222.0.60 () {58 vars in 1439 bytes} [Sat Jul 2 03:16:05 2022] PUT /identity/v3/projects/73025fb6edfa43b88c0c690d55906c19/users/f1c7660050c245549b3aa8237868945a/roles/c43aada0326446c4ade0ab1262918fa4 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:16:05.711240 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd6694-fd3f-4465-bf8a-b87915820d0a None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:05.717496 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78073670-4342-47b6-be38-282106d06e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:05.718959 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78073670-4342-47b6-be38-282106d06e96 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:05.719501 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78073670-4342-47b6-be38-282106d06e96 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:05.720008 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78073670-4342-47b6-be38-282106d06e96 None admin] PATH_INFO: `/v3/projects/73025fb6edfa43b88c0c690d55906c19` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:05.721608 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78073670-4342-47b6-be38-282106d06e96 None admin] RBAC: Authorizing `identity:get_project(project_id=73025fb6edfa43b88c0c690d55906c19)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:05.723453 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78073670-4342-47b6-be38-282106d06e96 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:05.725613 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 68/132] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Jul 2 03:16:05 2022] GET /identity/v3/projects/73025fb6edfa43b88c0c690d55906c19 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:05.732303 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78073670-4342-47b6-be38-282106d06e96 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:05.745715 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:05.847864 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78073670-4342-47b6-be38-282106d06e96 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:05.872184 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:05.886698 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd6694-fd3f-4465-bf8a-b87915820d0a None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:05.891184 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce9a87-4aad-4299-8b0e-b53b8da63ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:05.892636 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce9a87-4aad-4299-8b0e-b53b8da63ec1 None admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:05.893231 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce9a87-4aad-4299-8b0e-b53b8da63ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:05.893697 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce9a87-4aad-4299-8b0e-b53b8da63ec1 None admin] PATH_INFO: `/v3/projects/73025fb6edfa43b88c0c690d55906c19/users/6fcf66469a4a46abb312bd46ef8e4455/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:05.896015 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ce9a87-4aad-4299-8b0e-b53b8da63ec1 None admin] RBAC: Authorizing `identity:create_grant(project_id=73025fb6edfa43b88c0c690d55906c19, user_id=6fcf66469a4a46abb312bd46ef8e4455, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:05.897757 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ce9a87-4aad-4299-8b0e-b53b8da63ec1 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:05.915006 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 69/133] 10.222.0.60 () {58 vars in 1439 bytes} [Sat Jul 2 03:16:05 2022] PUT /identity/v3/projects/73025fb6edfa43b88c0c690d55906c19/users/6fcf66469a4a46abb312bd46ef8e4455/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:16:05.937832 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217795cb-c2d3-405e-810c-9a8b86cfde73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:05.938529 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217795cb-c2d3-405e-810c-9a8b86cfde73 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:05.938815 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217795cb-c2d3-405e-810c-9a8b86cfde73 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:05.939089 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217795cb-c2d3-405e-810c-9a8b86cfde73 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:05.939972 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217795cb-c2d3-405e-810c-9a8b86cfde73 None admin] RBAC: Adding query filter params (name=member) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:05.940291 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217795cb-c2d3-405e-810c-9a8b86cfde73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:05.941735 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217795cb-c2d3-405e-810c-9a8b86cfde73 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:05.952000 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 65/134] 10.222.0.60 () {56 vars in 1101 bytes} [Sat Jul 2 03:16:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:05.958018 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce9a87-4aad-4299-8b0e-b53b8da63ec1 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:06.037417 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:06.077161 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce9a87-4aad-4299-8b0e-b53b8da63ec1 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:06.117254 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca4aaa-cfdb-43e3-94f1-b2c4302807f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:06.118164 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca4aaa-cfdb-43e3-94f1-b2c4302807f8 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:06.118444 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca4aaa-cfdb-43e3-94f1-b2c4302807f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:06.118722 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca4aaa-cfdb-43e3-94f1-b2c4302807f8 None admin] PATH_INFO: `/v3/users/f1c7660050c245549b3aa8237868945a` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:06.120189 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cca4aaa-cfdb-43e3-94f1-b2c4302807f8 None admin] RBAC: Authorizing `identity:get_user(user_id=f1c7660050c245549b3aa8237868945a)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:06.121718 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cca4aaa-cfdb-43e3-94f1-b2c4302807f8 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:06.123749 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 70/135] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Jul 2 03:16:05 2022] GET /identity/v3/users/f1c7660050c245549b3aa8237868945a => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:06.129511 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217795cb-c2d3-405e-810c-9a8b86cfde73 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:06.241444 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217795cb-c2d3-405e-810c-9a8b86cfde73 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:06.276859 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff05ab-3950-4598-bbd7-5686ec2642e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:06.277741 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff05ab-3950-4598-bbd7-5686ec2642e5 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:06.278024 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff05ab-3950-4598-bbd7-5686ec2642e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:06.278297 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff05ab-3950-4598-bbd7-5686ec2642e5 None admin] PATH_INFO: `/v3/projects/8c6c0204b3d747f7874d3177babba295` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:06.279540 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ff05ab-3950-4598-bbd7-5686ec2642e5 None admin] RBAC: Authorizing `identity:get_project(project_id=8c6c0204b3d747f7874d3177babba295)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:06.281104 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ff05ab-3950-4598-bbd7-5686ec2642e5 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:06.283018 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 66/136] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Jul 2 03:16:06 2022] GET /identity/v3/projects/8c6c0204b3d747f7874d3177babba295 => generated 312 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:06.288755 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca4aaa-cfdb-43e3-94f1-b2c4302807f8 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:06.310931 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41190f3a-1d75-4595-b24e-14314623863d None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:06.311359 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41190f3a-1d75-4595-b24e-14314623863d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:06.311564 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41190f3a-1d75-4595-b24e-14314623863d None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:06.313076 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 67/137] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:16:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 03:16:06.318080 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6826a3-6eb5-4309-b862-8137c0f2c2f6 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:06.318366 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6826a3-6eb5-4309-b862-8137c0f2c2f6 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:06.318643 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6826a3-6eb5-4309-b862-8137c0f2c2f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:06.342673 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-7e6826a3-6eb5-4309-b862-8137c0f2c2f6 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:16:06.343889 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7e6826a3-6eb5-4309-b862-8137c0f2c2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:16:06.377826 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:06.464301 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca4aaa-cfdb-43e3-94f1-b2c4302807f8 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:06.471144 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 68/138] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:16:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 02 03:16:06.471144 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1269d0-b6b0-487e-b3b5-53ff7a7f71e4 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:06.471144 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1269d0-b6b0-487e-b3b5-53ff7a7f71e4 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:06.471144 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1269d0-b6b0-487e-b3b5-53ff7a7f71e4 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:06.471144 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 69/139] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:16:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:16:06.474544 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac65e85-3e58-425d-839a-6bed79034179 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:06.474896 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac65e85-3e58-425d-839a-6bed79034179 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:06.475266 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac65e85-3e58-425d-839a-6bed79034179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:06.492890 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-cac65e85-3e58-425d-839a-6bed79034179 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:16:06.494016 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-cac65e85-3e58-425d-839a-6bed79034179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:16:06.526056 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c998e-d275-4018-8c2f-654eb0aad1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:06.527762 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c998e-d275-4018-8c2f-654eb0aad1f5 None admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:06.528217 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c998e-d275-4018-8c2f-654eb0aad1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:06.528801 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c998e-d275-4018-8c2f-654eb0aad1f5 None admin] PATH_INFO: `/v3/projects/8c6c0204b3d747f7874d3177babba295/users/f1c7660050c245549b3aa8237868945a/roles/c43aada0326446c4ade0ab1262918fa4` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:06.533038 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87c998e-d275-4018-8c2f-654eb0aad1f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=8c6c0204b3d747f7874d3177babba295, user_id=f1c7660050c245549b3aa8237868945a, role_id=c43aada0326446c4ade0ab1262918fa4)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:06.534496 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87c998e-d275-4018-8c2f-654eb0aad1f5 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:06.544379 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:06.576326 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 70/140] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:16:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 03:16:06.577708 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 71/141] 10.222.0.60 () {58 vars in 1439 bytes} [Sat Jul 2 03:16:06 2022] PUT /identity/v3/projects/8c6c0204b3d747f7874d3177babba295/users/f1c7660050c245549b3aa8237868945a/roles/c43aada0326446c4ade0ab1262918fa4 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:16:06.583147 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac65e85-3e58-425d-839a-6bed79034179 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:06.640226 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c998e-d275-4018-8c2f-654eb0aad1f5 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:06.676388 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:06.701518 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac65e85-3e58-425d-839a-6bed79034179 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:06.738575 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15876ddb-af27-40d0-b9d0-88bddae65541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:06.739778 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15876ddb-af27-40d0-b9d0-88bddae65541 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:06.740262 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15876ddb-af27-40d0-b9d0-88bddae65541 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:06.740774 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15876ddb-af27-40d0-b9d0-88bddae65541 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:06.753672 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15876ddb-af27-40d0-b9d0-88bddae65541 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:16:06.762546 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-15876ddb-af27-40d0-b9d0-88bddae65541 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 02 03:16:06.762546 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:06.762546 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:06.762546 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:06.762546 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:06.762546 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:06.762546 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:06.762546 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:06.762546 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:06.762546 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:06.762546 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:06.762546 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:06.762546 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:16:06.762546 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:16:06.762546 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:16:06.762546 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:16:06.763631 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:16:06.763631 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:16:06.763631 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:16:06.763631 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:16:06.763631 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:06.763631 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:06.763631 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:06.763631 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:06.763631 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:06.763631 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:06.763631 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:06.763631 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:06.763631 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:06.763631 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:06.763631 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:06.763631 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:06.764475 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:06.764475 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:06.764475 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:06.764475 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:06.764475 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:16:06.764475 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:16:06.764475 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:16:06.764475 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:16:06.764475 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:16:06.764475 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:16:06.764475 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 02 03:16:06.764475 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:16:06.766865 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 71/142] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Jul 2 03:16:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:16:06.781396 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15876ddb-af27-40d0-b9d0-88bddae65541 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:06.853085 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c998e-d275-4018-8c2f-654eb0aad1f5 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:06.896003 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15876ddb-af27-40d0-b9d0-88bddae65541 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:06.932676 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26af9798-1b7c-4494-9346-01a113d72938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:06.933700 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af9798-1b7c-4494-9346-01a113d72938 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:06.934199 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af9798-1b7c-4494-9346-01a113d72938 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:06.934669 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af9798-1b7c-4494-9346-01a113d72938 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:06.935754 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26af9798-1b7c-4494-9346-01a113d72938 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:06.936430 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26af9798-1b7c-4494-9346-01a113d72938 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:06.938047 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26af9798-1b7c-4494-9346-01a113d72938 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:06.939833 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daaab9a-c53d-40f8-851c-d50938832f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:06.940657 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daaab9a-c53d-40f8-851c-d50938832f83 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:06.940946 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daaab9a-c53d-40f8-851c-d50938832f83 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:06.941225 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daaab9a-c53d-40f8-851c-d50938832f83 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:06.942476 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daaab9a-c53d-40f8-851c-d50938832f83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:06.943946 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daaab9a-c53d-40f8-851c-d50938832f83 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:06.945341 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:06.945598 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 72/143] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:16:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:06.950337 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 72/144] 10.222.0.60 () {56 vars in 1101 bytes} [Sat Jul 2 03:16:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:16:06.955979 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daaab9a-c53d-40f8-851c-d50938832f83 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:06.957701 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26af9798-1b7c-4494-9346-01a113d72938 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:07.061074 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26af9798-1b7c-4494-9346-01a113d72938 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:07.098214 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353d8012-9669-437a-b0e6-53f1e022ee0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:07.099281 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d8012-9669-437a-b0e6-53f1e022ee0b None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:07.099762 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d8012-9669-437a-b0e6-53f1e022ee0b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:07.100333 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d8012-9669-437a-b0e6-53f1e022ee0b None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:07.101265 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353d8012-9669-437a-b0e6-53f1e022ee0b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:07.102921 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353d8012-9669-437a-b0e6-53f1e022ee0b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:07.111599 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:07.130429 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 73/145] 10.222.0.60 () {60 vars in 1132 bytes} [Sat Jul 2 03:16:06 2022] POST /identity/v3/users => generated 283 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 03:16:07.162435 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daaab9a-c53d-40f8-851c-d50938832f83 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:07.198784 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5486575-952f-4ae9-b892-0f9e9912aca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:07.200091 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5486575-952f-4ae9-b892-0f9e9912aca2 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:07.200576 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5486575-952f-4ae9-b892-0f9e9912aca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:07.201046 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5486575-952f-4ae9-b892-0f9e9912aca2 None admin] PATH_INFO: `/v3/users/750caf97b9a44ca782e182ac8b7d3fce` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:07.202688 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5486575-952f-4ae9-b892-0f9e9912aca2 None admin] RBAC: Authorizing `identity:get_user(user_id=750caf97b9a44ca782e182ac8b7d3fce)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:07.204595 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5486575-952f-4ae9-b892-0f9e9912aca2 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:07.206575 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 73/146] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Jul 2 03:16:06 2022] GET /identity/v3/users/750caf97b9a44ca782e182ac8b7d3fce => generated 289 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:07.212399 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353d8012-9669-437a-b0e6-53f1e022ee0b None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:07.276982 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:07.328320 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353d8012-9669-437a-b0e6-53f1e022ee0b None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:07.364711 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c6661-eced-4755-8a12-7983b5eea956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:07.365948 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c6661-eced-4755-8a12-7983b5eea956 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:07.366424 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c6661-eced-4755-8a12-7983b5eea956 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:07.366893 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c6661-eced-4755-8a12-7983b5eea956 None admin] PATH_INFO: `/v3/projects/73025fb6edfa43b88c0c690d55906c19` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:07.368460 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56c6661-eced-4755-8a12-7983b5eea956 None admin] RBAC: Authorizing `identity:get_project(project_id=73025fb6edfa43b88c0c690d55906c19)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:07.370217 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56c6661-eced-4755-8a12-7983b5eea956 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:07.372165 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 74/147] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Jul 2 03:16:07 2022] GET /identity/v3/projects/73025fb6edfa43b88c0c690d55906c19 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:16:07.378075 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5486575-952f-4ae9-b892-0f9e9912aca2 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:07.510536 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5486575-952f-4ae9-b892-0f9e9912aca2 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:07.543406 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:07.549132 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc1a8a-1d49-4480-9533-4f6246a286b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:07.550173 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc1a8a-1d49-4480-9533-4f6246a286b5 None admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:07.550633 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc1a8a-1d49-4480-9533-4f6246a286b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:07.550907 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc1a8a-1d49-4480-9533-4f6246a286b5 None admin] PATH_INFO: `/v3/projects/73025fb6edfa43b88c0c690d55906c19/users/750caf97b9a44ca782e182ac8b7d3fce/roles/e7cdb23960ca4be7a9cd4c7685029db0` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:07.552946 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc1a8a-1d49-4480-9533-4f6246a286b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=73025fb6edfa43b88c0c690d55906c19, user_id=750caf97b9a44ca782e182ac8b7d3fce, role_id=e7cdb23960ca4be7a9cd4c7685029db0)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:07.554393 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc1a8a-1d49-4480-9533-4f6246a286b5 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:07.570634 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 74/148] 10.222.0.60 () {58 vars in 1439 bytes} [Sat Jul 2 03:16:07 2022] PUT /identity/v3/projects/73025fb6edfa43b88c0c690d55906c19/users/750caf97b9a44ca782e182ac8b7d3fce/roles/e7cdb23960ca4be7a9cd4c7685029db0 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:16:08.282630 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0168a9c7-9fbe-410c-bd91-60015d5e6fd2 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:08.282630 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0168a9c7-9fbe-410c-bd91-60015d5e6fd2 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:08.282630 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0168a9c7-9fbe-410c-bd91-60015d5e6fd2 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:08.282630 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 75/149] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:16:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:16:08.287871 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc90681-14c7-4089-9f0c-4a62e261cf10 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:08.288419 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc90681-14c7-4089-9f0c-4a62e261cf10 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:08.288918 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc90681-14c7-4089-9f0c-4a62e261cf10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:08.309930 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-3fc90681-14c7-4089-9f0c-4a62e261cf10 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:16:08.311655 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-3fc90681-14c7-4089-9f0c-4a62e261cf10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:16:08.391377 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 75/150] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:16:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 03:16:08.432982 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0168a9c7-9fbe-410c-bd91-60015d5e6fd2 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:08.556021 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0168a9c7-9fbe-410c-bd91-60015d5e6fd2 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:08.587152 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:08.598645 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b16d6a-d93d-4327-8cfb-ad287195c7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:08.599818 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b16d6a-d93d-4327-8cfb-ad287195c7ce None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:08.600309 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b16d6a-d93d-4327-8cfb-ad287195c7ce None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:08.600774 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b16d6a-d93d-4327-8cfb-ad287195c7ce None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:08.611631 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b16d6a-d93d-4327-8cfb-ad287195c7ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:16:08.629269 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-b3b16d6a-d93d-4327-8cfb-ad287195c7ce None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 02 03:16:08.629269 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:08.629269 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:08.629269 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:08.629269 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:08.629269 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:08.629269 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:08.629269 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:08.629269 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:08.629269 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:08.629269 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:08.629269 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:08.629269 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:16:08.629269 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:16:08.629269 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:16:08.629269 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:16:08.630201 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:16:08.630201 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:16:08.630201 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:16:08.630201 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:16:08.630201 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:08.630201 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:08.630201 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:08.630201 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:08.630201 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:08.630201 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:08.630201 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:08.630201 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:08.630201 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:08.630201 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:08.630201 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:08.630201 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:08.630984 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:08.630984 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:08.630984 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:08.630984 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:08.630984 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:16:08.630984 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:16:08.630984 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:16:08.630984 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:16:08.630984 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:16:08.630984 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:16:08.630984 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 02 03:16:08.630984 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:16:08.633448 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 76/151] 10.222.0.60 () {56 vars in 1114 bytes} [Sat Jul 2 03:16:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:16:08.639364 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc90681-14c7-4089-9f0c-4a62e261cf10 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:08.748362 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc90681-14c7-4089-9f0c-4a62e261cf10 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:08.777780 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:08.789779 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7664e5-8d57-4a29-b62c-057f00397851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:08.791024 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7664e5-8d57-4a29-b62c-057f00397851 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:08.791735 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7664e5-8d57-4a29-b62c-057f00397851 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:08.792577 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7664e5-8d57-4a29-b62c-057f00397851 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:08.793890 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7664e5-8d57-4a29-b62c-057f00397851 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:08.794469 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7664e5-8d57-4a29-b62c-057f00397851 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:08.796019 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7664e5-8d57-4a29-b62c-057f00397851 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:08.804968 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 76/152] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Jul 2 03:16:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:08.811199 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b16d6a-d93d-4327-8cfb-ad287195c7ce None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:08.927264 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b16d6a-d93d-4327-8cfb-ad287195c7ce None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:08.974852 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb70182-b8e7-460b-b73b-a3b390b13007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:08.975846 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb70182-b8e7-460b-b73b-a3b390b13007 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:08.976177 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb70182-b8e7-460b-b73b-a3b390b13007 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:08.976457 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb70182-b8e7-460b-b73b-a3b390b13007 None admin] PATH_INFO: `/v3/users/f1c7660050c245549b3aa8237868945a` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:08.977748 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb70182-b8e7-460b-b73b-a3b390b13007 None admin] RBAC: Authorizing `identity:get_user(user_id=f1c7660050c245549b3aa8237868945a)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:08.979282 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb70182-b8e7-460b-b73b-a3b390b13007 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:08.981001 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 77/153] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Jul 2 03:16:08 2022] GET /identity/v3/users/f1c7660050c245549b3aa8237868945a => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:08.986812 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7664e5-8d57-4a29-b62c-057f00397851 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:09.115954 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7664e5-8d57-4a29-b62c-057f00397851 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:09.159728 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe1201a-1e0e-47e2-9701-24a82127f086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:09.160430 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe1201a-1e0e-47e2-9701-24a82127f086 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:09.160714 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe1201a-1e0e-47e2-9701-24a82127f086 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:09.160992 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe1201a-1e0e-47e2-9701-24a82127f086 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:09.226805 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:09.243158 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe1201a-1e0e-47e2-9701-24a82127f086 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:09.244718 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe1201a-1e0e-47e2-9701-24a82127f086 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:09.363725 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 77/154] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Jul 2 03:16:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 03:16:09.369624 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb70182-b8e7-460b-b73b-a3b390b13007 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:09.436416 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:09.492769 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb70182-b8e7-460b-b73b-a3b390b13007 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:09.530601 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f906f5db-0b14-45f4-84b2-ae6853a425ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:09.531503 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906f5db-0b14-45f4-84b2-ae6853a425ad None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:09.531783 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906f5db-0b14-45f4-84b2-ae6853a425ad None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:09.532060 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906f5db-0b14-45f4-84b2-ae6853a425ad None admin] PATH_INFO: `/v3/projects/73025fb6edfa43b88c0c690d55906c19` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:09.533370 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f906f5db-0b14-45f4-84b2-ae6853a425ad None admin] RBAC: Authorizing `identity:get_project(project_id=73025fb6edfa43b88c0c690d55906c19)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:09.534900 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f906f5db-0b14-45f4-84b2-ae6853a425ad None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:09.536648 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 78/155] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Jul 2 03:16:09 2022] GET /identity/v3/projects/73025fb6edfa43b88c0c690d55906c19 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:09.542861 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe1201a-1e0e-47e2-9701-24a82127f086 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:09.630972 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77deabd-677b-4850-ba82-88dd2294f2a4 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:09.631173 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77deabd-677b-4850-ba82-88dd2294f2a4 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:09.631461 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77deabd-677b-4850-ba82-88dd2294f2a4 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:09.632847 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 79/156] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:16:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:16:09.638103 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2673e0e-0093-4e70-89ad-28feb096a41a None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:09.638386 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2673e0e-0093-4e70-89ad-28feb096a41a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:09.638663 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2673e0e-0093-4e70-89ad-28feb096a41a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:09.659511 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:09.669457 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-d2673e0e-0093-4e70-89ad-28feb096a41a None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:16:09.670723 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d2673e0e-0093-4e70-89ad-28feb096a41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:16:09.690174 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe1201a-1e0e-47e2-9701-24a82127f086 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:09.727152 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72acb255-8881-4988-8a5b-4f2e1158367b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:09.728182 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72acb255-8881-4988-8a5b-4f2e1158367b None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:09.728656 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72acb255-8881-4988-8a5b-4f2e1158367b None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:09.729124 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72acb255-8881-4988-8a5b-4f2e1158367b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:09.730302 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72acb255-8881-4988-8a5b-4f2e1158367b None admin] RBAC: Adding query filter params (role.id=a9792a930e0c4e139f287a712dfc7d4d, scope.project.id=73025fb6edfa43b88c0c690d55906c19, user.id=f1c7660050c245549b3aa8237868945a) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:09.730864 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72acb255-8881-4988-8a5b-4f2e1158367b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:09.732560 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72acb255-8881-4988-8a5b-4f2e1158367b None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:09.739688 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 78/157] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Jul 2 03:16:09 2022] GET /identity/v3/role_assignments?user.id=f1c7660050c245549b3aa8237868945a&scope.project.id=73025fb6edfa43b88c0c690d55906c19&role.id=a9792a930e0c4e139f287a712dfc7d4d => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:09.788539 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 80/158] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:16:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 02 03:16:09.829274 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4d265-4e5f-4e2a-91b6-137244b4ac9f None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:09.829888 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4d265-4e5f-4e2a-91b6-137244b4ac9f None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:09.830371 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4d265-4e5f-4e2a-91b6-137244b4ac9f None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:09.831988 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 79/159] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:16:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:16:09.833358 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2673e0e-0093-4e70-89ad-28feb096a41a None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:09.838778 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af037e0c-aceb-43aa-a8a4-63b88c1aa8f3 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:09.839398 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af037e0c-aceb-43aa-a8a4-63b88c1aa8f3 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:09.839880 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af037e0c-aceb-43aa-a8a4-63b88c1aa8f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:09.863941 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-af037e0c-aceb-43aa-a8a4-63b88c1aa8f3 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:16:09.871141 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-af037e0c-aceb-43aa-a8a4-63b88c1aa8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:16:09.897150 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:09.995819 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2673e0e-0093-4e70-89ad-28feb096a41a None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:10.075311 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 80/160] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:16:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 02 03:16:10.082312 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3c80e7-4f19-4f4b-a608-741ef889d08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:10.082854 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c80e7-4f19-4f4b-a608-741ef889d08e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:10.083143 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c80e7-4f19-4f4b-a608-741ef889d08e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:10.083426 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c80e7-4f19-4f4b-a608-741ef889d08e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:10.107239 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3c80e7-4f19-4f4b-a608-741ef889d08e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:16:10.119642 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-ff3c80e7-4f19-4f4b-a608-741ef889d08e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 03:16:10.119642 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:10.119642 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:10.119642 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:10.119642 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:10.119642 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:10.119642 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:10.119642 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:10.119642 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:10.119642 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:10.119642 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:10.119642 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:10.119642 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:16:10.119642 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:16:10.119642 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:16:10.119642 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:16:10.120524 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:16:10.120524 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:16:10.120524 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:16:10.120524 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:16:10.120524 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:10.120524 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:10.120524 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:10.120524 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:10.120524 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:10.120524 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:10.120524 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:10.120524 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:10.120524 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:10.120524 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:10.120524 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:10.120524 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:10.121374 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:10.121374 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:10.121374 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:10.121374 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:10.121374 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:16:10.121374 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:16:10.121374 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:16:10.121374 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:16:10.121374 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:16:10.121374 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:16:10.121374 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 03:16:10.121374 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:16:10.121374 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 81/161] 10.222.0.60 () {56 vars in 1096 bytes} [Sat Jul 2 03:16:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:16:10.127075 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3c80e7-4f19-4f4b-a608-741ef889d08e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:10.127406 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af037e0c-aceb-43aa-a8a4-63b88c1aa8f3 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:10.268990 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:10.299114 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af037e0c-aceb-43aa-a8a4-63b88c1aa8f3 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:10.343265 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3c80e7-4f19-4f4b-a608-741ef889d08e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:10.365198 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb744cf1-077e-4992-abad-ed473b94da34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:10.366106 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:10.366583 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb744cf1-077e-4992-abad-ed473b94da34 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:10.367075 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb744cf1-077e-4992-abad-ed473b94da34 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:10.373128 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb744cf1-077e-4992-abad-ed473b94da34 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:10.397946 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb744cf1-077e-4992-abad-ed473b94da34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:16:10.410396 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-bb744cf1-077e-4992-abad-ed473b94da34 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 02 03:16:10.410396 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:10.410396 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:10.410396 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:10.410396 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:10.410396 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:10.410396 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:10.410396 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:10.410396 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:10.410396 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:10.410396 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:10.410396 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:10.410396 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:16:10.410396 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:16:10.410396 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:16:10.410396 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:16:10.411317 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:16:10.411317 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:16:10.411317 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:16:10.411317 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:16:10.411317 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:10.411317 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:10.411317 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:10.411317 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:10.411317 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:10.411317 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:10.411317 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:10.411317 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:10.411317 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:10.411317 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:10.411317 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:10.411317 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:10.412139 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:10.412139 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:10.412139 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:10.412139 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:10.412139 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:16:10.412139 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:16:10.412139 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:16:10.412139 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:16:10.412139 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:16:10.412139 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:16:10.412139 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 02 03:16:10.412139 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:16:10.414545 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 81/162] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Jul 2 03:16:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:16:10.420945 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb744cf1-077e-4992-abad-ed473b94da34 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:10.462766 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a91934b-1e1b-4d49-b935-85622df67da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:10.467361 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91934b-1e1b-4d49-b935-85622df67da0 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:10.467361 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91934b-1e1b-4d49-b935-85622df67da0 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:10.467361 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91934b-1e1b-4d49-b935-85622df67da0 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:10.467361 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a91934b-1e1b-4d49-b935-85622df67da0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:10.467361 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a91934b-1e1b-4d49-b935-85622df67da0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:10.467361 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a91934b-1e1b-4d49-b935-85622df67da0 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:10.499434 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 82/163] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Jul 2 03:16:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:16:10.499434 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec564b51-ee1b-413c-97be-8f2ba9c40319 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:10.499434 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec564b51-ee1b-413c-97be-8f2ba9c40319 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:10.499434 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec564b51-ee1b-413c-97be-8f2ba9c40319 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:10.500377 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 83/164] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:16:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:16:10.522145 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63684a25-8e27-4709-9f6e-1e88c870666f None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:10.522145 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63684a25-8e27-4709-9f6e-1e88c870666f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:10.522145 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63684a25-8e27-4709-9f6e-1e88c870666f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:10.574192 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb744cf1-077e-4992-abad-ed473b94da34 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:10.578680 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-63684a25-8e27-4709-9f6e-1e88c870666f None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:16:10.583140 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-63684a25-8e27-4709-9f6e-1e88c870666f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:16:10.631829 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a3a715-f046-4e55-87fb-c9d6db8f70ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:10.633078 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a3a715-f046-4e55-87fb-c9d6db8f70ba None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:10.633647 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a3a715-f046-4e55-87fb-c9d6db8f70ba None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:10.634110 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a3a715-f046-4e55-87fb-c9d6db8f70ba None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:10.635080 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a3a715-f046-4e55-87fb-c9d6db8f70ba None admin] RBAC: Adding query filter params (name=member) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:10.635616 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a3a715-f046-4e55-87fb-c9d6db8f70ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:10.637221 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a3a715-f046-4e55-87fb-c9d6db8f70ba None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:10.647531 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:10.651377 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 82/165] 10.222.0.60 () {56 vars in 1101 bytes} [Sat Jul 2 03:16:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:16:10.657037 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a3a715-f046-4e55-87fb-c9d6db8f70ba None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:10.796630 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 84/166] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:16:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 03:16:10.798893 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63684a25-8e27-4709-9f6e-1e88c870666f None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:10.849266 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a3a715-f046-4e55-87fb-c9d6db8f70ba None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:10.919544 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b99276-ed92-4637-a92c-56f6c7cec4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:10.920872 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b99276-ed92-4637-a92c-56f6c7cec4c9 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:10.921348 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b99276-ed92-4637-a92c-56f6c7cec4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:10.921811 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b99276-ed92-4637-a92c-56f6c7cec4c9 None admin] PATH_INFO: `/v3/users/6fcf66469a4a46abb312bd46ef8e4455` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:10.927847 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b99276-ed92-4637-a92c-56f6c7cec4c9 None admin] RBAC: Authorizing `identity:get_user(user_id=6fcf66469a4a46abb312bd46ef8e4455)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:10.929594 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b99276-ed92-4637-a92c-56f6c7cec4c9 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:10.931568 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 83/167] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Jul 2 03:16:10 2022] GET /identity/v3/users/6fcf66469a4a46abb312bd46ef8e4455 => generated 247 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:10.932657 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b99276-ed92-4637-a92c-56f6c7cec4c9 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:11.007442 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:11.023578 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63684a25-8e27-4709-9f6e-1e88c870666f None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:11.025098 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:11.042697 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b99276-ed92-4637-a92c-56f6c7cec4c9 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:11.062038 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cfe6e3-0c21-42da-846b-e20995253a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:11.062846 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cfe6e3-0c21-42da-846b-e20995253a07 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:11.063138 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cfe6e3-0c21-42da-846b-e20995253a07 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:11.063410 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cfe6e3-0c21-42da-846b-e20995253a07 None admin] PATH_INFO: `/v3/users/f1c7660050c245549b3aa8237868945a` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:11.064640 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cfe6e3-0c21-42da-846b-e20995253a07 None admin] RBAC: Authorizing `identity:get_user(user_id=f1c7660050c245549b3aa8237868945a)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:11.066203 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cfe6e3-0c21-42da-846b-e20995253a07 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:11.067977 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 85/168] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Jul 2 03:16:10 2022] GET /identity/v3/users/f1c7660050c245549b3aa8237868945a => generated 275 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:11.072482 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cfe6e3-0c21-42da-846b-e20995253a07 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:11.085021 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b39e2e-1621-40f1-b1f4-dd6da36415df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:11.086139 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b39e2e-1621-40f1-b1f4-dd6da36415df None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:11.086614 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b39e2e-1621-40f1-b1f4-dd6da36415df None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:11.087078 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b39e2e-1621-40f1-b1f4-dd6da36415df None admin] PATH_INFO: `/v3/roles/member` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:11.100003 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b39e2e-1621-40f1-b1f4-dd6da36415df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:16:11.112033 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-99b39e2e-1621-40f1-b1f4-dd6da36415df None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 02 03:16:11.112033 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:11.112033 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:11.112033 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:11.112033 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:11.112033 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:11.112033 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:11.112033 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:11.112033 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:11.112033 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:11.112033 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:11.112033 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:11.112033 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:16:11.112033 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:16:11.112033 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:16:11.112033 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:16:11.113011 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:16:11.113011 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:16:11.113011 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:16:11.113011 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:16:11.113011 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:11.113011 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:11.113011 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:11.113011 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:11.113011 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:11.113011 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:11.113011 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:11.113011 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:11.113011 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:11.113011 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:11.113011 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:11.113011 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:11.113784 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:11.113784 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:11.113784 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:11.113784 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:11.113784 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:16:11.113784 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:16:11.113784 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:16:11.113784 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:16:11.113784 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:16:11.113784 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:16:11.113784 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 02 03:16:11.113784 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:16:11.116173 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 84/169] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Jul 2 03:16:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:16:11.117738 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6df695-1dea-4b11-9d3d-ef48f1eb7538 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:11.118232 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6df695-1dea-4b11-9d3d-ef48f1eb7538 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:11.118700 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6df695-1dea-4b11-9d3d-ef48f1eb7538 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:11.120347 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 85/170] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:16:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:16:11.121411 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6df695-1dea-4b11-9d3d-ef48f1eb7538 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:11.180848 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cfe6e3-0c21-42da-846b-e20995253a07 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:11.218743 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e0b216-bef7-4ef0-a010-27225adc9732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:11.219549 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0b216-bef7-4ef0-a010-27225adc9732 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:11.219810 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0b216-bef7-4ef0-a010-27225adc9732 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:11.220079 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0b216-bef7-4ef0-a010-27225adc9732 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:11.229494 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6df695-1dea-4b11-9d3d-ef48f1eb7538 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:11.256835 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:11.264312 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:11.265494 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1d6dd1-ece8-43cb-82da-a0e413f6173f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:11.266405 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d6dd1-ece8-43cb-82da-a0e413f6173f None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:11.267045 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d6dd1-ece8-43cb-82da-a0e413f6173f None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:11.267548 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d6dd1-ece8-43cb-82da-a0e413f6173f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:11.298088 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e0b216-bef7-4ef0-a010-27225adc9732 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:11.299838 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e0b216-bef7-4ef0-a010-27225adc9732 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:11.337940 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1d6dd1-ece8-43cb-82da-a0e413f6173f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:11.339903 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1d6dd1-ece8-43cb-82da-a0e413f6173f None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:11.402607 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 86/171] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Jul 2 03:16:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 03:16:11.403474 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e0b216-bef7-4ef0-a010-27225adc9732 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:11.441400 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 86/172] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Jul 2 03:16:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 03:16:11.447078 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ca0b0-32d5-42e8-83d6-e717d7d25a48 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:11.447484 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ca0b0-32d5-42e8-83d6-e717d7d25a48 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:11.447860 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ca0b0-32d5-42e8-83d6-e717d7d25a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:11.464584 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-be1ca0b0-32d5-42e8-83d6-e717d7d25a48 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:16:11.465905 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-be1ca0b0-32d5-42e8-83d6-e717d7d25a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:16:11.474838 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:11.490082 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:11.511781 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e0b216-bef7-4ef0-a010-27225adc9732 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:11.534692 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 87/173] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:16:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 03:16:11.535782 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1ca0b0-32d5-42e8-83d6-e717d7d25a48 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:11.559724 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303b46a2-9534-4715-b7cd-a8e17e2c3587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:11.560684 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b46a2-9534-4715-b7cd-a8e17e2c3587 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:11.561173 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b46a2-9534-4715-b7cd-a8e17e2c3587 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:11.561583 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b46a2-9534-4715-b7cd-a8e17e2c3587 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:11.562586 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303b46a2-9534-4715-b7cd-a8e17e2c3587 None admin] RBAC: Adding query filter params (name=member) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:11.563036 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303b46a2-9534-4715-b7cd-a8e17e2c3587 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:11.564699 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303b46a2-9534-4715-b7cd-a8e17e2c3587 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:11.578678 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 87/174] 10.222.0.60 () {56 vars in 1101 bytes} [Sat Jul 2 03:16:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:11.579901 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303b46a2-9534-4715-b7cd-a8e17e2c3587 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:11.637744 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1ca0b0-32d5-42e8-83d6-e717d7d25a48 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:11.692177 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1878fd-16fd-4126-8180-1b27d74a994b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:11.693079 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1878fd-16fd-4126-8180-1b27d74a994b None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:11.693501 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1878fd-16fd-4126-8180-1b27d74a994b None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:11.693631 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1878fd-16fd-4126-8180-1b27d74a994b None admin] PATH_INFO: `/v3/projects/73025fb6edfa43b88c0c690d55906c19` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:11.694800 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1878fd-16fd-4126-8180-1b27d74a994b None admin] RBAC: Authorizing `identity:get_project(project_id=73025fb6edfa43b88c0c690d55906c19)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:11.696299 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1878fd-16fd-4126-8180-1b27d74a994b None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:11.696957 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303b46a2-9534-4715-b7cd-a8e17e2c3587 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:11.698181 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 88/175] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Jul 2 03:16:11 2022] GET /identity/v3/projects/73025fb6edfa43b88c0c690d55906c19 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:11.703478 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1878fd-16fd-4126-8180-1b27d74a994b None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:11.728636 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:11.738923 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e783b-e29f-4826-ae23-eeed84631b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:11.740835 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e783b-e29f-4826-ae23-eeed84631b6f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:11.741518 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e783b-e29f-4826-ae23-eeed84631b6f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:11.744637 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e783b-e29f-4826-ae23-eeed84631b6f None admin] PATH_INFO: `/v3/projects/73025fb6edfa43b88c0c690d55906c19` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:11.746159 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617e783b-e29f-4826-ae23-eeed84631b6f None admin] RBAC: Authorizing `identity:get_project(project_id=73025fb6edfa43b88c0c690d55906c19)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:11.747841 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617e783b-e29f-4826-ae23-eeed84631b6f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:11.749955 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 88/176] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Jul 2 03:16:11 2022] GET /identity/v3/projects/73025fb6edfa43b88c0c690d55906c19 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:11.752021 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e783b-e29f-4826-ae23-eeed84631b6f None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:11.758916 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:11.847777 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1878fd-16fd-4126-8180-1b27d74a994b None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:11.881993 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e783b-e29f-4826-ae23-eeed84631b6f None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:11.882501 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd763fda-4ee1-4b2e-be55-56486da6fa32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:11.883970 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd763fda-4ee1-4b2e-be55-56486da6fa32 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:11.884437 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd763fda-4ee1-4b2e-be55-56486da6fa32 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:11.884909 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd763fda-4ee1-4b2e-be55-56486da6fa32 None admin] PATH_INFO: `/v3/users/f1c7660050c245549b3aa8237868945a` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:11.886308 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd763fda-4ee1-4b2e-be55-56486da6fa32 None admin] RBAC: Authorizing `identity:get_user(user_id=f1c7660050c245549b3aa8237868945a)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:11.888013 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd763fda-4ee1-4b2e-be55-56486da6fa32 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:11.889905 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 89/177] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Jul 2 03:16:11 2022] GET /identity/v3/users/f1c7660050c245549b3aa8237868945a => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:11.890857 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd763fda-4ee1-4b2e-be55-56486da6fa32 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:11.918732 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8499ba-e99c-416a-86a6-291d45669dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:11.919649 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8499ba-e99c-416a-86a6-291d45669dbe None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:11.919921 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8499ba-e99c-416a-86a6-291d45669dbe None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:11.920233 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8499ba-e99c-416a-86a6-291d45669dbe None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:11.931320 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8499ba-e99c-416a-86a6-291d45669dbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:16:11.939903 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-7d8499ba-e99c-416a-86a6-291d45669dbe None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 02 03:16:11.939903 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:11.939903 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:11.939903 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:11.939903 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:11.939903 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:11.939903 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:11.939903 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:11.939903 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:11.939903 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:11.939903 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:11.939903 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:11.939903 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:16:11.939903 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:16:11.939903 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:16:11.939903 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:16:11.940809 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:16:11.940809 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:16:11.940809 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:16:11.940809 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:16:11.940809 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:11.940809 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:11.940809 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:11.940809 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:11.940809 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:11.940809 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:11.940809 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:11.940809 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:11.940809 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:11.940809 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:11.940809 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:11.940809 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:11.941567 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:11.941567 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:11.941567 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:11.941567 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:11.941567 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:16:11.941567 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:16:11.941567 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:16:11.941567 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:16:11.941567 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:16:11.941567 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:16:11.941567 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 02 03:16:11.941567 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:16:11.941567 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 89/178] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Jul 2 03:16:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:16:11.947550 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8499ba-e99c-416a-86a6-291d45669dbe None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:11.999794 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd763fda-4ee1-4b2e-be55-56486da6fa32 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:12.010024 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:12.011585 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:12.036010 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed01c9e4-99c4-43ab-9a9e-6da4a38dcc01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:12.037022 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed01c9e4-99c4-43ab-9a9e-6da4a38dcc01 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:12.037490 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed01c9e4-99c4-43ab-9a9e-6da4a38dcc01 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:12.037986 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed01c9e4-99c4-43ab-9a9e-6da4a38dcc01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:12.039008 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed01c9e4-99c4-43ab-9a9e-6da4a38dcc01 None admin] RBAC: Adding query filter params (role.id=5dcd130cda6c490595e862dc2348e83d, scope.project.id=73025fb6edfa43b88c0c690d55906c19, user.id=6fcf66469a4a46abb312bd46ef8e4455) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:12.039673 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed01c9e4-99c4-43ab-9a9e-6da4a38dcc01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:12.041333 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed01c9e4-99c4-43ab-9a9e-6da4a38dcc01 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:12.048136 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 90/179] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Jul 2 03:16:11 2022] GET /identity/v3/role_assignments?user.id=6fcf66469a4a46abb312bd46ef8e4455&scope.project.id=73025fb6edfa43b88c0c690d55906c19&role.id=5dcd130cda6c490595e862dc2348e83d => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:12.049985 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2821d2-8912-4af1-8258-e1a72ade77cf None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:12.050461 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2821d2-8912-4af1-8258-e1a72ade77cf None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:12.050932 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2821d2-8912-4af1-8258-e1a72ade77cf None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:12.052486 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 91/180] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:16:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:16:12.053457 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2821d2-8912-4af1-8258-e1a72ade77cf None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:12.061547 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8499ba-e99c-416a-86a6-291d45669dbe None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:12.101017 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d81c72-9828-4947-a03f-e4e43d33f21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:12.102218 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d81c72-9828-4947-a03f-e4e43d33f21d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:12.102711 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d81c72-9828-4947-a03f-e4e43d33f21d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:12.103308 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d81c72-9828-4947-a03f-e4e43d33f21d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:12.104348 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d81c72-9828-4947-a03f-e4e43d33f21d None admin] RBAC: Adding query filter params (role.id=c43aada0326446c4ade0ab1262918fa4, scope.project.id=73025fb6edfa43b88c0c690d55906c19, user.id=f1c7660050c245549b3aa8237868945a) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:12.104879 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d81c72-9828-4947-a03f-e4e43d33f21d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:12.107317 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d81c72-9828-4947-a03f-e4e43d33f21d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:12.115048 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 90/181] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Jul 2 03:16:11 2022] GET /identity/v3/role_assignments?user.id=f1c7660050c245549b3aa8237868945a&scope.project.id=73025fb6edfa43b88c0c690d55906c19&role.id=c43aada0326446c4ade0ab1262918fa4 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:12.120863 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d81c72-9828-4947-a03f-e4e43d33f21d None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:12.169299 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2821d2-8912-4af1-8258-e1a72ade77cf None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:12.207517 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3ebce1-3a3c-4981-b439-1df8dd66a0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:12.208749 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ebce1-3a3c-4981-b439-1df8dd66a0ed None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:12.209236 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ebce1-3a3c-4981-b439-1df8dd66a0ed None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:12.209726 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ebce1-3a3c-4981-b439-1df8dd66a0ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:12.247667 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:12.283797 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d81c72-9828-4947-a03f-e4e43d33f21d None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:12.290211 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3ebce1-3a3c-4981-b439-1df8dd66a0ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:12.292400 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3ebce1-3a3c-4981-b439-1df8dd66a0ed None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:12.312476 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:12.325108 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0043fa-f0af-47c9-b7d1-43dad11edb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:12.325980 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0043fa-f0af-47c9-b7d1-43dad11edb9f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:12.326632 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0043fa-f0af-47c9-b7d1-43dad11edb9f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:12.327002 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0043fa-f0af-47c9-b7d1-43dad11edb9f None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:12.327920 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0043fa-f0af-47c9-b7d1-43dad11edb9f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:12.328327 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0043fa-f0af-47c9-b7d1-43dad11edb9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:12.330803 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0043fa-f0af-47c9-b7d1-43dad11edb9f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:12.344866 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 91/182] 10.222.0.60 () {56 vars in 1101 bytes} [Sat Jul 2 03:16:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:12.344866 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b304dff8-934a-4e57-b6c9-694294c8d1da None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:12.344866 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b304dff8-934a-4e57-b6c9-694294c8d1da None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:12.344866 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b304dff8-934a-4e57-b6c9-694294c8d1da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:12.362835 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-b304dff8-934a-4e57-b6c9-694294c8d1da None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:16:12.364290 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b304dff8-934a-4e57-b6c9-694294c8d1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:16:12.417075 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 92/183] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Jul 2 03:16:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 03:16:12.418733 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36a1d7-73ef-4988-99a9-afa626ac2f13 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:12.419024 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36a1d7-73ef-4988-99a9-afa626ac2f13 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:12.419506 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36a1d7-73ef-4988-99a9-afa626ac2f13 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:12.425158 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 93/184] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:16:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:16:12.425158 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d36a1d7-73ef-4988-99a9-afa626ac2f13 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:12.442154 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 92/185] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:16:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 03:16:12.443439 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ce2d0-503c-4d4e-8808-375904610ef7 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:12.443730 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ce2d0-503c-4d4e-8808-375904610ef7 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:12.444005 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ce2d0-503c-4d4e-8808-375904610ef7 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:12.445548 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 93/186] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:16:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:16:12.446865 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c348d6bf-649a-446b-b89d-53e0e06472ca None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:12.446865 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c348d6bf-649a-446b-b89d-53e0e06472ca None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:12.447159 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c348d6bf-649a-446b-b89d-53e0e06472ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:12.467898 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-c348d6bf-649a-446b-b89d-53e0e06472ca None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:16:12.469083 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c348d6bf-649a-446b-b89d-53e0e06472ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:16:12.499898 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:12.545329 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d36a1d7-73ef-4988-99a9-afa626ac2f13 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:12.545982 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 94/187] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:16:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 03:16:12.546809 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c348d6bf-649a-446b-b89d-53e0e06472ca None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:12.580948 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c9677-a79f-4ee1-8773-e3e3d8e1595b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:12.581831 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c9677-a79f-4ee1-8773-e3e3d8e1595b None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:12.582111 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c9677-a79f-4ee1-8773-e3e3d8e1595b None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:12.582380 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c9677-a79f-4ee1-8773-e3e3d8e1595b None admin] PATH_INFO: `/v3/users/750caf97b9a44ca782e182ac8b7d3fce` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:12.583616 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0c9677-a79f-4ee1-8773-e3e3d8e1595b None admin] RBAC: Authorizing `identity:get_user(user_id=750caf97b9a44ca782e182ac8b7d3fce)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:12.585070 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0c9677-a79f-4ee1-8773-e3e3d8e1595b None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:12.586716 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 94/188] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Jul 2 03:16:12 2022] GET /identity/v3/users/750caf97b9a44ca782e182ac8b7d3fce => generated 289 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:12.587870 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f283f3-6295-4ff0-b86f-51f937eebcf2 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:12.588151 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f283f3-6295-4ff0-b86f-51f937eebcf2 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:12.588425 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f283f3-6295-4ff0-b86f-51f937eebcf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:12.594154 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:12.605634 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-d2f283f3-6295-4ff0-b86f-51f937eebcf2 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:16:12.606833 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-d2f283f3-6295-4ff0-b86f-51f937eebcf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:16:12.645915 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c348d6bf-649a-446b-b89d-53e0e06472ca None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:12.672084 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 95/189] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:16:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 03:16:12.672826 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f283f3-6295-4ff0-b86f-51f937eebcf2 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:12.679817 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4218b02-6403-4111-b9a3-04e85a81f0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:12.680677 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4218b02-6403-4111-b9a3-04e85a81f0a2 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:12.680959 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4218b02-6403-4111-b9a3-04e85a81f0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:12.681234 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4218b02-6403-4111-b9a3-04e85a81f0a2 None admin] PATH_INFO: `/v3/projects/8c6c0204b3d747f7874d3177babba295` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:12.682506 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4218b02-6403-4111-b9a3-04e85a81f0a2 None admin] RBAC: Authorizing `identity:get_project(project_id=8c6c0204b3d747f7874d3177babba295)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:12.683989 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4218b02-6403-4111-b9a3-04e85a81f0a2 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:12.690471 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 95/190] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Jul 2 03:16:12 2022] GET /identity/v3/projects/8c6c0204b3d747f7874d3177babba295 => generated 312 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:12.690471 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4218b02-6403-4111-b9a3-04e85a81f0a2 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:12.734515 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:12.780563 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f283f3-6295-4ff0-b86f-51f937eebcf2 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:12.784366 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4218b02-6403-4111-b9a3-04e85a81f0a2 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:12.798376 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:12.814724 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8592f569-58f2-412f-8aa0-c5e6abd3cf05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:12.815549 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8592f569-58f2-412f-8aa0-c5e6abd3cf05 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:12.815832 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8592f569-58f2-412f-8aa0-c5e6abd3cf05 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:12.816217 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8592f569-58f2-412f-8aa0-c5e6abd3cf05 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:12.818735 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b70328a-75ff-4945-a492-94db3597dbc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:12.819546 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b70328a-75ff-4945-a492-94db3597dbc5 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:12.819825 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b70328a-75ff-4945-a492-94db3597dbc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:12.820089 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b70328a-75ff-4945-a492-94db3597dbc5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:12.821253 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b70328a-75ff-4945-a492-94db3597dbc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:12.822713 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b70328a-75ff-4945-a492-94db3597dbc5 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:12.824372 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 96/191] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:16:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:12.825120 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b70328a-75ff-4945-a492-94db3597dbc5 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:12.826478 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8592f569-58f2-412f-8aa0-c5e6abd3cf05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:16:12.834156 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-8592f569-58f2-412f-8aa0-c5e6abd3cf05 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 03:16:12.834156 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:12.834156 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:12.834156 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:12.834156 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:12.834156 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:12.834156 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:12.834156 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:12.834156 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:12.834156 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:12.834156 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:12.834156 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:12.834156 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:16:12.834156 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:16:12.834156 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:16:12.834156 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:16:12.835242 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:16:12.835242 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:16:12.835242 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:16:12.835242 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:16:12.835242 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:12.835242 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:12.835242 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:12.835242 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:12.835242 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:12.835242 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:12.835242 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:12.835242 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:12.835242 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:12.835242 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:12.835242 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:12.835242 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:12.836021 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:12.836021 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:12.836021 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:12.836021 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:12.836021 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:16:12.836021 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:16:12.836021 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:16:12.836021 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:16:12.836021 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:16:12.836021 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:16:12.836021 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 03:16:12.836021 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:16:12.836021 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 96/192] 10.222.0.60 () {56 vars in 1096 bytes} [Sat Jul 2 03:16:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:16:12.836660 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8592f569-58f2-412f-8aa0-c5e6abd3cf05 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:12.927639 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b70328a-75ff-4945-a492-94db3597dbc5 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:12.935818 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8592f569-58f2-412f-8aa0-c5e6abd3cf05 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:12.951890 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:12.960157 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104294c5-d131-4c69-8924-99c989eb7c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:12.960805 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104294c5-d131-4c69-8924-99c989eb7c70 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:12.961086 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104294c5-d131-4c69-8924-99c989eb7c70 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:12.961359 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104294c5-d131-4c69-8924-99c989eb7c70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:12.970605 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74df4b2-0dd7-41b4-84b6-c9ff9dced118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:12.971284 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74df4b2-0dd7-41b4-84b6-c9ff9dced118 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:12.971573 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74df4b2-0dd7-41b4-84b6-c9ff9dced118 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:12.971851 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74df4b2-0dd7-41b4-84b6-c9ff9dced118 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:12.972689 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74df4b2-0dd7-41b4-84b6-c9ff9dced118 None admin] RBAC: Adding query filter params (role.id=c43aada0326446c4ade0ab1262918fa4, scope.project.id=8c6c0204b3d747f7874d3177babba295, user.id=f1c7660050c245549b3aa8237868945a) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:12.973004 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74df4b2-0dd7-41b4-84b6-c9ff9dced118 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:12.974468 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74df4b2-0dd7-41b4-84b6-c9ff9dced118 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:12.980540 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 97/193] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Jul 2 03:16:12 2022] GET /identity/v3/role_assignments?user.id=f1c7660050c245549b3aa8237868945a&scope.project.id=8c6c0204b3d747f7874d3177babba295&role.id=c43aada0326446c4ade0ab1262918fa4 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:12.981313 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74df4b2-0dd7-41b4-84b6-c9ff9dced118 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:13.024987 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:13.048431 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104294c5-d131-4c69-8924-99c989eb7c70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:13.050260 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104294c5-d131-4c69-8924-99c989eb7c70 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:13.093897 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74df4b2-0dd7-41b4-84b6-c9ff9dced118 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:13.131481 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ebf9dc-72cd-4450-91c2-fbef80000c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:13.132029 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ebf9dc-72cd-4450-91c2-fbef80000c2a None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:13.132893 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ebf9dc-72cd-4450-91c2-fbef80000c2a None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:13.132993 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ebf9dc-72cd-4450-91c2-fbef80000c2a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:13.146963 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ebf9dc-72cd-4450-91c2-fbef80000c2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:16:13.155232 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-d9ebf9dc-72cd-4450-91c2-fbef80000c2a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 02 03:16:13.155232 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:13.155232 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:13.155232 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:13.155232 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:13.155232 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:13.155232 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:13.155232 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:13.155232 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:13.155232 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:13.155232 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:13.155232 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:13.155232 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:16:13.155232 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:16:13.155232 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:16:13.155232 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:16:13.156130 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:16:13.156130 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:16:13.156130 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:16:13.156130 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:16:13.156130 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:13.156130 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:13.156130 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:13.156130 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:13.156130 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:13.156130 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:13.156130 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:13.156130 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:13.156130 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:13.156130 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:13.156130 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:13.156130 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:13.156890 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:13.156890 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:13.156890 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:13.156890 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:13.156890 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:16:13.156890 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:16:13.156890 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:16:13.156890 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:16:13.156890 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:16:13.156890 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:16:13.156890 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 02 03:16:13.156890 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:16:13.156890 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 98/194] 10.222.0.60 () {56 vars in 1114 bytes} [Sat Jul 2 03:16:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:16:13.157519 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ebf9dc-72cd-4450-91c2-fbef80000c2a None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:13.166284 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 97/195] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Jul 2 03:16:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 03:16:13.167473 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104294c5-d131-4c69-8924-99c989eb7c70 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:13.214858 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:13.254135 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:13.272025 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ebf9dc-72cd-4450-91c2-fbef80000c2a None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:13.272161 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104294c5-d131-4c69-8924-99c989eb7c70 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:13.305241 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c8cab-9d13-4d7a-9a43-2046d5a5b78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:13.306004 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c8cab-9d13-4d7a-9a43-2046d5a5b78a None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:13.306281 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c8cab-9d13-4d7a-9a43-2046d5a5b78a None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:13.306549 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c8cab-9d13-4d7a-9a43-2046d5a5b78a None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:13.307290 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604c8cab-9d13-4d7a-9a43-2046d5a5b78a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:13.307404 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f7958-69de-4584-9e92-10a7bed1eb85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:13.308040 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f7958-69de-4584-9e92-10a7bed1eb85 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:13.308322 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f7958-69de-4584-9e92-10a7bed1eb85 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:13.308595 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f7958-69de-4584-9e92-10a7bed1eb85 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:13.308708 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604c8cab-9d13-4d7a-9a43-2046d5a5b78a None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:13.309345 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2f7958-69de-4584-9e92-10a7bed1eb85 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:13.309650 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2f7958-69de-4584-9e92-10a7bed1eb85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:13.311052 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2f7958-69de-4584-9e92-10a7bed1eb85 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:13.319011 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 98/196] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Jul 2 03:16:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:13.319823 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f7958-69de-4584-9e92-10a7bed1eb85 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:13.342546 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 99/197] 10.222.0.60 () {60 vars in 1132 bytes} [Sat Jul 2 03:16:13 2022] POST /identity/v3/users => generated 297 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:16:13.351568 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c8cab-9d13-4d7a-9a43-2046d5a5b78a None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:13.445239 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f7958-69de-4584-9e92-10a7bed1eb85 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:13.463680 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:13.470954 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c8cab-9d13-4d7a-9a43-2046d5a5b78a None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:13.489423 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51584f6-99f7-434d-8959-03df4decd036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:13.490105 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51584f6-99f7-434d-8959-03df4decd036 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:13.490387 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51584f6-99f7-434d-8959-03df4decd036 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:13.490818 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51584f6-99f7-434d-8959-03df4decd036 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:13.491733 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51584f6-99f7-434d-8959-03df4decd036 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:13.492037 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51584f6-99f7-434d-8959-03df4decd036 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:13.493445 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51584f6-99f7-434d-8959-03df4decd036 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:13.504279 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 99/198] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Jul 2 03:16:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:13.505373 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51584f6-99f7-434d-8959-03df4decd036 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:13.516114 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74906f08-7f78-4d1f-bbd2-f82164e75d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:13.516645 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:13.517448 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74906f08-7f78-4d1f-bbd2-f82164e75d22 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:13.517448 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74906f08-7f78-4d1f-bbd2-f82164e75d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:13.517648 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74906f08-7f78-4d1f-bbd2-f82164e75d22 None admin] PATH_INFO: `/v3/projects/73025fb6edfa43b88c0c690d55906c19` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:13.520275 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74906f08-7f78-4d1f-bbd2-f82164e75d22 None admin] RBAC: Authorizing `identity:get_project(project_id=73025fb6edfa43b88c0c690d55906c19)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:13.521859 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74906f08-7f78-4d1f-bbd2-f82164e75d22 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:13.523972 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 100/199] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Jul 2 03:16:13 2022] GET /identity/v3/projects/73025fb6edfa43b88c0c690d55906c19 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:13.524559 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74906f08-7f78-4d1f-bbd2-f82164e75d22 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:13.634319 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51584f6-99f7-434d-8959-03df4decd036 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:13.650247 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74906f08-7f78-4d1f-bbd2-f82164e75d22 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:13.677955 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d6da1b-86b8-4403-ab5c-57204b6db9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:13.678842 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d6da1b-86b8-4403-ab5c-57204b6db9cc None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:13.679144 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d6da1b-86b8-4403-ab5c-57204b6db9cc None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:13.679431 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d6da1b-86b8-4403-ab5c-57204b6db9cc None admin] PATH_INFO: `/v3/users/0893d699d42f44d4abebc512b77c89ea` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:13.689716 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472baa7-64ba-4652-bdc2-fbdd9196c67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:13.690588 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472baa7-64ba-4652-bdc2-fbdd9196c67d None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:13.690863 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472baa7-64ba-4652-bdc2-fbdd9196c67d None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:13.691424 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472baa7-64ba-4652-bdc2-fbdd9196c67d None admin] PATH_INFO: `/v3/users/0893d699d42f44d4abebc512b77c89ea` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:13.695164 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d6da1b-86b8-4403-ab5c-57204b6db9cc None admin] RBAC: Authorizing `identity:get_user(user_id=0893d699d42f44d4abebc512b77c89ea)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:13.696638 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d6da1b-86b8-4403-ab5c-57204b6db9cc None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:13.698588 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 100/200] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Jul 2 03:16:13 2022] GET /identity/v3/users/0893d699d42f44d4abebc512b77c89ea => generated 283 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:13.699267 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d6da1b-86b8-4403-ab5c-57204b6db9cc None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:13.708995 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7472baa7-64ba-4652-bdc2-fbdd9196c67d None admin] RBAC: Authorizing `identity:get_user(user_id=0893d699d42f44d4abebc512b77c89ea)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:13.711513 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7472baa7-64ba-4652-bdc2-fbdd9196c67d None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:13.714906 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 101/201] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Jul 2 03:16:13 2022] GET /identity/v3/users/0893d699d42f44d4abebc512b77c89ea => generated 283 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:13.716046 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472baa7-64ba-4652-bdc2-fbdd9196c67d None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:13.747752 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:13.774973 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:13.822500 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d6da1b-86b8-4403-ab5c-57204b6db9cc None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:13.858304 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472baa7-64ba-4652-bdc2-fbdd9196c67d None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:13.871472 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824d0d5d-0e50-4051-b08b-f6de4d3a68e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:13.872138 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d0d5d-0e50-4051-b08b-f6de4d3a68e7 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:13.872421 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d0d5d-0e50-4051-b08b-f6de4d3a68e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:13.872699 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d0d5d-0e50-4051-b08b-f6de4d3a68e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:13.873916 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824d0d5d-0e50-4051-b08b-f6de4d3a68e7 None admin] RBAC: Adding query filter params (role.id=e7cdb23960ca4be7a9cd4c7685029db0, scope.project.id=73025fb6edfa43b88c0c690d55906c19, user.id=750caf97b9a44ca782e182ac8b7d3fce) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:13.874368 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824d0d5d-0e50-4051-b08b-f6de4d3a68e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:13.876046 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824d0d5d-0e50-4051-b08b-f6de4d3a68e7 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:13.883932 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 101/202] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Jul 2 03:16:13 2022] GET /identity/v3/role_assignments?user.id=750caf97b9a44ca782e182ac8b7d3fce&scope.project.id=73025fb6edfa43b88c0c690d55906c19&role.id=e7cdb23960ca4be7a9cd4c7685029db0 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:13.884715 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824d0d5d-0e50-4051-b08b-f6de4d3a68e7 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:13.904182 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbf4c97-4b95-4e6b-8e41-c22b7f29f6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:13.905544 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf4c97-4b95-4e6b-8e41-c22b7f29f6d7 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:13.906462 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf4c97-4b95-4e6b-8e41-c22b7f29f6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:13.907210 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf4c97-4b95-4e6b-8e41-c22b7f29f6d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:14.029144 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbf4c97-4b95-4e6b-8e41-c22b7f29f6d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:14.031527 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbf4c97-4b95-4e6b-8e41-c22b7f29f6d7 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:14.057913 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824d0d5d-0e50-4051-b08b-f6de4d3a68e7 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:14.084330 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:14.113290 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:14.127702 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb3844-417a-42ce-898d-8ec7949916cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:14.128363 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb3844-417a-42ce-898d-8ec7949916cc None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:14.128641 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb3844-417a-42ce-898d-8ec7949916cc None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:14.128914 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb3844-417a-42ce-898d-8ec7949916cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:14.185045 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 102/203] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Jul 2 03:16:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 03:16:14.190835 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbf4c97-4b95-4e6b-8e41-c22b7f29f6d7 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:14.218707 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fb3844-417a-42ce-898d-8ec7949916cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:14.220702 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fb3844-417a-42ce-898d-8ec7949916cc None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:14.322575 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbf4c97-4b95-4e6b-8e41-c22b7f29f6d7 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:14.345092 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 102/204] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Jul 2 03:16:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 03:16:14.350468 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:14.351160 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb3844-417a-42ce-898d-8ec7949916cc None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:14.362919 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc02601-7665-4833-9729-8d2736579cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:14.363838 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc02601-7665-4833-9729-8d2736579cd7 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:14.364113 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc02601-7665-4833-9729-8d2736579cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:14.364384 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc02601-7665-4833-9729-8d2736579cd7 None admin] PATH_INFO: `/v3/projects/d260f7a9c3984a7d8d4d7f5aa78dcc78` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:14.365647 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc02601-7665-4833-9729-8d2736579cd7 None admin] RBAC: Authorizing `identity:get_project(project_id=d260f7a9c3984a7d8d4d7f5aa78dcc78)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:14.370170 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc02601-7665-4833-9729-8d2736579cd7 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:14.370170 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 103/205] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Jul 2 03:16:14 2022] GET /identity/v3/projects/d260f7a9c3984a7d8d4d7f5aa78dcc78 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:14.374816 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc02601-7665-4833-9729-8d2736579cd7 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:14.386100 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:14.462687 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb3844-417a-42ce-898d-8ec7949916cc None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:14.487778 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc02601-7665-4833-9729-8d2736579cd7 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:14.497174 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8577b8-af5b-4549-a137-e8b682b8d853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:14.498298 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8577b8-af5b-4549-a137-e8b682b8d853 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:14.498724 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8577b8-af5b-4549-a137-e8b682b8d853 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:14.499186 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8577b8-af5b-4549-a137-e8b682b8d853 None admin] PATH_INFO: `/v3/projects/d260f7a9c3984a7d8d4d7f5aa78dcc78` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:14.500564 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8577b8-af5b-4549-a137-e8b682b8d853 None admin] RBAC: Authorizing `identity:get_project(project_id=d260f7a9c3984a7d8d4d7f5aa78dcc78)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:14.502151 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8577b8-af5b-4549-a137-e8b682b8d853 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:14.504343 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 103/206] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Jul 2 03:16:14 2022] GET /identity/v3/projects/d260f7a9c3984a7d8d4d7f5aa78dcc78 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:16:14.510245 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8577b8-af5b-4549-a137-e8b682b8d853 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:14.530325 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3817b87-d20b-4d40-8c0e-7163059d623e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:14.531242 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3817b87-d20b-4d40-8c0e-7163059d623e None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:14.531668 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3817b87-d20b-4d40-8c0e-7163059d623e None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:14.532080 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3817b87-d20b-4d40-8c0e-7163059d623e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:14.533576 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3817b87-d20b-4d40-8c0e-7163059d623e None admin] RBAC: Adding query filter params (role.id=5dcd130cda6c490595e862dc2348e83d, scope.project.id=d260f7a9c3984a7d8d4d7f5aa78dcc78, user.id=0893d699d42f44d4abebc512b77c89ea) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:14.534280 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3817b87-d20b-4d40-8c0e-7163059d623e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:14.536574 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3817b87-d20b-4d40-8c0e-7163059d623e None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:14.544971 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 104/207] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Jul 2 03:16:14 2022] GET /identity/v3/role_assignments?user.id=0893d699d42f44d4abebc512b77c89ea&scope.project.id=d260f7a9c3984a7d8d4d7f5aa78dcc78&role.id=5dcd130cda6c490595e862dc2348e83d => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:16:14.618856 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:14.625364 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8577b8-af5b-4549-a137-e8b682b8d853 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:14.663672 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5eebe2-6bb3-4a95-96c2-3f95c8811288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:14.664354 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5eebe2-6bb3-4a95-96c2-3f95c8811288 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:14.664614 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5eebe2-6bb3-4a95-96c2-3f95c8811288 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:14.664892 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5eebe2-6bb3-4a95-96c2-3f95c8811288 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:14.665750 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5eebe2-6bb3-4a95-96c2-3f95c8811288 None admin] RBAC: Adding query filter params (role.id=a9792a930e0c4e139f287a712dfc7d4d, scope.project.id=d260f7a9c3984a7d8d4d7f5aa78dcc78, user.id=0893d699d42f44d4abebc512b77c89ea) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:14.666065 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5eebe2-6bb3-4a95-96c2-3f95c8811288 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:14.667904 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5eebe2-6bb3-4a95-96c2-3f95c8811288 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:14.674511 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 104/208] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Jul 2 03:16:14 2022] GET /identity/v3/role_assignments?user.id=0893d699d42f44d4abebc512b77c89ea&scope.project.id=d260f7a9c3984a7d8d4d7f5aa78dcc78&role.id=a9792a930e0c4e139f287a712dfc7d4d => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:16:15.559185 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c70756-4f69-4d2e-a867-78f073c48ad4 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:15.560135 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c70756-4f69-4d2e-a867-78f073c48ad4 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:15.560631 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c70756-4f69-4d2e-a867-78f073c48ad4 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:15.562430 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 105/209] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:16:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:16:15.568064 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793dd2e-f312-4a8e-b10f-ef48f82a3636 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:15.568605 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793dd2e-f312-4a8e-b10f-ef48f82a3636 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:15.569089 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793dd2e-f312-4a8e-b10f-ef48f82a3636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:15.586288 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-d793dd2e-f312-4a8e-b10f-ef48f82a3636 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:16:15.587818 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d793dd2e-f312-4a8e-b10f-ef48f82a3636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:16:15.658170 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 105/210] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:16:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 03:16:15.682274 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c70756-4f69-4d2e-a867-78f073c48ad4 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:15.726858 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c810c-04b4-42a1-b716-c8e664cef06a None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:15.727407 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c810c-04b4-42a1-b716-c8e664cef06a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:15.727407 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c810c-04b4-42a1-b716-c8e664cef06a None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:15.728971 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 106/211] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:16:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:16:15.734073 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afdeccb-a0d0-4380-b26f-90ef09c02cf4 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:15.734360 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afdeccb-a0d0-4380-b26f-90ef09c02cf4 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:15.734640 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afdeccb-a0d0-4380-b26f-90ef09c02cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:15.744604 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:15.754545 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-4afdeccb-a0d0-4380-b26f-90ef09c02cf4 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:16:15.755866 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4afdeccb-a0d0-4380-b26f-90ef09c02cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:16:15.791145 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c70756-4f69-4d2e-a867-78f073c48ad4 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:15.831208 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 107/212] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:16:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 02 03:16:15.836021 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4c89cc-7ff3-417d-a42f-ce26e3f80451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:15.837062 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c89cc-7ff3-417d-a42f-ce26e3f80451 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:15.837537 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c89cc-7ff3-417d-a42f-ce26e3f80451 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:15.838002 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c89cc-7ff3-417d-a42f-ce26e3f80451 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:15.849110 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4c89cc-7ff3-417d-a42f-ce26e3f80451 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:16:15.852264 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afdeccb-a0d0-4380-b26f-90ef09c02cf4 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:15.860439 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-4c4c89cc-7ff3-417d-a42f-ce26e3f80451 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 02 03:16:15.860439 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:15.860439 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:15.860439 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:15.860439 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:15.860439 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:15.860439 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:15.860439 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:15.860439 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:15.860439 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:15.860439 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:15.860439 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:15.860439 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:16:15.860439 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:16:15.860439 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:16:15.860439 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:16:15.861305 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:16:15.861305 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:16:15.861305 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:16:15.861305 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:16:15.861305 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:15.861305 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:15.861305 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:15.861305 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:15.861305 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:15.861305 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:15.861305 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:15.861305 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:15.861305 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:15.861305 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:15.861305 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:15.861305 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:15.862100 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:15.862100 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:15.862100 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:15.862100 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:15.862100 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:16:15.862100 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:16:15.862100 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:16:15.862100 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:16:15.862100 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:16:15.862100 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:16:15.862100 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 02 03:16:15.862100 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:16:15.862100 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 106/213] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Jul 2 03:16:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:16:15.871174 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4c89cc-7ff3-417d-a42f-ce26e3f80451 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:15.882490 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:15.977661 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afdeccb-a0d0-4380-b26f-90ef09c02cf4 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:15.978004 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4c89cc-7ff3-417d-a42f-ce26e3f80451 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:15.992459 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:16.013629 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ed3fe-c6cb-4f48-93e0-893e9e7ed31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:16.014570 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ed3fe-c6cb-4f48-93e0-893e9e7ed31e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:16.014951 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ed3fe-c6cb-4f48-93e0-893e9e7ed31e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:16.015326 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f711469-cb55-4b8e-8673-4649e5bc19ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:16.015467 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ed3fe-c6cb-4f48-93e0-893e9e7ed31e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:16.016350 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f711469-cb55-4b8e-8673-4649e5bc19ea None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:16.016775 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f711469-cb55-4b8e-8673-4649e5bc19ea None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:16.016903 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418ed3fe-c6cb-4f48-93e0-893e9e7ed31e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:16.017301 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f711469-cb55-4b8e-8673-4649e5bc19ea None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:16.018193 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f711469-cb55-4b8e-8673-4649e5bc19ea None admin] RBAC: Adding query filter params (name=member) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:16.018636 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f711469-cb55-4b8e-8673-4649e5bc19ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:16.018761 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418ed3fe-c6cb-4f48-93e0-893e9e7ed31e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:16.020324 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f711469-cb55-4b8e-8673-4649e5bc19ea None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:16.020909 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 108/214] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:16:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:16:16.025861 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ed3fe-c6cb-4f48-93e0-893e9e7ed31e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:16.029838 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 107/215] 10.222.0.60 () {56 vars in 1101 bytes} [Sat Jul 2 03:16:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:16.035944 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f711469-cb55-4b8e-8673-4649e5bc19ea None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:16.123896 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:16.138616 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ed3fe-c6cb-4f48-93e0-893e9e7ed31e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:16.166158 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f711469-cb55-4b8e-8673-4649e5bc19ea None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:16.177527 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b52a616-afca-42ac-bc0b-401df904d4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:16.178889 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52a616-afca-42ac-bc0b-401df904d4a2 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:16.179750 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52a616-afca-42ac-bc0b-401df904d4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:16.180179 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52a616-afca-42ac-bc0b-401df904d4a2 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:16.181334 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b52a616-afca-42ac-bc0b-401df904d4a2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:16.183658 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b52a616-afca-42ac-bc0b-401df904d4a2 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:16.207817 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb3f875-a7a7-4498-8e4a-66813ae8166d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:16.208980 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3f875-a7a7-4498-8e4a-66813ae8166d None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:16.209361 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3f875-a7a7-4498-8e4a-66813ae8166d None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:16.209803 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3f875-a7a7-4498-8e4a-66813ae8166d None admin] PATH_INFO: `/v3/users/c22eef11685c47b3a41da1d9ca89ece9` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:16.210192 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 109/216] 10.222.0.60 () {60 vars in 1132 bytes} [Sat Jul 2 03:16:16 2022] POST /identity/v3/users => generated 297 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 03:16:16.231185 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb3f875-a7a7-4498-8e4a-66813ae8166d None admin] RBAC: Authorizing `identity:get_user(user_id=c22eef11685c47b3a41da1d9ca89ece9)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:16.233295 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb3f875-a7a7-4498-8e4a-66813ae8166d None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:16.236101 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 108/217] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Jul 2 03:16:16 2022] GET /identity/v3/users/c22eef11685c47b3a41da1d9ca89ece9 => generated 297 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:16:16.244595 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b52a616-afca-42ac-bc0b-401df904d4a2 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:16.362445 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b52a616-afca-42ac-bc0b-401df904d4a2 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:16.398023 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b048ff-de1d-43bf-b043-33deeca10b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:16.398688 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b048ff-de1d-43bf-b043-33deeca10b78 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:16.398977 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b048ff-de1d-43bf-b043-33deeca10b78 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:16.399284 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b048ff-de1d-43bf-b043-33deeca10b78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:16.415996 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:16.471610 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b048ff-de1d-43bf-b043-33deeca10b78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:16.473097 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b048ff-de1d-43bf-b043-33deeca10b78 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:16.577175 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 110/218] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Jul 2 03:16:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 03:16:16.582817 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb3f875-a7a7-4498-8e4a-66813ae8166d None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:16.588638 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df1e5f1-4d72-4547-b66d-329c6da85a17 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:16.589451 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df1e5f1-4d72-4547-b66d-329c6da85a17 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:16.590214 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df1e5f1-4d72-4547-b66d-329c6da85a17 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:16.592546 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 111/219] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:16:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:16:16.601068 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7764d5de-527d-4f16-88fa-43bd185e3299 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:16.601627 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7764d5de-527d-4f16-88fa-43bd185e3299 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:16.602102 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7764d5de-527d-4f16-88fa-43bd185e3299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:16.624717 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-7764d5de-527d-4f16-88fa-43bd185e3299 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:16:16.625194 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:16.626721 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7764d5de-527d-4f16-88fa-43bd185e3299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:16:16.675716 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:16.705910 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb3f875-a7a7-4498-8e4a-66813ae8166d None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:16.713557 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 112/220] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:16:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 03:16:16.765257 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da4f222-05af-4321-89a3-1a878c28341b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:16.766522 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da4f222-05af-4321-89a3-1a878c28341b None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:16.767008 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da4f222-05af-4321-89a3-1a878c28341b None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:16.767490 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da4f222-05af-4321-89a3-1a878c28341b None admin] PATH_INFO: `/v3/projects/d260f7a9c3984a7d8d4d7f5aa78dcc78` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:16.770228 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7764d5de-527d-4f16-88fa-43bd185e3299 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:16.774410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da4f222-05af-4321-89a3-1a878c28341b None admin] RBAC: Authorizing `identity:get_project(project_id=d260f7a9c3984a7d8d4d7f5aa78dcc78)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:16.780764 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da4f222-05af-4321-89a3-1a878c28341b None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:16.784935 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 109/221] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Jul 2 03:16:16 2022] GET /identity/v3/projects/d260f7a9c3984a7d8d4d7f5aa78dcc78 => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:16.786465 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ecd884-51be-4a9f-ad6e-cff20f2a80ad None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:16.786936 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ecd884-51be-4a9f-ad6e-cff20f2a80ad None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:16.787431 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ecd884-51be-4a9f-ad6e-cff20f2a80ad None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:16.789075 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 110/222] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:16:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:16:16.790635 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ecd884-51be-4a9f-ad6e-cff20f2a80ad None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:16.886435 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7764d5de-527d-4f16-88fa-43bd185e3299 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:16.923941 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ecd884-51be-4a9f-ad6e-cff20f2a80ad None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:16.924379 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85c769f-6089-4e47-b06d-482db859f502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:16.925494 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:16.925865 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c769f-6089-4e47-b06d-482db859f502 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:16.927071 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c769f-6089-4e47-b06d-482db859f502 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:16.927566 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c769f-6089-4e47-b06d-482db859f502 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:16.945976 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85c769f-6089-4e47-b06d-482db859f502 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:16:16.957517 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-a85c769f-6089-4e47-b06d-482db859f502 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 03:16:16.957517 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:16.957517 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:16.957517 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:16.957517 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:16.957517 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:16.957517 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:16.957517 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:16.957517 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:16.957517 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:16.957517 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:16.957517 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:16.957517 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:16:16.957517 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:16:16.957517 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:16:16.957517 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:16:16.958576 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:16:16.958576 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:16:16.958576 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:16:16.958576 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:16:16.958576 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:16.958576 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:16.958576 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:16.958576 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:16.958576 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:16.958576 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:16.958576 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:16.958576 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:16.958576 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:16.958576 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:16.958576 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:16.958576 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:16.959505 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:16.959505 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:16.959505 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:16.959505 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:16.959505 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:16:16.959505 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:16:16.959505 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:16:16.959505 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:16:16.959505 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:16:16.959505 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:16:16.959505 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 03:16:16.959505 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:16:16.960471 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 113/223] 10.222.0.60 () {56 vars in 1096 bytes} [Sat Jul 2 03:16:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:16:16.961705 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d54437-eb52-41cd-99d9-f1d17468691e None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:16.961991 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d54437-eb52-41cd-99d9-f1d17468691e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:16.962269 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d54437-eb52-41cd-99d9-f1d17468691e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:16.967654 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f151e6-8866-4c5c-b55a-68604e9afd41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:16.968609 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f151e6-8866-4c5c-b55a-68604e9afd41 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:16.969090 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f151e6-8866-4c5c-b55a-68604e9afd41 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:16.969558 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f151e6-8866-4c5c-b55a-68604e9afd41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:16.970701 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f151e6-8866-4c5c-b55a-68604e9afd41 None admin] RBAC: Adding query filter params (role.id=c43aada0326446c4ade0ab1262918fa4, scope.project.id=d260f7a9c3984a7d8d4d7f5aa78dcc78, user.id=c22eef11685c47b3a41da1d9ca89ece9) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:16.971297 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f151e6-8866-4c5c-b55a-68604e9afd41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:16.973024 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f151e6-8866-4c5c-b55a-68604e9afd41 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:16.979804 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-a2d54437-eb52-41cd-99d9-f1d17468691e None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:16:16.980293 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 111/224] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Jul 2 03:16:16 2022] GET /identity/v3/role_assignments?user.id=c22eef11685c47b3a41da1d9ca89ece9&scope.project.id=d260f7a9c3984a7d8d4d7f5aa78dcc78&role.id=c43aada0326446c4ade0ab1262918fa4 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:16:16.981311 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f151e6-8866-4c5c-b55a-68604e9afd41 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:16.981614 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a2d54437-eb52-41cd-99d9-f1d17468691e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:16:17.033534 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:17.102391 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f151e6-8866-4c5c-b55a-68604e9afd41 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:17.141837 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 114/225] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:16:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 03:16:17.143420 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2908d62-4d3f-4e38-8f34-856795518e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:17.144342 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2908d62-4d3f-4e38-8f34-856795518e22 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:17.144821 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2908d62-4d3f-4e38-8f34-856795518e22 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:17.145291 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2908d62-4d3f-4e38-8f34-856795518e22 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:17.146249 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2908d62-4d3f-4e38-8f34-856795518e22 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:17.146766 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2908d62-4d3f-4e38-8f34-856795518e22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:17.148465 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2908d62-4d3f-4e38-8f34-856795518e22 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:17.158440 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 112/226] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Jul 2 03:16:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:17.164228 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d54437-eb52-41cd-99d9-f1d17468691e None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:17.164588 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2908d62-4d3f-4e38-8f34-856795518e22 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:17.218912 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:17.339069 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d54437-eb52-41cd-99d9-f1d17468691e None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:17.359593 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2908d62-4d3f-4e38-8f34-856795518e22 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:17.403312 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e991f7ff-91b5-417d-a216-979c184e9ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:17.404186 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991f7ff-91b5-417d-a216-979c184e9ef3 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:17.404465 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991f7ff-91b5-417d-a216-979c184e9ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:17.404740 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991f7ff-91b5-417d-a216-979c184e9ef3 None admin] PATH_INFO: `/v3/users/0893d699d42f44d4abebc512b77c89ea` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:17.406544 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e991f7ff-91b5-417d-a216-979c184e9ef3 None admin] RBAC: Authorizing `identity:get_user(user_id=0893d699d42f44d4abebc512b77c89ea)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:17.408261 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e991f7ff-91b5-417d-a216-979c184e9ef3 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:17.409920 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 115/227] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Jul 2 03:16:17 2022] GET /identity/v3/users/0893d699d42f44d4abebc512b77c89ea => generated 283 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:17.416045 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e991f7ff-91b5-417d-a216-979c184e9ef3 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:17.432560 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0434cc-ae98-44f0-8540-0f87199f25bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:17.433365 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0434cc-ae98-44f0-8540-0f87199f25bf None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:17.433639 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0434cc-ae98-44f0-8540-0f87199f25bf None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:17.433908 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0434cc-ae98-44f0-8540-0f87199f25bf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:17.453133 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0434cc-ae98-44f0-8540-0f87199f25bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:16:17.461299 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-4c0434cc-ae98-44f0-8540-0f87199f25bf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 02 03:16:17.461299 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:17.461299 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:17.461299 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:17.461299 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:17.461299 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:17.461299 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:17.461299 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:17.461299 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:17.461299 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:17.461299 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:17.461299 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:17.461299 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:16:17.461299 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:16:17.461299 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:16:17.461299 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:16:17.462161 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:16:17.462161 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:16:17.462161 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:16:17.462161 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:16:17.462161 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:17.462161 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:17.462161 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:17.462161 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:17.462161 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:17.462161 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:17.462161 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:17.462161 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:17.462161 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:17.462161 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:17.462161 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:17.462161 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:17.463361 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:17.463361 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:17.463361 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:17.463361 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:17.463361 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:16:17.463361 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:16:17.463361 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:16:17.463361 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:16:17.463361 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:16:17.463361 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:16:17.463361 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 02 03:16:17.463361 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:16:17.463361 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 113/228] 10.222.0.60 () {56 vars in 1114 bytes} [Sat Jul 2 03:16:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:16:17.469870 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0434cc-ae98-44f0-8540-0f87199f25bf None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:17.473715 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:17.593559 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e991f7ff-91b5-417d-a216-979c184e9ef3 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:17.627937 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:17.649663 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0434cc-ae98-44f0-8540-0f87199f25bf None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:17.660953 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f46bce-4170-437d-afcc-f404d7db6f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:17.661757 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f46bce-4170-437d-afcc-f404d7db6f02 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:17.662026 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f46bce-4170-437d-afcc-f404d7db6f02 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:17.662293 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f46bce-4170-437d-afcc-f404d7db6f02 None admin] PATH_INFO: `/v3/projects/d260f7a9c3984a7d8d4d7f5aa78dcc78` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:17.663519 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f46bce-4170-437d-afcc-f404d7db6f02 None admin] RBAC: Authorizing `identity:get_project(project_id=d260f7a9c3984a7d8d4d7f5aa78dcc78)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:17.665169 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f46bce-4170-437d-afcc-f404d7db6f02 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:17.667248 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 116/229] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Jul 2 03:16:17 2022] GET /identity/v3/projects/d260f7a9c3984a7d8d4d7f5aa78dcc78 => generated 302 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:17.675687 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f46bce-4170-437d-afcc-f404d7db6f02 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:17.718223 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a03597-d5f5-449c-b481-0e4b148d880c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:17.720017 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a03597-d5f5-449c-b481-0e4b148d880c None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:17.725107 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a03597-d5f5-449c-b481-0e4b148d880c None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:17.725605 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a03597-d5f5-449c-b481-0e4b148d880c None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:17.726541 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a03597-d5f5-449c-b481-0e4b148d880c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:17.727013 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a03597-d5f5-449c-b481-0e4b148d880c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:17.728578 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a03597-d5f5-449c-b481-0e4b148d880c None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:17.738894 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 114/230] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Jul 2 03:16:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:17.747479 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a03597-d5f5-449c-b481-0e4b148d880c None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:17.848715 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:17.852365 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f46bce-4170-437d-afcc-f404d7db6f02 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:17.908737 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a03597-d5f5-449c-b481-0e4b148d880c None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:17.947597 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b9747a-51eb-4814-b97d-7ec6dcba9856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:17.949027 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9747a-51eb-4814-b97d-7ec6dcba9856 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:17.950450 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c885b64-f5f8-4f8b-b119-abf8e805a9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:17.951603 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c885b64-f5f8-4f8b-b119-abf8e805a9a2 None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:17.952071 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9747a-51eb-4814-b97d-7ec6dcba9856 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:17.952530 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9747a-51eb-4814-b97d-7ec6dcba9856 None admin] PATH_INFO: `/v3/users/0893d699d42f44d4abebc512b77c89ea` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:17.953539 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c885b64-f5f8-4f8b-b119-abf8e805a9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:17.954341 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b9747a-51eb-4814-b97d-7ec6dcba9856 None admin] RBAC: Authorizing `identity:get_user(user_id=0893d699d42f44d4abebc512b77c89ea)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:17.954825 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c885b64-f5f8-4f8b-b119-abf8e805a9a2 None admin] PATH_INFO: `/v3/projects/d260f7a9c3984a7d8d4d7f5aa78dcc78/users/0893d699d42f44d4abebc512b77c89ea/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:17.958422 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c885b64-f5f8-4f8b-b119-abf8e805a9a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=d260f7a9c3984a7d8d4d7f5aa78dcc78, user_id=0893d699d42f44d4abebc512b77c89ea, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:17.958787 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b9747a-51eb-4814-b97d-7ec6dcba9856 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:17.960723 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 115/231] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Jul 2 03:16:17 2022] GET /identity/v3/users/0893d699d42f44d4abebc512b77c89ea => generated 283 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:16:17.962389 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c885b64-f5f8-4f8b-b119-abf8e805a9a2 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:17.966438 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b9747a-51eb-4814-b97d-7ec6dcba9856 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:17.988221 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 117/232] 10.222.0.60 () {58 vars in 1439 bytes} [Sat Jul 2 03:16:17 2022] PUT /identity/v3/projects/d260f7a9c3984a7d8d4d7f5aa78dcc78/users/0893d699d42f44d4abebc512b77c89ea/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 03:16:18.016954 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:18.143658 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b9747a-51eb-4814-b97d-7ec6dcba9856 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:18.198167 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5170f96-3e4f-4f67-a9e8-3f8c18ee647a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:18.198962 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5170f96-3e4f-4f67-a9e8-3f8c18ee647a None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:18.199274 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5170f96-3e4f-4f67-a9e8-3f8c18ee647a None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:18.199551 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5170f96-3e4f-4f67-a9e8-3f8c18ee647a None admin] PATH_INFO: `/v3/projects/d260f7a9c3984a7d8d4d7f5aa78dcc78` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:18.200811 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5170f96-3e4f-4f67-a9e8-3f8c18ee647a None admin] RBAC: Authorizing `identity:get_project(project_id=d260f7a9c3984a7d8d4d7f5aa78dcc78)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:18.202317 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5170f96-3e4f-4f67-a9e8-3f8c18ee647a None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:18.204447 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 116/233] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Jul 2 03:16:17 2022] GET /identity/v3/projects/d260f7a9c3984a7d8d4d7f5aa78dcc78 => generated 302 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:18.210199 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c885b64-f5f8-4f8b-b119-abf8e805a9a2 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:18.322131 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c885b64-f5f8-4f8b-b119-abf8e805a9a2 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:18.357175 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1876f7ab-2e19-4541-b53f-7dbbaa1f2efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:18.358107 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876f7ab-2e19-4541-b53f-7dbbaa1f2efd None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:18.358389 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876f7ab-2e19-4541-b53f-7dbbaa1f2efd None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:18.358662 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876f7ab-2e19-4541-b53f-7dbbaa1f2efd None admin] PATH_INFO: `/v3/projects/d260f7a9c3984a7d8d4d7f5aa78dcc78/users/0893d699d42f44d4abebc512b77c89ea/roles/a9792a930e0c4e139f287a712dfc7d4d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:18.360997 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1876f7ab-2e19-4541-b53f-7dbbaa1f2efd None admin] RBAC: Authorizing `identity:create_grant(project_id=d260f7a9c3984a7d8d4d7f5aa78dcc78, user_id=0893d699d42f44d4abebc512b77c89ea, role_id=a9792a930e0c4e139f287a712dfc7d4d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:18.362463 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1876f7ab-2e19-4541-b53f-7dbbaa1f2efd None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:18.385658 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 118/234] 10.222.0.60 () {58 vars in 1439 bytes} [Sat Jul 2 03:16:18 2022] PUT /identity/v3/projects/d260f7a9c3984a7d8d4d7f5aa78dcc78/users/0893d699d42f44d4abebc512b77c89ea/roles/a9792a930e0c4e139f287a712dfc7d4d => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:16:18.700240 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45311ca2-e5f0-4d37-b8f1-610839935e04 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:18.700761 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45311ca2-e5f0-4d37-b8f1-610839935e04 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:18.700761 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45311ca2-e5f0-4d37-b8f1-610839935e04 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:18.702227 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 117/235] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:16:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:16:18.707703 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ea6a7-2ed7-4c69-9319-d9650535febd None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:18.707988 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ea6a7-2ed7-4c69-9319-d9650535febd None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:18.708263 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ea6a7-2ed7-4c69-9319-d9650535febd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:18.726245 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-2c9ea6a7-2ed7-4c69-9319-d9650535febd None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:16:18.727546 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2c9ea6a7-2ed7-4c69-9319-d9650535febd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:16:18.742594 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:18.771852 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3db941-2448-4419-a51f-789982c83ef2 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:18.772180 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3db941-2448-4419-a51f-789982c83ef2 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:18.772915 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3db941-2448-4419-a51f-789982c83ef2 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:18.774312 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 118/236] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:16:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:16:18.779628 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e866d-917f-45be-818c-b40a751b987c None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:18.779908 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e866d-917f-45be-818c-b40a751b987c None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:18.780182 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e866d-917f-45be-818c-b40a751b987c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:18.799911 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-f85e866d-917f-45be-818c-b40a751b987c None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:16:18.801100 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-f85e866d-917f-45be-818c-b40a751b987c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:16:18.806482 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 119/237] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:16:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 03:16:18.832667 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ea6a7-2ed7-4c69-9319-d9650535febd None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:18.933526 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ea6a7-2ed7-4c69-9319-d9650535febd None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:18.941430 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 119/238] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:16:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 02 03:16:18.971066 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c786246f-64a4-49dc-9008-2b94796e7b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:18.971810 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786246f-64a4-49dc-9008-2b94796e7b14 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:18.972087 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786246f-64a4-49dc-9008-2b94796e7b14 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:18.972355 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786246f-64a4-49dc-9008-2b94796e7b14 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:18.973540 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c786246f-64a4-49dc-9008-2b94796e7b14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:18.975132 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c786246f-64a4-49dc-9008-2b94796e7b14 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:18.975249 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85e866d-917f-45be-818c-b40a751b987c None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:18.977185 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 120/239] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:16:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:18.984428 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c786246f-64a4-49dc-9008-2b94796e7b14 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:19.011721 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:19.023472 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:19.153734 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85e866d-917f-45be-818c-b40a751b987c None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:19.165100 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c786246f-64a4-49dc-9008-2b94796e7b14 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:19.202577 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c53c653-2632-4506-8918-64df122547bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:19.203451 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c53c653-2632-4506-8918-64df122547bd None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:19.204117 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c53c653-2632-4506-8918-64df122547bd None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:19.204399 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c53c653-2632-4506-8918-64df122547bd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:19.215898 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c53c653-2632-4506-8918-64df122547bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:16:19.224449 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-2c53c653-2632-4506-8918-64df122547bd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 02 03:16:19.224449 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:19.224449 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:19.224449 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:19.224449 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:19.224449 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:19.224449 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:19.224449 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:19.224449 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:19.224449 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:19.224449 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:19.224449 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:19.224449 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:16:19.224449 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:16:19.224449 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:16:19.224449 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:16:19.225315 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:16:19.225315 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:16:19.225315 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:16:19.225315 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:16:19.225315 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:19.225315 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:19.225315 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:19.225315 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:19.225315 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:19.225315 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:19.225315 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:19.225315 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:19.225315 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:19.225315 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:19.225315 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:19.225315 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:19.226106 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:19.226106 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:19.226106 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:19.226106 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:19.226106 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:16:19.226106 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:16:19.226106 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:16:19.226106 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:16:19.226106 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:16:19.226106 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:16:19.226106 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 02 03:16:19.226106 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:16:19.226106 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 120/240] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Jul 2 03:16:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:16:19.231614 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c53c653-2632-4506-8918-64df122547bd None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:19.272406 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47750bfb-b373-4e7a-9bf7-278a284456a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:19.273089 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47750bfb-b373-4e7a-9bf7-278a284456a1 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:19.273369 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47750bfb-b373-4e7a-9bf7-278a284456a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:19.273638 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47750bfb-b373-4e7a-9bf7-278a284456a1 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:19.274357 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47750bfb-b373-4e7a-9bf7-278a284456a1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:19.275835 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47750bfb-b373-4e7a-9bf7-278a284456a1 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:19.309242 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 121/241] 10.222.0.60 () {60 vars in 1132 bytes} [Sat Jul 2 03:16:18 2022] POST /identity/v3/users => generated 293 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:16:19.336512 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:19.363159 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c53c653-2632-4506-8918-64df122547bd None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:19.367833 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215bf226-1daa-4f82-8bb5-0af5694a0cc2 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:19.368433 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215bf226-1daa-4f82-8bb5-0af5694a0cc2 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:19.368902 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215bf226-1daa-4f82-8bb5-0af5694a0cc2 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:19.370773 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 122/242] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:16:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 03:16:19.377160 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2d73f-509c-474a-aaa8-e3baebb7a52f None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:19.378092 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2d73f-509c-474a-aaa8-e3baebb7a52f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:19.378645 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2d73f-509c-474a-aaa8-e3baebb7a52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:19.399320 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-4ed2d73f-509c-474a-aaa8-e3baebb7a52f None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:16:19.401151 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4ed2d73f-509c-474a-aaa8-e3baebb7a52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:16:19.416290 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b042f9-99cf-4488-9ae6-2a3639326adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:19.417729 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b042f9-99cf-4488-9ae6-2a3639326adf None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:19.418205 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b042f9-99cf-4488-9ae6-2a3639326adf None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:19.418671 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b042f9-99cf-4488-9ae6-2a3639326adf None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:19.419754 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b042f9-99cf-4488-9ae6-2a3639326adf None admin] RBAC: Adding query filter params (name=reader) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:19.420474 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b042f9-99cf-4488-9ae6-2a3639326adf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:19.424271 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b042f9-99cf-4488-9ae6-2a3639326adf None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:19.442731 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 121/243] 10.222.0.60 () {56 vars in 1101 bytes} [Sat Jul 2 03:16:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:19.452313 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b042f9-99cf-4488-9ae6-2a3639326adf None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:19.549428 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 123/244] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:16:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 03:16:19.572239 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed2d73f-509c-474a-aaa8-e3baebb7a52f None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:19.575839 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:19.616797 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b042f9-99cf-4488-9ae6-2a3639326adf None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:19.662313 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12bc834-0194-4aee-bb02-3654588814e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:19.663609 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12bc834-0194-4aee-bb02-3654588814e1 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:19.664236 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12bc834-0194-4aee-bb02-3654588814e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:19.664726 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12bc834-0194-4aee-bb02-3654588814e1 None admin] PATH_INFO: `/v3/users/8d729af1811d4baba13d254da1b7e04d` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:19.675183 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:19.683221 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12bc834-0194-4aee-bb02-3654588814e1 None admin] RBAC: Authorizing `identity:get_user(user_id=8d729af1811d4baba13d254da1b7e04d)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:19.684811 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12bc834-0194-4aee-bb02-3654588814e1 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:19.687726 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 122/245] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Jul 2 03:16:19 2022] GET /identity/v3/users/8d729af1811d4baba13d254da1b7e04d => generated 297 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:19.696943 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12bc834-0194-4aee-bb02-3654588814e1 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:19.711193 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed2d73f-509c-474a-aaa8-e3baebb7a52f None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:19.759234 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a875a92a-eb0a-48de-a9da-4e58392df3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:19.760034 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a875a92a-eb0a-48de-a9da-4e58392df3e1 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:19.760320 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a875a92a-eb0a-48de-a9da-4e58392df3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:19.760596 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a875a92a-eb0a-48de-a9da-4e58392df3e1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:19.772079 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a875a92a-eb0a-48de-a9da-4e58392df3e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:16:19.780294 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-a875a92a-eb0a-48de-a9da-4e58392df3e1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 02 03:16:19.780294 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:19.780294 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:19.780294 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:19.780294 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:19.780294 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:19.780294 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:19.780294 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:19.780294 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:19.780294 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:19.780294 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:19.780294 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:19.780294 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:16:19.780294 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:16:19.780294 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:16:19.780294 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:16:19.781266 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:16:19.781266 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:16:19.781266 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:16:19.781266 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:16:19.781266 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:19.781266 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:19.781266 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:19.781266 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:19.781266 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:19.781266 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:19.781266 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:19.781266 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:19.781266 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:19.781266 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:19.781266 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:19.781266 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:19.782353 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:19.782353 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:19.782353 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:19.782353 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:19.782353 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:16:19.782353 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:16:19.782353 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:16:19.782353 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:16:19.782353 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:16:19.782353 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:16:19.782353 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 02 03:16:19.782353 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:16:19.782353 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 124/246] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Jul 2 03:16:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 03:16:19.790221 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a875a92a-eb0a-48de-a9da-4e58392df3e1 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:19.837863 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12bc834-0194-4aee-bb02-3654588814e1 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:19.877533 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:19.883901 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac08118-6149-41e4-8c32-4fd4ed0305c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:19.884567 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac08118-6149-41e4-8c32-4fd4ed0305c2 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:19.884844 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac08118-6149-41e4-8c32-4fd4ed0305c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:19.885115 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac08118-6149-41e4-8c32-4fd4ed0305c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:19.921913 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a875a92a-eb0a-48de-a9da-4e58392df3e1 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:19.979684 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725d2289-e141-4af0-8575-660787ff83f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:19.981249 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d2289-e141-4af0-8575-660787ff83f7 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:19.981750 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d2289-e141-4af0-8575-660787ff83f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:19.982340 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d2289-e141-4af0-8575-660787ff83f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:19.983379 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725d2289-e141-4af0-8575-660787ff83f7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:19.983905 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725d2289-e141-4af0-8575-660787ff83f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:19.985560 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725d2289-e141-4af0-8575-660787ff83f7 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:19.986776 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:19.997982 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac08118-6149-41e4-8c32-4fd4ed0305c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:19.999732 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac08118-6149-41e4-8c32-4fd4ed0305c2 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:20.010143 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 125/247] 10.222.0.60 () {56 vars in 1101 bytes} [Sat Jul 2 03:16:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:16:20.029984 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725d2289-e141-4af0-8575-660787ff83f7 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:20.117751 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 123/248] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Jul 2 03:16:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 03:16:20.123044 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac08118-6149-41e4-8c32-4fd4ed0305c2 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:20.205602 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725d2289-e141-4af0-8575-660787ff83f7 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:20.257640 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:20.281424 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ef76d8-ecb3-4abb-9600-aa2a0c2bad1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:20.282309 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef76d8-ecb3-4abb-9600-aa2a0c2bad1d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:20.282588 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef76d8-ecb3-4abb-9600-aa2a0c2bad1d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:20.282861 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef76d8-ecb3-4abb-9600-aa2a0c2bad1d None admin] PATH_INFO: `/v3/users/c22eef11685c47b3a41da1d9ca89ece9` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:20.284225 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ef76d8-ecb3-4abb-9600-aa2a0c2bad1d None admin] RBAC: Authorizing `identity:get_user(user_id=c22eef11685c47b3a41da1d9ca89ece9)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:20.285677 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ef76d8-ecb3-4abb-9600-aa2a0c2bad1d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:20.287368 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 126/249] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Jul 2 03:16:20 2022] GET /identity/v3/users/c22eef11685c47b3a41da1d9ca89ece9 => generated 297 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:20.294273 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ef76d8-ecb3-4abb-9600-aa2a0c2bad1d None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:20.305574 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:20.317498 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac08118-6149-41e4-8c32-4fd4ed0305c2 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:20.380330 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977c43b1-b77a-4782-a9e3-32c25c81caaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:20.387820 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c43b1-b77a-4782-a9e3-32c25c81caaa None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:20.388115 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c43b1-b77a-4782-a9e3-32c25c81caaa None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:20.388443 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c43b1-b77a-4782-a9e3-32c25c81caaa None admin] PATH_INFO: `/v3/projects/d260f7a9c3984a7d8d4d7f5aa78dcc78` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:20.389760 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977c43b1-b77a-4782-a9e3-32c25c81caaa None admin] RBAC: Authorizing `identity:get_project(project_id=d260f7a9c3984a7d8d4d7f5aa78dcc78)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:20.391268 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977c43b1-b77a-4782-a9e3-32c25c81caaa None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:20.393314 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 124/250] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Jul 2 03:16:20 2022] GET /identity/v3/projects/d260f7a9c3984a7d8d4d7f5aa78dcc78 => generated 302 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:20.398933 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977c43b1-b77a-4782-a9e3-32c25c81caaa None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:20.481200 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ef76d8-ecb3-4abb-9600-aa2a0c2bad1d None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:20.548914 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fb9ebb-6812-4f22-b4dc-108fe5f4d66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:20.550188 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb9ebb-6812-4f22-b4dc-108fe5f4d66a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:20.550721 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb9ebb-6812-4f22-b4dc-108fe5f4d66a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:20.551327 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb9ebb-6812-4f22-b4dc-108fe5f4d66a None admin] PATH_INFO: `/v3/projects/d260f7a9c3984a7d8d4d7f5aa78dcc78` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:20.552835 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fb9ebb-6812-4f22-b4dc-108fe5f4d66a None admin] RBAC: Authorizing `identity:get_project(project_id=d260f7a9c3984a7d8d4d7f5aa78dcc78)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:20.554496 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fb9ebb-6812-4f22-b4dc-108fe5f4d66a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:20.563538 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 127/251] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Jul 2 03:16:20 2022] GET /identity/v3/projects/d260f7a9c3984a7d8d4d7f5aa78dcc78 => generated 302 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:20.564627 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fb9ebb-6812-4f22-b4dc-108fe5f4d66a None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:20.574444 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977c43b1-b77a-4782-a9e3-32c25c81caaa None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:20.625205 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa42d114-9157-473e-9562-3ee638f87001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:20.625787 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42d114-9157-473e-9562-3ee638f87001 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:20.626065 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42d114-9157-473e-9562-3ee638f87001 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:20.626336 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42d114-9157-473e-9562-3ee638f87001 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:20.627314 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa42d114-9157-473e-9562-3ee638f87001 None admin] RBAC: Adding query filter params (role.id=e7cdb23960ca4be7a9cd4c7685029db0, scope.project.id=d260f7a9c3984a7d8d4d7f5aa78dcc78, user.id=8d729af1811d4baba13d254da1b7e04d) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:20.627619 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa42d114-9157-473e-9562-3ee638f87001 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:20.629313 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa42d114-9157-473e-9562-3ee638f87001 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:20.635441 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 125/252] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Jul 2 03:16:20 2022] GET /identity/v3/role_assignments?user.id=8d729af1811d4baba13d254da1b7e04d&scope.project.id=d260f7a9c3984a7d8d4d7f5aa78dcc78&role.id=e7cdb23960ca4be7a9cd4c7685029db0 => generated 259 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:16:20.636727 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a7cf5-9d62-4446-b5db-1aead208f3a4 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:20.637005 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a7cf5-9d62-4446-b5db-1aead208f3a4 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:20.637273 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a7cf5-9d62-4446-b5db-1aead208f3a4 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:20.638695 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 126/253] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:16:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:16:20.648821 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19869286-e2df-4644-bb43-9a03ffae6044 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:20.649151 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19869286-e2df-4644-bb43-9a03ffae6044 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:20.649376 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19869286-e2df-4644-bb43-9a03ffae6044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:20.684298 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-19869286-e2df-4644-bb43-9a03ffae6044 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:16:20.685621 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-19869286-e2df-4644-bb43-9a03ffae6044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:16:20.704345 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:20.727108 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:20.793593 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fb9ebb-6812-4f22-b4dc-108fe5f4d66a None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:20.804730 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 127/254] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:16:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 02 03:16:20.832050 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19869286-e2df-4644-bb43-9a03ffae6044 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:20.861154 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198236c6-dcbe-48f9-afcd-183575104b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:20.862061 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198236c6-dcbe-48f9-afcd-183575104b11 None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:20.862342 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198236c6-dcbe-48f9-afcd-183575104b11 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:20.862616 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198236c6-dcbe-48f9-afcd-183575104b11 None admin] PATH_INFO: `/v3/projects/d260f7a9c3984a7d8d4d7f5aa78dcc78/users/c22eef11685c47b3a41da1d9ca89ece9/roles/c43aada0326446c4ade0ab1262918fa4` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:20.868504 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198236c6-dcbe-48f9-afcd-183575104b11 None admin] RBAC: Authorizing `identity:create_grant(project_id=d260f7a9c3984a7d8d4d7f5aa78dcc78, user_id=c22eef11685c47b3a41da1d9ca89ece9, role_id=c43aada0326446c4ade0ab1262918fa4)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:20.869983 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198236c6-dcbe-48f9-afcd-183575104b11 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:20.891691 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 128/255] 10.222.0.60 () {58 vars in 1439 bytes} [Sat Jul 2 03:16:20 2022] PUT /identity/v3/projects/d260f7a9c3984a7d8d4d7f5aa78dcc78/users/c22eef11685c47b3a41da1d9ca89ece9/roles/c43aada0326446c4ade0ab1262918fa4 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:16:20.977222 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19869286-e2df-4644-bb43-9a03ffae6044 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:21.029087 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98423ec4-8fb3-4254-9a78-f8d9a2c01437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:21.029916 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98423ec4-8fb3-4254-9a78-f8d9a2c01437 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:21.030196 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98423ec4-8fb3-4254-9a78-f8d9a2c01437 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:21.030470 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98423ec4-8fb3-4254-9a78-f8d9a2c01437 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:21.050578 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98423ec4-8fb3-4254-9a78-f8d9a2c01437 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:16:21.058499 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-98423ec4-8fb3-4254-9a78-f8d9a2c01437 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 03:16:21.058499 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:21.058499 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:21.058499 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:21.058499 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:21.058499 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:21.058499 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:21.058499 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:21.058499 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:21.058499 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:21.058499 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:21.058499 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:21.058499 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:16:21.058499 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:16:21.058499 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:16:21.058499 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:16:21.059419 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:16:21.059419 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:16:21.059419 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:16:21.059419 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:16:21.059419 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:21.059419 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:21.059419 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:21.059419 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:21.059419 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:21.059419 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:21.059419 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:21.059419 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:21.059419 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:21.059419 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:21.059419 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:21.059419 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:21.060287 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:21.060287 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:21.060287 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:21.060287 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:21.060287 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:16:21.060287 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:16:21.060287 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:16:21.060287 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:16:21.060287 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:16:21.060287 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:16:21.060287 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 03:16:21.060287 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:16:21.062412 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 128/256] 10.222.0.60 () {56 vars in 1096 bytes} [Sat Jul 2 03:16:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 03:16:21.067499 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198236c6-dcbe-48f9-afcd-183575104b11 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:21.083269 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ba820-05ff-4e87-9ff5-e44135bfbb03 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:21.083912 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ba820-05ff-4e87-9ff5-e44135bfbb03 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:21.084404 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ba820-05ff-4e87-9ff5-e44135bfbb03 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:21.086379 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 129/257] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:16:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:16:21.092299 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1b26c-739f-4e23-b398-90ce7601aecc None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:21.092902 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1b26c-739f-4e23-b398-90ce7601aecc None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:21.093403 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1b26c-739f-4e23-b398-90ce7601aecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:21.128224 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-d7c1b26c-739f-4e23-b398-90ce7601aecc None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:16:21.129456 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-d7c1b26c-739f-4e23-b398-90ce7601aecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:16:21.150021 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:21.227353 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 130/258] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:16:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 02 03:16:21.254399 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c1b26c-739f-4e23-b398-90ce7601aecc None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:21.279429 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198236c6-dcbe-48f9-afcd-183575104b11 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:21.324067 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:21.351826 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a9a2ad-bff4-4536-b22f-1492160f9c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:21.352514 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9a2ad-bff4-4536-b22f-1492160f9c64 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:21.353092 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9a2ad-bff4-4536-b22f-1492160f9c64 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:21.353092 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9a2ad-bff4-4536-b22f-1492160f9c64 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:21.353824 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a9a2ad-bff4-4536-b22f-1492160f9c64 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:21.354132 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a9a2ad-bff4-4536-b22f-1492160f9c64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:21.355566 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a9a2ad-bff4-4536-b22f-1492160f9c64 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:21.365897 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c1b26c-739f-4e23-b398-90ce7601aecc None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:21.376252 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 129/259] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Jul 2 03:16:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:21.381573 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a9a2ad-bff4-4536-b22f-1492160f9c64 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:21.420148 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8173812-70e5-4a85-ba5d-d49781c6df0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:21.421408 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8173812-70e5-4a85-ba5d-d49781c6df0b None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:21.421897 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8173812-70e5-4a85-ba5d-d49781c6df0b None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:21.423067 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8173812-70e5-4a85-ba5d-d49781c6df0b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:21.449517 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8173812-70e5-4a85-ba5d-d49781c6df0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:16:21.474716 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-e8173812-70e5-4a85-ba5d-d49781c6df0b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 02 03:16:21.474716 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:21.474716 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:21.474716 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:21.474716 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:21.474716 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:21.474716 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:21.474716 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:21.474716 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:21.474716 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:21.474716 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:21.474716 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:21.474716 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:16:21.474716 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:16:21.474716 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:16:21.474716 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:16:21.476377 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:16:21.476377 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:16:21.476377 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:16:21.476377 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:16:21.476377 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:21.476377 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:21.476377 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:21.476377 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:21.476377 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:21.476377 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:21.476377 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:21.476377 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:21.476377 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:21.476377 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:21.476377 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:21.476377 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:21.477167 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:21.477167 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:21.477167 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:21.477167 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:21.477167 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:16:21.477167 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:16:21.477167 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:16:21.477167 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:16:21.477167 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:16:21.477167 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:16:21.477167 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 02 03:16:21.477167 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:16:21.492037 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 131/260] 10.222.0.60 () {56 vars in 1114 bytes} [Sat Jul 2 03:16:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:16:21.495379 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8173812-70e5-4a85-ba5d-d49781c6df0b None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:21.531481 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:21.642194 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a9a2ad-bff4-4536-b22f-1492160f9c64 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:21.647201 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8173812-70e5-4a85-ba5d-d49781c6df0b None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:21.692878 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ecce4-595f-4444-9f81-1fb1fe7ae1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:21.693704 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ecce4-595f-4444-9f81-1fb1fe7ae1d6 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:21.693981 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ecce4-595f-4444-9f81-1fb1fe7ae1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:21.694251 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ecce4-595f-4444-9f81-1fb1fe7ae1d6 None admin] PATH_INFO: `/v3/users/0893d699d42f44d4abebc512b77c89ea` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:21.695590 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925ecce4-595f-4444-9f81-1fb1fe7ae1d6 None admin] RBAC: Authorizing `identity:get_user(user_id=0893d699d42f44d4abebc512b77c89ea)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:21.697212 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925ecce4-595f-4444-9f81-1fb1fe7ae1d6 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:21.703830 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 130/261] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Jul 2 03:16:21 2022] GET /identity/v3/users/0893d699d42f44d4abebc512b77c89ea => generated 283 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:21.709101 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca56589c-215e-4a6e-8c1b-5367a7d2750b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:21.709265 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ecce4-595f-4444-9f81-1fb1fe7ae1d6 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:21.709800 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca56589c-215e-4a6e-8c1b-5367a7d2750b None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:21.710131 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca56589c-215e-4a6e-8c1b-5367a7d2750b None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:21.710406 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca56589c-215e-4a6e-8c1b-5367a7d2750b None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:21.711243 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca56589c-215e-4a6e-8c1b-5367a7d2750b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:21.711548 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca56589c-215e-4a6e-8c1b-5367a7d2750b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:21.713001 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca56589c-215e-4a6e-8c1b-5367a7d2750b None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:21.736575 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 132/262] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Jul 2 03:16:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:21.742115 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca56589c-215e-4a6e-8c1b-5367a7d2750b None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:21.790498 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:21.840349 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ecce4-595f-4444-9f81-1fb1fe7ae1d6 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:21.855508 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:21.884377 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7635fb03-e8e1-4e4b-a2fb-1925ed82b41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:21.885039 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7635fb03-e8e1-4e4b-a2fb-1925ed82b41f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:21.885319 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7635fb03-e8e1-4e4b-a2fb-1925ed82b41f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:21.885589 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7635fb03-e8e1-4e4b-a2fb-1925ed82b41f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:21.904598 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca56589c-215e-4a6e-8c1b-5367a7d2750b None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:21.952374 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf869000-d476-4a85-8305-d649be70a427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:21.953182 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf869000-d476-4a85-8305-d649be70a427 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:21.953463 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf869000-d476-4a85-8305-d649be70a427 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:21.954000 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf869000-d476-4a85-8305-d649be70a427 None admin] PATH_INFO: `/v3/users/0893d699d42f44d4abebc512b77c89ea` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:21.955432 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf869000-d476-4a85-8305-d649be70a427 None admin] RBAC: Authorizing `identity:get_user(user_id=0893d699d42f44d4abebc512b77c89ea)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:21.957123 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf869000-d476-4a85-8305-d649be70a427 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:21.959079 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 133/263] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Jul 2 03:16:21 2022] GET /identity/v3/users/0893d699d42f44d4abebc512b77c89ea => generated 283 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:21.964408 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf869000-d476-4a85-8305-d649be70a427 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:22.060223 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7635fb03-e8e1-4e4b-a2fb-1925ed82b41f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:22.061708 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7635fb03-e8e1-4e4b-a2fb-1925ed82b41f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:22.167701 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:22.178886 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf869000-d476-4a85-8305-d649be70a427 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:22.256328 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44a94a6-0093-4e3b-8bd0-754b32abc0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:22.256982 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a94a6-0093-4e3b-8bd0-754b32abc0c5 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:22.257261 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a94a6-0093-4e3b-8bd0-754b32abc0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:22.257534 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a94a6-0093-4e3b-8bd0-754b32abc0c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:22.273170 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:22.275704 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 131/264] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Jul 2 03:16:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 02 03:16:22.283505 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7635fb03-e8e1-4e4b-a2fb-1925ed82b41f None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:22.432300 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44a94a6-0093-4e3b-8bd0-754b32abc0c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:22.433834 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44a94a6-0093-4e3b-8bd0-754b32abc0c5 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:22.531035 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7635fb03-e8e1-4e4b-a2fb-1925ed82b41f None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:22.604346 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7350aad4-ed39-438c-9119-9ee8ef1f4c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:22.605225 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7350aad4-ed39-438c-9119-9ee8ef1f4c60 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:22.605499 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7350aad4-ed39-438c-9119-9ee8ef1f4c60 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:22.605770 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7350aad4-ed39-438c-9119-9ee8ef1f4c60 None admin] PATH_INFO: `/v3/projects/d260f7a9c3984a7d8d4d7f5aa78dcc78` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:22.611882 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7350aad4-ed39-438c-9119-9ee8ef1f4c60 None admin] RBAC: Authorizing `identity:get_project(project_id=d260f7a9c3984a7d8d4d7f5aa78dcc78)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:22.613347 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7350aad4-ed39-438c-9119-9ee8ef1f4c60 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:22.616443 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 132/265] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Jul 2 03:16:22 2022] GET /identity/v3/projects/d260f7a9c3984a7d8d4d7f5aa78dcc78 => generated 302 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:16:22.625309 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7350aad4-ed39-438c-9119-9ee8ef1f4c60 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:22.663925 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 134/266] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Jul 2 03:16:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 700 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 03:16:22.668329 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:22.669818 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44a94a6-0093-4e3b-8bd0-754b32abc0c5 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:22.753786 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:22.813853 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7350aad4-ed39-438c-9119-9ee8ef1f4c60 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:22.861286 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d671fd5-11dd-45bd-bc6f-a2e944f8f944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:22.862326 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d671fd5-11dd-45bd-bc6f-a2e944f8f944 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:22.862801 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d671fd5-11dd-45bd-bc6f-a2e944f8f944 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:22.863305 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d671fd5-11dd-45bd-bc6f-a2e944f8f944 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:22.864405 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d671fd5-11dd-45bd-bc6f-a2e944f8f944 None admin] RBAC: Adding query filter params (role.id=5dcd130cda6c490595e862dc2348e83d, scope.project.id=d260f7a9c3984a7d8d4d7f5aa78dcc78, user.id=0893d699d42f44d4abebc512b77c89ea) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:22.864909 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d671fd5-11dd-45bd-bc6f-a2e944f8f944 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:22.866593 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d671fd5-11dd-45bd-bc6f-a2e944f8f944 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:22.873890 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 133/267] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Jul 2 03:16:22 2022] GET /identity/v3/role_assignments?user.id=0893d699d42f44d4abebc512b77c89ea&scope.project.id=d260f7a9c3984a7d8d4d7f5aa78dcc78&role.id=5dcd130cda6c490595e862dc2348e83d => generated 608 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:16:22.915519 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44a94a6-0093-4e3b-8bd0-754b32abc0c5 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:22.959974 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735dd4a0-b033-458b-9f14-c2cf52b7f9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:22.961210 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735dd4a0-b033-458b-9f14-c2cf52b7f9db None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:22.961710 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735dd4a0-b033-458b-9f14-c2cf52b7f9db None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:22.962170 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735dd4a0-b033-458b-9f14-c2cf52b7f9db None admin] PATH_INFO: `/v3/projects/d260f7a9c3984a7d8d4d7f5aa78dcc78` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:22.963732 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735dd4a0-b033-458b-9f14-c2cf52b7f9db None admin] RBAC: Authorizing `identity:get_project(project_id=d260f7a9c3984a7d8d4d7f5aa78dcc78)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:22.965499 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735dd4a0-b033-458b-9f14-c2cf52b7f9db None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:22.967567 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 135/268] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Jul 2 03:16:22 2022] GET /identity/v3/projects/d260f7a9c3984a7d8d4d7f5aa78dcc78 => generated 302 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:22.973613 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d671fd5-11dd-45bd-bc6f-a2e944f8f944 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:23.011771 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1823d1-77a1-47a8-adfb-5ffe08d850e9 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:23.012101 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1823d1-77a1-47a8-adfb-5ffe08d850e9 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:23.012350 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1823d1-77a1-47a8-adfb-5ffe08d850e9 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:23.014427 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 136/269] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:16:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:16:23.021001 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ae4fe-2905-41d7-96a7-5686ad3aece7 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:23.021286 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ae4fe-2905-41d7-96a7-5686ad3aece7 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:23.021562 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ae4fe-2905-41d7-96a7-5686ad3aece7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:23.042831 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-a96ae4fe-2905-41d7-96a7-5686ad3aece7 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:16:23.044570 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-a96ae4fe-2905-41d7-96a7-5686ad3aece7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:16:23.141607 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:23.173194 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d671fd5-11dd-45bd-bc6f-a2e944f8f944 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:23.181197 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 137/270] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:16:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 02 03:16:23.183113 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd847c-51e1-49d7-b7c9-888dcd096d8a None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:23.183609 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd847c-51e1-49d7-b7c9-888dcd096d8a None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:23.184056 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd847c-51e1-49d7-b7c9-888dcd096d8a None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:23.185688 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 138/271] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:16:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:16:23.192394 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c668419-b1f3-415b-b670-44fcd6443090 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:23.192971 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c668419-b1f3-415b-b670-44fcd6443090 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:23.194149 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c668419-b1f3-415b-b670-44fcd6443090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:23.222945 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-9c668419-b1f3-415b-b670-44fcd6443090 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:16:23.224795 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-9c668419-b1f3-415b-b670-44fcd6443090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:16:23.229508 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64874434-10b7-4d21-ab47-67a73bacae24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:23.230422 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64874434-10b7-4d21-ab47-67a73bacae24 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:23.230422 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64874434-10b7-4d21-ab47-67a73bacae24 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:23.239251 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64874434-10b7-4d21-ab47-67a73bacae24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:23.239251 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64874434-10b7-4d21-ab47-67a73bacae24 None admin] RBAC: Adding query filter params (role.id=a9792a930e0c4e139f287a712dfc7d4d, scope.project.id=d260f7a9c3984a7d8d4d7f5aa78dcc78, user.id=0893d699d42f44d4abebc512b77c89ea) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:23.239251 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64874434-10b7-4d21-ab47-67a73bacae24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:23.239251 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64874434-10b7-4d21-ab47-67a73bacae24 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:23.240735 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 134/272] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Jul 2 03:16:22 2022] GET /identity/v3/role_assignments?user.id=0893d699d42f44d4abebc512b77c89ea&scope.project.id=d260f7a9c3984a7d8d4d7f5aa78dcc78&role.id=a9792a930e0c4e139f287a712dfc7d4d => generated 608 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:23.241642 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64874434-10b7-4d21-ab47-67a73bacae24 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:23.278147 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:23.336446 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 139/273] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:16:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 03:16:23.355102 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64874434-10b7-4d21-ab47-67a73bacae24 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:23.380253 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c668419-b1f3-415b-b670-44fcd6443090 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:23.393949 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee465d60-af40-43f2-91e3-358e70637028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:23.394674 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee465d60-af40-43f2-91e3-358e70637028 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:23.394959 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee465d60-af40-43f2-91e3-358e70637028 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:23.395273 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee465d60-af40-43f2-91e3-358e70637028 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:23.396570 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee465d60-af40-43f2-91e3-358e70637028 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:23.398053 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee465d60-af40-43f2-91e3-358e70637028 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:23.400154 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 135/274] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:16:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:23.405551 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee465d60-af40-43f2-91e3-358e70637028 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:23.427576 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:23.519659 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee465d60-af40-43f2-91e3-358e70637028 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:23.560663 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c19674e-637c-4010-a00a-e873d1eb8d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:23.561344 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c19674e-637c-4010-a00a-e873d1eb8d67 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:23.561623 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c19674e-637c-4010-a00a-e873d1eb8d67 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:23.561903 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c19674e-637c-4010-a00a-e873d1eb8d67 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:23.562624 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c19674e-637c-4010-a00a-e873d1eb8d67 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:23.564125 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c19674e-637c-4010-a00a-e873d1eb8d67 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:23.597734 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 136/275] 10.222.0.60 () {60 vars in 1132 bytes} [Sat Jul 2 03:16:23 2022] POST /identity/v3/users => generated 293 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:16:23.598935 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c668419-b1f3-415b-b670-44fcd6443090 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:23.622554 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333107f9-7822-43a7-b49a-f6ab3e903344 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:23.622877 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333107f9-7822-43a7-b49a-f6ab3e903344 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:23.623145 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333107f9-7822-43a7-b49a-f6ab3e903344 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:23.625036 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 137/276] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:16:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 03:16:23.631268 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3008f626-51ab-4c4c-ae50-570534e468a6 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:23.631554 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3008f626-51ab-4c4c-ae50-570534e468a6 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:23.631836 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3008f626-51ab-4c4c-ae50-570534e468a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:23.643352 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219f02d8-6ed9-4adb-a517-b90f997ea93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:23.644219 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f02d8-6ed9-4adb-a517-b90f997ea93e None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:23.644439 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f02d8-6ed9-4adb-a517-b90f997ea93e None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:23.644709 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f02d8-6ed9-4adb-a517-b90f997ea93e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:23.652442 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-3008f626-51ab-4c4c-ae50-570534e468a6 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:16:23.654283 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3008f626-51ab-4c4c-ae50-570534e468a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:16:23.657216 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219f02d8-6ed9-4adb-a517-b90f997ea93e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:16:23.665208 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-219f02d8-6ed9-4adb-a517-b90f997ea93e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 02 03:16:23.665208 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:23.665208 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:23.665208 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:23.665208 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:23.665208 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:23.665208 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:23.665208 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:23.665208 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:23.665208 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:23.665208 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:23.665208 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:23.665208 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:16:23.665208 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:16:23.665208 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:16:23.665208 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:16:23.666132 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:16:23.666132 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:16:23.666132 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:16:23.666132 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:16:23.666132 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:23.666132 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:23.666132 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:23.666132 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:23.666132 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:23.666132 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:23.666132 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:23.666132 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:23.666132 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:23.666132 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:23.666132 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:23.666132 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:23.667337 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:23.667337 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:23.667337 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:23.667337 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:23.667337 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:16:23.667337 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:16:23.667337 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:16:23.667337 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:16:23.667337 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:16:23.667337 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:16:23.667337 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 02 03:16:23.667337 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:16:23.667337 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 140/277] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Jul 2 03:16:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:16:23.668379 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957a04e-b50c-4795-9f62-c8c43bfc5123 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:23.669673 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957a04e-b50c-4795-9f62-c8c43bfc5123 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:23.669673 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957a04e-b50c-4795-9f62-c8c43bfc5123 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:23.671239 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 141/278] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:16:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:16:23.675551 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e2f32c-2294-495d-aa8b-5f1b6864976d None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:23.675884 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e2f32c-2294-495d-aa8b-5f1b6864976d None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:23.676079 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e2f32c-2294-495d-aa8b-5f1b6864976d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:23.696474 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-76e2f32c-2294-495d-aa8b-5f1b6864976d None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:16:23.697695 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-76e2f32c-2294-495d-aa8b-5f1b6864976d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:16:23.720877 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:23.741732 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 138/279] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:16:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 02 03:16:23.742632 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3008f626-51ab-4c4c-ae50-570534e468a6 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:23.746437 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:23.788042 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 142/280] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:16:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 02 03:16:23.794754 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e2f32c-2294-495d-aa8b-5f1b6864976d None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:23.862388 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3008f626-51ab-4c4c-ae50-570534e468a6 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:23.903606 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7720607d-da4c-4c8e-a49a-10bcc33daae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:23.904768 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720607d-da4c-4c8e-a49a-10bcc33daae9 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:23.905060 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720607d-da4c-4c8e-a49a-10bcc33daae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:23.905335 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720607d-da4c-4c8e-a49a-10bcc33daae9 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:23.906228 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7720607d-da4c-4c8e-a49a-10bcc33daae9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:23.906537 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7720607d-da4c-4c8e-a49a-10bcc33daae9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:23.907383 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e2f32c-2294-495d-aa8b-5f1b6864976d None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:23.907952 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7720607d-da4c-4c8e-a49a-10bcc33daae9 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:23.919866 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 139/281] 10.222.0.60 () {56 vars in 1101 bytes} [Sat Jul 2 03:16:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:23.921078 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7720607d-da4c-4c8e-a49a-10bcc33daae9 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:23.949131 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c4d8d-ace5-42ff-a5ba-93b2cd0ab987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:23.950241 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c4d8d-ace5-42ff-a5ba-93b2cd0ab987 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:23.950518 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c4d8d-ace5-42ff-a5ba-93b2cd0ab987 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:23.950831 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c4d8d-ace5-42ff-a5ba-93b2cd0ab987 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:23.967651 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041c4d8d-ace5-42ff-a5ba-93b2cd0ab987 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:16:23.977435 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-041c4d8d-ace5-42ff-a5ba-93b2cd0ab987 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 02 03:16:23.977435 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:23.977435 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:23.977435 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:23.977435 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:23.977435 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:23.977435 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:23.977435 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:23.977435 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:23.977435 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:23.977435 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:23.977435 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:23.977435 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:16:23.977435 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:16:23.977435 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:16:23.977435 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:16:23.978335 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:16:23.978335 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:16:23.978335 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:16:23.978335 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:16:23.978335 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:23.978335 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:23.978335 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:23.978335 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:23.978335 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:23.978335 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:23.978335 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:23.978335 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:23.978335 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:23.978335 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:23.978335 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:23.978335 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:23.979734 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:23.979734 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:23.979734 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:23.979734 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:23.979734 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:16:23.979734 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:16:23.979734 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:16:23.979734 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:16:23.979734 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:16:23.979734 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:16:23.979734 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 02 03:16:23.979734 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:16:23.979734 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 143/282] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Jul 2 03:16:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:16:23.980559 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c4d8d-ace5-42ff-a5ba-93b2cd0ab987 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:23.987970 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:24.001606 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:24.034662 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7720607d-da4c-4c8e-a49a-10bcc33daae9 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:24.070219 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c69f75-b4ca-4ca3-b402-68873041a6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:24.071419 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c69f75-b4ca-4ca3-b402-68873041a6b6 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:24.071900 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c69f75-b4ca-4ca3-b402-68873041a6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:24.072369 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c69f75-b4ca-4ca3-b402-68873041a6b6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:24.084994 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c69f75-b4ca-4ca3-b402-68873041a6b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:16:24.093538 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-00c69f75-b4ca-4ca3-b402-68873041a6b6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 02 03:16:24.093538 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:24.093538 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:24.093538 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:24.093538 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:24.093538 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:24.093538 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:24.093538 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:24.093538 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:24.093538 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:24.093538 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:24.093538 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:24.093538 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:16:24.093538 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:16:24.093538 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:16:24.093538 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:16:24.094436 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:16:24.094436 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:16:24.094436 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:16:24.094436 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:16:24.094436 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:24.094436 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:24.094436 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:24.094436 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:24.094436 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:24.094436 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:24.094436 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:24.094436 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:24.094436 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:24.094436 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:24.094436 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:24.094436 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:24.095238 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:24.095238 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:24.095238 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:24.095238 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:24.095238 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:16:24.095238 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:16:24.095238 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:16:24.095238 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:16:24.095238 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:16:24.095238 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:16:24.095238 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 02 03:16:24.095238 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:16:24.097633 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 140/283] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Jul 2 03:16:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:16:24.098803 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c69f75-b4ca-4ca3-b402-68873041a6b6 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:24.110217 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c4d8d-ace5-42ff-a5ba-93b2cd0ab987 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:24.156331 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead4d97-7a9e-48f6-ae86-718f0d2a04e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:24.157138 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead4d97-7a9e-48f6-ae86-718f0d2a04e3 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:24.157415 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead4d97-7a9e-48f6-ae86-718f0d2a04e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:24.157685 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead4d97-7a9e-48f6-ae86-718f0d2a04e3 None admin] PATH_INFO: `/v3/users/a538897a433b4c378fefd40a54c0644a` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:24.180649 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ead4d97-7a9e-48f6-ae86-718f0d2a04e3 None admin] RBAC: Authorizing `identity:get_user(user_id=a538897a433b4c378fefd40a54c0644a)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:24.182685 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ead4d97-7a9e-48f6-ae86-718f0d2a04e3 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:24.185011 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 144/284] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Jul 2 03:16:23 2022] GET /identity/v3/users/a538897a433b4c378fefd40a54c0644a => generated 293 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:24.185798 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead4d97-7a9e-48f6-ae86-718f0d2a04e3 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:24.222356 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c69f75-b4ca-4ca3-b402-68873041a6b6 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:24.262942 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:24.268648 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e61b0e-f6a4-4a5b-be6f-fec74a518b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:24.271233 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:24.271367 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e61b0e-f6a4-4a5b-be6f-fec74a518b49 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:24.271869 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e61b0e-f6a4-4a5b-be6f-fec74a518b49 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:24.272161 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e61b0e-f6a4-4a5b-be6f-fec74a518b49 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:24.272975 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e61b0e-f6a4-4a5b-be6f-fec74a518b49 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:24.273273 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e61b0e-f6a4-4a5b-be6f-fec74a518b49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:24.274634 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e61b0e-f6a4-4a5b-be6f-fec74a518b49 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:24.284112 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 141/285] 10.222.0.60 () {56 vars in 1101 bytes} [Sat Jul 2 03:16:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:24.285031 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e61b0e-f6a4-4a5b-be6f-fec74a518b49 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:24.306882 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead4d97-7a9e-48f6-ae86-718f0d2a04e3 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:24.344631 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4846d446-b4f9-4920-b20a-575c2043fdbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:24.345304 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846d446-b4f9-4920-b20a-575c2043fdbc None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:24.345581 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846d446-b4f9-4920-b20a-575c2043fdbc None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:24.345853 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846d446-b4f9-4920-b20a-575c2043fdbc None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:24.346713 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4846d446-b4f9-4920-b20a-575c2043fdbc None admin] RBAC: Adding query filter params (name=member) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:24.347021 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4846d446-b4f9-4920-b20a-575c2043fdbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:24.348585 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4846d446-b4f9-4920-b20a-575c2043fdbc None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:24.358079 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 145/286] 10.222.0.60 () {56 vars in 1101 bytes} [Sat Jul 2 03:16:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:24.358797 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4846d446-b4f9-4920-b20a-575c2043fdbc None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:24.414318 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e61b0e-f6a4-4a5b-be6f-fec74a518b49 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:24.459151 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7536841-e6f0-4782-a7ff-2bd85c77f38e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:24.460289 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7536841-e6f0-4782-a7ff-2bd85c77f38e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:24.461134 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7536841-e6f0-4782-a7ff-2bd85c77f38e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:24.461674 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7536841-e6f0-4782-a7ff-2bd85c77f38e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:24.462794 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7536841-e6f0-4782-a7ff-2bd85c77f38e None admin] RBAC: Adding query filter params (role.id=c43aada0326446c4ade0ab1262918fa4, user.id=a538897a433b4c378fefd40a54c0644a, scope.system=all) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:24.463493 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7536841-e6f0-4782-a7ff-2bd85c77f38e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:24.465802 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7536841-e6f0-4782-a7ff-2bd85c77f38e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:24.471659 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4846d446-b4f9-4920-b20a-575c2043fdbc None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:24.479906 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 142/287] 10.222.0.60 () {56 vars in 1308 bytes} [Sat Jul 2 03:16:24 2022] GET /identity/v3/role_assignments?user.id=a538897a433b4c378fefd40a54c0644a&scope.system=all&role.id=c43aada0326446c4ade0ab1262918fa4 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:24.481170 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7536841-e6f0-4782-a7ff-2bd85c77f38e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:24.536121 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeeb6e3-724f-46ba-ac1c-ac29b4f3159e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:24.537017 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeeb6e3-724f-46ba-ac1c-ac29b4f3159e None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:24.537295 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeeb6e3-724f-46ba-ac1c-ac29b4f3159e None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:24.537566 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeeb6e3-724f-46ba-ac1c-ac29b4f3159e None admin] PATH_INFO: `/v3/users/8d729af1811d4baba13d254da1b7e04d` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:24.538863 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeeb6e3-724f-46ba-ac1c-ac29b4f3159e None admin] RBAC: Authorizing `identity:get_user(user_id=8d729af1811d4baba13d254da1b7e04d)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:24.540384 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeeb6e3-724f-46ba-ac1c-ac29b4f3159e None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:24.542465 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 146/288] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Jul 2 03:16:24 2022] GET /identity/v3/users/8d729af1811d4baba13d254da1b7e04d => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:24.548234 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeeb6e3-724f-46ba-ac1c-ac29b4f3159e None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:24.558544 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:24.584087 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:24.691230 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7536841-e6f0-4782-a7ff-2bd85c77f38e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:24.726001 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeeb6e3-724f-46ba-ac1c-ac29b4f3159e None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:24.750662 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1926d9a7-9859-417c-babb-48eeff3d3db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:24.752784 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1926d9a7-9859-417c-babb-48eeff3d3db4 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:24.753062 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1926d9a7-9859-417c-babb-48eeff3d3db4 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:24.754191 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1926d9a7-9859-417c-babb-48eeff3d3db4 None admin] PATH_INFO: `/v3/users/c22eef11685c47b3a41da1d9ca89ece9` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:24.756575 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1926d9a7-9859-417c-babb-48eeff3d3db4 None admin] RBAC: Authorizing `identity:get_user(user_id=c22eef11685c47b3a41da1d9ca89ece9)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:24.758041 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1926d9a7-9859-417c-babb-48eeff3d3db4 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:24.761962 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 143/289] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Jul 2 03:16:24 2022] GET /identity/v3/users/c22eef11685c47b3a41da1d9ca89ece9 => generated 297 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:24.764932 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1926d9a7-9859-417c-babb-48eeff3d3db4 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:24.788484 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8762b4-3c8e-40b2-9834-caed62d8d402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:24.789353 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8762b4-3c8e-40b2-9834-caed62d8d402 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:24.789630 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8762b4-3c8e-40b2-9834-caed62d8d402 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:24.789903 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8762b4-3c8e-40b2-9834-caed62d8d402 None admin] PATH_INFO: `/v3/projects/d260f7a9c3984a7d8d4d7f5aa78dcc78` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:24.792244 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8762b4-3c8e-40b2-9834-caed62d8d402 None admin] RBAC: Authorizing `identity:get_project(project_id=d260f7a9c3984a7d8d4d7f5aa78dcc78)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:24.793712 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8762b4-3c8e-40b2-9834-caed62d8d402 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:24.795533 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 147/290] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Jul 2 03:16:24 2022] GET /identity/v3/projects/d260f7a9c3984a7d8d4d7f5aa78dcc78 => generated 302 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:24.801096 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8762b4-3c8e-40b2-9834-caed62d8d402 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:24.897485 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:24.948632 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8762b4-3c8e-40b2-9834-caed62d8d402 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:24.975816 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1926d9a7-9859-417c-babb-48eeff3d3db4 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:24.997674 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec768fa-faf9-441f-b318-3f44f9216ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:24.998595 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec768fa-faf9-441f-b318-3f44f9216ee9 None admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:24.998871 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec768fa-faf9-441f-b318-3f44f9216ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:24.999156 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec768fa-faf9-441f-b318-3f44f9216ee9 None admin] PATH_INFO: `/v3/projects/d260f7a9c3984a7d8d4d7f5aa78dcc78/users/8d729af1811d4baba13d254da1b7e04d/roles/e7cdb23960ca4be7a9cd4c7685029db0` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:25.002607 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec768fa-faf9-441f-b318-3f44f9216ee9 None admin] RBAC: Authorizing `identity:create_grant(project_id=d260f7a9c3984a7d8d4d7f5aa78dcc78, user_id=8d729af1811d4baba13d254da1b7e04d, role_id=e7cdb23960ca4be7a9cd4c7685029db0)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:25.004118 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec768fa-faf9-441f-b318-3f44f9216ee9 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:25.014932 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:25.031622 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 148/291] 10.222.0.60 () {58 vars in 1439 bytes} [Sat Jul 2 03:16:24 2022] PUT /identity/v3/projects/d260f7a9c3984a7d8d4d7f5aa78dcc78/users/8d729af1811d4baba13d254da1b7e04d/roles/e7cdb23960ca4be7a9cd4c7685029db0 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:16:25.043237 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1142d93a-21fa-4428-a931-62d5ec2c1460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:25.043983 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1142d93a-21fa-4428-a931-62d5ec2c1460 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:25.044297 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1142d93a-21fa-4428-a931-62d5ec2c1460 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:25.044689 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1142d93a-21fa-4428-a931-62d5ec2c1460 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:25.144392 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1142d93a-21fa-4428-a931-62d5ec2c1460 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:25.145886 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1142d93a-21fa-4428-a931-62d5ec2c1460 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:25.279809 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 144/292] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Jul 2 03:16:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 03:16:25.285046 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec768fa-faf9-441f-b318-3f44f9216ee9 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:25.407926 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec768fa-faf9-441f-b318-3f44f9216ee9 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:25.449391 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:25.457243 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b23eae1-86fd-43d2-9b8f-7275f1117359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:25.458382 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23eae1-86fd-43d2-9b8f-7275f1117359 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:25.458841 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23eae1-86fd-43d2-9b8f-7275f1117359 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:25.459325 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23eae1-86fd-43d2-9b8f-7275f1117359 None admin] PATH_INFO: `/v3/projects/d260f7a9c3984a7d8d4d7f5aa78dcc78` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:25.460724 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b23eae1-86fd-43d2-9b8f-7275f1117359 None admin] RBAC: Authorizing `identity:get_project(project_id=d260f7a9c3984a7d8d4d7f5aa78dcc78)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:25.462390 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b23eae1-86fd-43d2-9b8f-7275f1117359 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:25.464325 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 149/293] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Jul 2 03:16:25 2022] GET /identity/v3/projects/d260f7a9c3984a7d8d4d7f5aa78dcc78 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:25.470293 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1142d93a-21fa-4428-a931-62d5ec2c1460 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:25.489284 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:25.584738 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1142d93a-21fa-4428-a931-62d5ec2c1460 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:25.633696 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f26cc9e-4fae-40ae-9e59-67afc126f596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:25.634381 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26cc9e-4fae-40ae-9e59-67afc126f596 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:25.634660 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26cc9e-4fae-40ae-9e59-67afc126f596 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:25.635047 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26cc9e-4fae-40ae-9e59-67afc126f596 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:25.635914 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f26cc9e-4fae-40ae-9e59-67afc126f596 None admin] RBAC: Adding query filter params (role.id=c43aada0326446c4ade0ab1262918fa4, scope.project.id=d260f7a9c3984a7d8d4d7f5aa78dcc78, user.id=c22eef11685c47b3a41da1d9ca89ece9) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:25.636222 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f26cc9e-4fae-40ae-9e59-67afc126f596 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:25.637665 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f26cc9e-4fae-40ae-9e59-67afc126f596 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:25.647987 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 145/294] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Jul 2 03:16:25 2022] GET /identity/v3/role_assignments?user.id=c22eef11685c47b3a41da1d9ca89ece9&scope.project.id=d260f7a9c3984a7d8d4d7f5aa78dcc78&role.id=c43aada0326446c4ade0ab1262918fa4 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:25.840262 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d94c2e-c75a-4c4c-b91c-62a22ab7b5a3 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:25.840472 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d94c2e-c75a-4c4c-b91c-62a22ab7b5a3 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:25.840750 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d94c2e-c75a-4c4c-b91c-62a22ab7b5a3 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:25.842807 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 150/295] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:16:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:16:25.848980 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180832e-2747-401d-b3b6-59639112bcb2 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:25.849291 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180832e-2747-401d-b3b6-59639112bcb2 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:25.849567 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180832e-2747-401d-b3b6-59639112bcb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:25.876264 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-6180832e-2747-401d-b3b6-59639112bcb2 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:16:25.877485 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-6180832e-2747-401d-b3b6-59639112bcb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:16:25.952214 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 146/296] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:16:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 03:16:25.975535 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d94c2e-c75a-4c4c-b91c-62a22ab7b5a3 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:26.084254 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d94c2e-c75a-4c4c-b91c-62a22ab7b5a3 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:26.120911 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2cf754-3253-40c3-b0f0-29171c2075f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:26.121938 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2cf754-3253-40c3-b0f0-29171c2075f0 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:26.122446 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2cf754-3253-40c3-b0f0-29171c2075f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:26.122852 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2cf754-3253-40c3-b0f0-29171c2075f0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:26.135364 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2cf754-3253-40c3-b0f0-29171c2075f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:16:26.143494 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-fa2cf754-3253-40c3-b0f0-29171c2075f0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 02 03:16:26.143494 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:26.143494 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:26.143494 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:26.143494 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:26.143494 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:26.143494 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:26.143494 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:26.143494 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:26.143494 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:26.143494 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:26.143494 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:26.143494 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:16:26.143494 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:16:26.143494 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:16:26.143494 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:16:26.144544 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:16:26.144544 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:16:26.144544 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:16:26.144544 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:16:26.144544 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:26.144544 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:26.144544 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:26.144544 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:26.144544 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:26.144544 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:26.144544 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:26.144544 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:26.144544 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:26.144544 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:26.144544 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:26.144544 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:26.145493 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:26.145493 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:26.145493 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:26.145493 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:26.145493 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:16:26.145493 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:16:26.145493 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:16:26.145493 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:16:26.145493 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:16:26.145493 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:16:26.145493 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 02 03:16:26.145493 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:16:26.147836 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 151/297] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Jul 2 03:16:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:16:26.154013 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6180832e-2747-401d-b3b6-59639112bcb2 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:26.168709 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:26.245368 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b5cdb-511c-4113-a54e-b13aa8ffec6f None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:26.246017 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b5cdb-511c-4113-a54e-b13aa8ffec6f None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:26.246508 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b5cdb-511c-4113-a54e-b13aa8ffec6f None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:26.248417 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 152/298] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:16:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 03:16:26.254887 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf39695-68f9-486d-a0e0-67882b15daef None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:26.255447 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf39695-68f9-486d-a0e0-67882b15daef None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:26.255919 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf39695-68f9-486d-a0e0-67882b15daef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:26.273559 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6180832e-2747-401d-b3b6-59639112bcb2 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:26.283091 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-3bf39695-68f9-486d-a0e0-67882b15daef None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:16:26.284404 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-3bf39695-68f9-486d-a0e0-67882b15daef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:16:26.309348 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053cd987-6d6d-4853-b642-78a2d00a8698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:26.310199 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053cd987-6d6d-4853-b642-78a2d00a8698 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:26.310533 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053cd987-6d6d-4853-b642-78a2d00a8698 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:26.310891 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053cd987-6d6d-4853-b642-78a2d00a8698 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:26.311676 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053cd987-6d6d-4853-b642-78a2d00a8698 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:26.311981 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053cd987-6d6d-4853-b642-78a2d00a8698 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:26.313462 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053cd987-6d6d-4853-b642-78a2d00a8698 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:26.322567 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 147/299] 10.222.0.60 () {56 vars in 1101 bytes} [Sat Jul 2 03:16:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:26.331712 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053cd987-6d6d-4853-b642-78a2d00a8698 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:26.343812 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:26.356263 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 153/300] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:16:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 02 03:16:26.379858 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf39695-68f9-486d-a0e0-67882b15daef None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:26.421792 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:26.450690 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053cd987-6d6d-4853-b642-78a2d00a8698 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:26.485119 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f9c92e-4b3c-4c80-9cf7-6075211afe74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:26.485994 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9c92e-4b3c-4c80-9cf7-6075211afe74 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:26.486270 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9c92e-4b3c-4c80-9cf7-6075211afe74 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:26.486540 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9c92e-4b3c-4c80-9cf7-6075211afe74 None admin] PATH_INFO: `/v3/users/b7dac73834204f43a93e3f8aaa4dae3a` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:26.498370 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf39695-68f9-486d-a0e0-67882b15daef None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:26.500535 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f9c92e-4b3c-4c80-9cf7-6075211afe74 None admin] RBAC: Authorizing `identity:get_user(user_id=b7dac73834204f43a93e3f8aaa4dae3a)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:26.502000 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f9c92e-4b3c-4c80-9cf7-6075211afe74 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:26.504029 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 148/301] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Jul 2 03:16:26 2022] GET /identity/v3/users/b7dac73834204f43a93e3f8aaa4dae3a => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:26.509560 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f9c92e-4b3c-4c80-9cf7-6075211afe74 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:26.535454 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c879ce78-b3d8-4740-b547-cd343dd1f13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:26.536673 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879ce78-b3d8-4740-b547-cd343dd1f13c None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:26.537242 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879ce78-b3d8-4740-b547-cd343dd1f13c None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:26.537727 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879ce78-b3d8-4740-b547-cd343dd1f13c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:26.539174 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c879ce78-b3d8-4740-b547-cd343dd1f13c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:26.541089 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c879ce78-b3d8-4740-b547-cd343dd1f13c None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:26.548155 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 154/302] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:16:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:16:26.549244 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c879ce78-b3d8-4740-b547-cd343dd1f13c None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:26.610735 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f9c92e-4b3c-4c80-9cf7-6075211afe74 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:26.615827 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:26.640721 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:26.646707 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10709077-fed4-45e5-80bc-e69274dc7a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:26.647623 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10709077-fed4-45e5-80bc-e69274dc7a4d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:26.648377 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10709077-fed4-45e5-80bc-e69274dc7a4d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:26.648794 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10709077-fed4-45e5-80bc-e69274dc7a4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:26.650021 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10709077-fed4-45e5-80bc-e69274dc7a4d None admin] RBAC: Adding query filter params (role.id=e7cdb23960ca4be7a9cd4c7685029db0, user.id=b7dac73834204f43a93e3f8aaa4dae3a, scope.system=all) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:26.650436 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10709077-fed4-45e5-80bc-e69274dc7a4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:26.652035 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10709077-fed4-45e5-80bc-e69274dc7a4d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:26.663798 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 149/303] 10.222.0.60 () {56 vars in 1308 bytes} [Sat Jul 2 03:16:26 2022] GET /identity/v3/role_assignments?user.id=b7dac73834204f43a93e3f8aaa4dae3a&scope.system=all&role.id=e7cdb23960ca4be7a9cd4c7685029db0 => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:16:26.671223 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c879ce78-b3d8-4740-b547-cd343dd1f13c None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:26.712035 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af1567-6e51-41da-8489-c2ed3c0dce69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:26.712730 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af1567-6e51-41da-8489-c2ed3c0dce69 None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:26.713010 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af1567-6e51-41da-8489-c2ed3c0dce69 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:26.713281 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af1567-6e51-41da-8489-c2ed3c0dce69 None admin] PATH_INFO: `/v3/groups` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:26.714054 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98af1567-6e51-41da-8489-c2ed3c0dce69 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:26.715584 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98af1567-6e51-41da-8489-c2ed3c0dce69 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:26.734425 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 155/304] 10.222.0.60 () {60 vars in 1134 bytes} [Sat Jul 2 03:16:26 2022] POST /identity/v3/groups => generated 229 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:16:26.807237 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0466388-f40b-43fc-929c-8baf8515cb40 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:26.807582 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0466388-f40b-43fc-929c-8baf8515cb40 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:26.807856 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0466388-f40b-43fc-929c-8baf8515cb40 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:26.809653 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 150/305] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:16:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:16:26.815844 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2faeaf4-436a-41e5-b474-24fddf38ed9d None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:26.816155 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2faeaf4-436a-41e5-b474-24fddf38ed9d None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:26.816408 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2faeaf4-436a-41e5-b474-24fddf38ed9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:26.838945 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-d2faeaf4-436a-41e5-b474-24fddf38ed9d None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:16:26.840255 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-d2faeaf4-436a-41e5-b474-24fddf38ed9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:16:26.913853 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 156/306] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:16:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 03:16:26.940433 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0466388-f40b-43fc-929c-8baf8515cb40 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:27.045537 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0466388-f40b-43fc-929c-8baf8515cb40 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:27.086774 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce2d945-277e-436d-b0a9-b7203d20a98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:27.087621 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce2d945-277e-436d-b0a9-b7203d20a98b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:27.087905 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce2d945-277e-436d-b0a9-b7203d20a98b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:27.088186 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce2d945-277e-436d-b0a9-b7203d20a98b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:27.098972 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce2d945-277e-436d-b0a9-b7203d20a98b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:16:27.106737 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-fce2d945-277e-436d-b0a9-b7203d20a98b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 02 03:16:27.106737 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:27.106737 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:27.106737 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:27.106737 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:27.106737 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:27.106737 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:27.106737 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:27.106737 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:27.106737 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:27.106737 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:27.106737 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:27.106737 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:16:27.106737 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:16:27.106737 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:16:27.106737 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:16:27.107611 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:16:27.107611 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:16:27.107611 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:16:27.107611 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:16:27.107611 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:27.107611 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:27.107611 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:27.107611 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:27.107611 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:27.107611 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:27.107611 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:27.107611 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:27.107611 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:27.107611 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:27.107611 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:27.107611 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:27.108393 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:27.108393 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:27.108393 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:27.108393 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:27.108393 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:16:27.108393 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:16:27.108393 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:16:27.108393 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:16:27.108393 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:16:27.108393 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:16:27.108393 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 02 03:16:27.108393 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:16:27.108393 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 151/307] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Jul 2 03:16:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:16:27.115463 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2faeaf4-436a-41e5-b474-24fddf38ed9d None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:27.167863 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:27.218838 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2faeaf4-436a-41e5-b474-24fddf38ed9d None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:27.254197 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c099ccf-4664-4c18-984c-9d6fd2b02ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:27.255378 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c099ccf-4664-4c18-984c-9d6fd2b02ccc None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:27.255892 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c099ccf-4664-4c18-984c-9d6fd2b02ccc None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:27.256356 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c099ccf-4664-4c18-984c-9d6fd2b02ccc None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:27.257314 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c099ccf-4664-4c18-984c-9d6fd2b02ccc None admin] RBAC: Adding query filter params (name=member) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:27.257631 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c099ccf-4664-4c18-984c-9d6fd2b02ccc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:27.259024 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c099ccf-4664-4c18-984c-9d6fd2b02ccc None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:27.269700 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 157/308] 10.222.0.60 () {56 vars in 1101 bytes} [Sat Jul 2 03:16:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:27.276556 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce2d945-277e-436d-b0a9-b7203d20a98b None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:27.335304 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:27.385739 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce2d945-277e-436d-b0a9-b7203d20a98b None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:27.420946 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c613b594-0b6b-4865-be26-c0158beac710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:27.421733 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c613b594-0b6b-4865-be26-c0158beac710 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:27.422010 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c613b594-0b6b-4865-be26-c0158beac710 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:27.422283 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c613b594-0b6b-4865-be26-c0158beac710 None admin] PATH_INFO: `/v3/users/a538897a433b4c378fefd40a54c0644a` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:27.423521 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c613b594-0b6b-4865-be26-c0158beac710 None admin] RBAC: Authorizing `identity:get_user(user_id=a538897a433b4c378fefd40a54c0644a)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:27.424972 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c613b594-0b6b-4865-be26-c0158beac710 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:27.426738 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 152/309] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Jul 2 03:16:27 2022] GET /identity/v3/users/a538897a433b4c378fefd40a54c0644a => generated 293 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:27.432356 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c099ccf-4664-4c18-984c-9d6fd2b02ccc None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:27.535393 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c099ccf-4664-4c18-984c-9d6fd2b02ccc None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:27.536332 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920d85b-91eb-40c0-a5ce-444cf7aec0c6 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:27.536621 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920d85b-91eb-40c0-a5ce-444cf7aec0c6 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:27.536895 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920d85b-91eb-40c0-a5ce-444cf7aec0c6 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:27.538542 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 153/310] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:16:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:16:27.543706 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64f859-65ed-4ddf-9d7f-b382a9bd7194 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:27.543983 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64f859-65ed-4ddf-9d7f-b382a9bd7194 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:27.544388 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64f859-65ed-4ddf-9d7f-b382a9bd7194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:27.546696 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:27.567463 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-df64f859-65ed-4ddf-9d7f-b382a9bd7194 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:16:27.569628 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-df64f859-65ed-4ddf-9d7f-b382a9bd7194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:16:27.573477 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0bc478-bc90-4bd9-bd59-eeb992e529c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:27.574344 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0bc478-bc90-4bd9-bd59-eeb992e529c9 None admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:27.574625 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0bc478-bc90-4bd9-bd59-eeb992e529c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:27.574898 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0bc478-bc90-4bd9-bd59-eeb992e529c9 None admin] PATH_INFO: `/v3/system/users/a538897a433b4c378fefd40a54c0644a/roles/c43aada0326446c4ade0ab1262918fa4` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:27.576610 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0bc478-bc90-4bd9-bd59-eeb992e529c9 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a538897a433b4c378fefd40a54c0644a, role_id=c43aada0326446c4ade0ab1262918fa4)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:27.578137 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0bc478-bc90-4bd9-bd59-eeb992e529c9 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:27.589272 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 158/311] 10.222.0.60 () {58 vars in 1334 bytes} [Sat Jul 2 03:16:27 2022] PUT /identity/v3/system/users/a538897a433b4c378fefd40a54c0644a/roles/c43aada0326446c4ade0ab1262918fa4 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:16:27.651242 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 154/312] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:16:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 02 03:16:27.674799 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0bc478-bc90-4bd9-bd59-eeb992e529c9 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:27.789447 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0bc478-bc90-4bd9-bd59-eeb992e529c9 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:27.825497 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27b4f69-ecd8-40c6-ba63-f4abae92d5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:27.826307 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b4f69-ecd8-40c6-ba63-f4abae92d5d1 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:27.826590 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b4f69-ecd8-40c6-ba63-f4abae92d5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:27.826863 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b4f69-ecd8-40c6-ba63-f4abae92d5d1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:27.838886 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27b4f69-ecd8-40c6-ba63-f4abae92d5d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:16:27.846983 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-d27b4f69-ecd8-40c6-ba63-f4abae92d5d1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 02 03:16:27.846983 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:27.846983 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:27.846983 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:27.846983 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:27.846983 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:27.846983 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:27.846983 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:27.846983 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:27.846983 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:27.846983 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:27.846983 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:27.846983 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:16:27.846983 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:16:27.846983 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:16:27.846983 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:16:27.847935 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:16:27.847935 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:16:27.847935 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:16:27.847935 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:16:27.847935 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:27.847935 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:27.847935 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:27.847935 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:27.847935 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:27.847935 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:27.847935 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:27.847935 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:27.847935 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:27.847935 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:27.847935 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:27.847935 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:27.848709 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:27.848709 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:27.848709 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:27.848709 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:27.848709 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:16:27.848709 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:16:27.848709 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:16:27.848709 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:16:27.848709 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:16:27.848709 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:16:27.848709 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 02 03:16:27.848709 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:16:27.849301 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 159/313] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Jul 2 03:16:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:16:27.854575 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df64f859-65ed-4ddf-9d7f-b382a9bd7194 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:27.910724 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:27.955963 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df64f859-65ed-4ddf-9d7f-b382a9bd7194 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:27.991822 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ce541e-eba4-486e-b3d2-4d0fd35bc6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:27.992491 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce541e-eba4-486e-b3d2-4d0fd35bc6c7 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:27.992768 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce541e-eba4-486e-b3d2-4d0fd35bc6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:27.993035 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce541e-eba4-486e-b3d2-4d0fd35bc6c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:27.993787 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ce541e-eba4-486e-b3d2-4d0fd35bc6c7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:27.994090 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ce541e-eba4-486e-b3d2-4d0fd35bc6c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:27.995494 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ce541e-eba4-486e-b3d2-4d0fd35bc6c7 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:28.004214 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 155/314] 10.222.0.60 () {56 vars in 1101 bytes} [Sat Jul 2 03:16:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:28.009735 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27b4f69-ecd8-40c6-ba63-f4abae92d5d1 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:28.045138 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:28.113286 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27b4f69-ecd8-40c6-ba63-f4abae92d5d1 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:28.146354 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a0d295-dfd9-4067-b6bb-89023bb4a753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:28.147256 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0d295-dfd9-4067-b6bb-89023bb4a753 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:28.147533 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0d295-dfd9-4067-b6bb-89023bb4a753 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:28.147803 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0d295-dfd9-4067-b6bb-89023bb4a753 None admin] PATH_INFO: `/v3/users/8d729af1811d4baba13d254da1b7e04d` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:28.148979 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a0d295-dfd9-4067-b6bb-89023bb4a753 None admin] RBAC: Authorizing `identity:get_user(user_id=8d729af1811d4baba13d254da1b7e04d)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:28.150424 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a0d295-dfd9-4067-b6bb-89023bb4a753 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:28.152377 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 160/315] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Jul 2 03:16:28 2022] GET /identity/v3/users/8d729af1811d4baba13d254da1b7e04d => generated 297 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:28.157825 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ce541e-eba4-486e-b3d2-4d0fd35bc6c7 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:28.255911 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ce541e-eba4-486e-b3d2-4d0fd35bc6c7 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:28.272104 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:28.289372 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4866c8-09bf-4a67-8b87-be6512396c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:28.290022 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4866c8-09bf-4a67-8b87-be6512396c42 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:28.290548 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4866c8-09bf-4a67-8b87-be6512396c42 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:28.290830 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4866c8-09bf-4a67-8b87-be6512396c42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:28.367267 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4866c8-09bf-4a67-8b87-be6512396c42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:28.368743 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4866c8-09bf-4a67-8b87-be6512396c42 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:28.466938 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 156/316] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Jul 2 03:16:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 03:16:28.472481 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a0d295-dfd9-4067-b6bb-89023bb4a753 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:28.572232 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a0d295-dfd9-4067-b6bb-89023bb4a753 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:28.573681 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:28.606522 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd0a4e0-3f2f-430f-8ac4-6eb6430732e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:28.607439 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0a4e0-3f2f-430f-8ac4-6eb6430732e7 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:28.607711 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0a4e0-3f2f-430f-8ac4-6eb6430732e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:28.607976 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0a4e0-3f2f-430f-8ac4-6eb6430732e7 None admin] PATH_INFO: `/v3/projects/d260f7a9c3984a7d8d4d7f5aa78dcc78` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:28.609159 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd0a4e0-3f2f-430f-8ac4-6eb6430732e7 None admin] RBAC: Authorizing `identity:get_project(project_id=d260f7a9c3984a7d8d4d7f5aa78dcc78)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:28.610604 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd0a4e0-3f2f-430f-8ac4-6eb6430732e7 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:28.612632 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 161/317] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Jul 2 03:16:28 2022] GET /identity/v3/projects/d260f7a9c3984a7d8d4d7f5aa78dcc78 => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:28.618351 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4866c8-09bf-4a67-8b87-be6512396c42 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:28.635910 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:28.724684 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4866c8-09bf-4a67-8b87-be6512396c42 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:28.764389 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be3d9c-5c2a-498e-a124-2bbbf308808e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:28.765047 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be3d9c-5c2a-498e-a124-2bbbf308808e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:28.765328 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be3d9c-5c2a-498e-a124-2bbbf308808e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:28.765601 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be3d9c-5c2a-498e-a124-2bbbf308808e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:28.766443 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02be3d9c-5c2a-498e-a124-2bbbf308808e None admin] RBAC: Adding query filter params (role.id=e7cdb23960ca4be7a9cd4c7685029db0, scope.project.id=d260f7a9c3984a7d8d4d7f5aa78dcc78, user.id=8d729af1811d4baba13d254da1b7e04d) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:28.766751 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02be3d9c-5c2a-498e-a124-2bbbf308808e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:28.768248 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02be3d9c-5c2a-498e-a124-2bbbf308808e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:28.775013 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 157/318] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Jul 2 03:16:28 2022] GET /identity/v3/role_assignments?user.id=8d729af1811d4baba13d254da1b7e04d&scope.project.id=d260f7a9c3984a7d8d4d7f5aa78dcc78&role.id=e7cdb23960ca4be7a9cd4c7685029db0 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:28.846901 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489830e-6181-43c6-984d-4171261882f3 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:28.847094 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489830e-6181-43c6-984d-4171261882f3 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:28.847372 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489830e-6181-43c6-984d-4171261882f3 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:28.848893 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 162/319] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:16:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:16:28.854745 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972faaab-0446-4552-bbf0-00c73ea8c46e None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:28.855036 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972faaab-0446-4552-bbf0-00c73ea8c46e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:28.855337 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972faaab-0446-4552-bbf0-00c73ea8c46e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:28.873983 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-972faaab-0446-4552-bbf0-00c73ea8c46e None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:16:28.875230 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-972faaab-0446-4552-bbf0-00c73ea8c46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:16:28.916429 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0abf808-cd19-4c0d-a73e-e8a2e0831144 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:28.916746 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0abf808-cd19-4c0d-a73e-e8a2e0831144 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:28.917002 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0abf808-cd19-4c0d-a73e-e8a2e0831144 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:28.918619 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 163/320] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:16:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 03:16:28.924533 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c8872-1738-4724-94c1-9a87d7db5b50 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:28.925125 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c8872-1738-4724-94c1-9a87d7db5b50 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:28.925641 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c8872-1738-4724-94c1-9a87d7db5b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:28.945699 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-d38c8872-1738-4724-94c1-9a87d7db5b50 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:16:28.948718 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-d38c8872-1738-4724-94c1-9a87d7db5b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:16:28.949153 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 158/321] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:16:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 03:16:28.977850 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972faaab-0446-4552-bbf0-00c73ea8c46e None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:28.990253 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:29.035160 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 164/322] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:16:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 02 03:16:29.056462 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c8872-1738-4724-94c1-9a87d7db5b50 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:29.094785 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972faaab-0446-4552-bbf0-00c73ea8c46e None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:29.129609 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68578a91-4633-4221-a705-a25f035ba9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:29.129846 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68578a91-4633-4221-a705-a25f035ba9f5 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:29.130080 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68578a91-4633-4221-a705-a25f035ba9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:29.130352 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68578a91-4633-4221-a705-a25f035ba9f5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:29.140646 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68578a91-4633-4221-a705-a25f035ba9f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:16:29.148402 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-68578a91-4633-4221-a705-a25f035ba9f5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 02 03:16:29.148402 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:29.148402 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:29.148402 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:29.148402 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:29.148402 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:29.148402 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:29.148402 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:29.148402 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:29.148402 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:29.148402 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:29.148402 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:29.148402 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:16:29.148402 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:16:29.148402 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:16:29.148402 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:16:29.149257 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:16:29.149257 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:16:29.149257 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:16:29.149257 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:16:29.149257 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:29.149257 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:29.149257 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:29.149257 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:29.149257 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:29.149257 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:29.149257 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:29.149257 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:29.149257 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:29.149257 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:29.149257 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:29.149257 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:29.150009 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:29.150009 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:29.150009 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:29.150009 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:29.150009 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:16:29.150009 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:16:29.150009 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:16:29.150009 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:16:29.150009 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:16:29.150009 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:16:29.150009 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 02 03:16:29.150009 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:16:29.150009 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 159/323] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Jul 2 03:16:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 03:16:29.155737 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68578a91-4633-4221-a705-a25f035ba9f5 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:29.161385 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:29.164148 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c8872-1738-4724-94c1-9a87d7db5b50 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:29.200338 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375cf8e5-df9a-44df-97da-92b6bda39679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:29.201135 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375cf8e5-df9a-44df-97da-92b6bda39679 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:29.201412 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375cf8e5-df9a-44df-97da-92b6bda39679 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:29.201684 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375cf8e5-df9a-44df-97da-92b6bda39679 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:29.202838 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375cf8e5-df9a-44df-97da-92b6bda39679 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:29.204335 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375cf8e5-df9a-44df-97da-92b6bda39679 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:29.206284 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 165/324] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:16:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:16:29.211524 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375cf8e5-df9a-44df-97da-92b6bda39679 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:29.234612 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:29.270340 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68578a91-4633-4221-a705-a25f035ba9f5 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:29.311534 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b836b55-4de0-4d2a-9df0-e0d35ca7cfaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:29.312210 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b836b55-4de0-4d2a-9df0-e0d35ca7cfaf None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:29.312489 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b836b55-4de0-4d2a-9df0-e0d35ca7cfaf None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:29.312758 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b836b55-4de0-4d2a-9df0-e0d35ca7cfaf None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:29.313510 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b836b55-4de0-4d2a-9df0-e0d35ca7cfaf None admin] RBAC: Adding query filter params (name=reader) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:29.313816 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b836b55-4de0-4d2a-9df0-e0d35ca7cfaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:29.314086 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375cf8e5-df9a-44df-97da-92b6bda39679 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:29.315214 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b836b55-4de0-4d2a-9df0-e0d35ca7cfaf None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:29.323763 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 160/325] 10.222.0.60 () {56 vars in 1101 bytes} [Sat Jul 2 03:16:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:16:29.329106 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b836b55-4de0-4d2a-9df0-e0d35ca7cfaf None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:29.350559 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc8ebb-b912-43f0-8a5d-f3cc98cf8e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:29.351261 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc8ebb-b912-43f0-8a5d-f3cc98cf8e0a None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:29.351535 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc8ebb-b912-43f0-8a5d-f3cc98cf8e0a None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:29.351808 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc8ebb-b912-43f0-8a5d-f3cc98cf8e0a None admin] PATH_INFO: `/v3/groups` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:29.352595 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc8ebb-b912-43f0-8a5d-f3cc98cf8e0a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:29.354025 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc8ebb-b912-43f0-8a5d-f3cc98cf8e0a None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:29.372027 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 166/326] 10.222.0.60 () {60 vars in 1134 bytes} [Sat Jul 2 03:16:29 2022] POST /identity/v3/groups => generated 226 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 03:16:29.453662 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b836b55-4de0-4d2a-9df0-e0d35ca7cfaf None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:29.486616 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:29.493237 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d230f77-54b2-4c64-880e-eb539423e87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:29.494154 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d230f77-54b2-4c64-880e-eb539423e87b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:29.494441 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d230f77-54b2-4c64-880e-eb539423e87b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:29.494719 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d230f77-54b2-4c64-880e-eb539423e87b None admin] PATH_INFO: `/v3/users/b7dac73834204f43a93e3f8aaa4dae3a` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:29.496156 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d230f77-54b2-4c64-880e-eb539423e87b None admin] RBAC: Authorizing `identity:get_user(user_id=b7dac73834204f43a93e3f8aaa4dae3a)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:29.497773 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d230f77-54b2-4c64-880e-eb539423e87b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:29.499691 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 161/327] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Jul 2 03:16:29 2022] GET /identity/v3/users/b7dac73834204f43a93e3f8aaa4dae3a => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:16:29.505441 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc8ebb-b912-43f0-8a5d-f3cc98cf8e0a None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:29.536866 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:29.615478 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc8ebb-b912-43f0-8a5d-f3cc98cf8e0a None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:29.652782 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec603c2b-6348-4487-b874-1dbde2fdd9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:29.654006 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec603c2b-6348-4487-b874-1dbde2fdd9aa None admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:29.654467 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec603c2b-6348-4487-b874-1dbde2fdd9aa None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:29.654938 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec603c2b-6348-4487-b874-1dbde2fdd9aa None admin] PATH_INFO: `/v3/system/users/b7dac73834204f43a93e3f8aaa4dae3a/roles/e7cdb23960ca4be7a9cd4c7685029db0` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:29.656658 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec603c2b-6348-4487-b874-1dbde2fdd9aa None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b7dac73834204f43a93e3f8aaa4dae3a, role_id=e7cdb23960ca4be7a9cd4c7685029db0)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:29.658217 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec603c2b-6348-4487-b874-1dbde2fdd9aa None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:29.667167 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 167/328] 10.222.0.60 () {58 vars in 1334 bytes} [Sat Jul 2 03:16:29 2022] PUT /identity/v3/system/users/b7dac73834204f43a93e3f8aaa4dae3a/roles/e7cdb23960ca4be7a9cd4c7685029db0 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:16:29.673018 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721da77e-2641-44e7-b59a-6c0b9be01c56 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:29.673354 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721da77e-2641-44e7-b59a-6c0b9be01c56 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:29.673588 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721da77e-2641-44e7-b59a-6c0b9be01c56 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:29.675275 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 162/329] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:16:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:16:29.681274 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a7e05-4694-44a2-b278-47ac7e8aef7b None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:29.681609 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a7e05-4694-44a2-b278-47ac7e8aef7b None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:29.681840 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a7e05-4694-44a2-b278-47ac7e8aef7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:29.701335 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-bc8a7e05-4694-44a2-b278-47ac7e8aef7b None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:16:29.702621 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-bc8a7e05-4694-44a2-b278-47ac7e8aef7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:16:29.781696 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 168/330] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:16:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 03:16:29.805788 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721da77e-2641-44e7-b59a-6c0b9be01c56 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:29.930884 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721da77e-2641-44e7-b59a-6c0b9be01c56 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:29.966859 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b9e5e6-15fe-4b43-8d39-d3950472e97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:29.967690 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9e5e6-15fe-4b43-8d39-d3950472e97c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:29.967969 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9e5e6-15fe-4b43-8d39-d3950472e97c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:29.968241 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9e5e6-15fe-4b43-8d39-d3950472e97c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:29.979419 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b9e5e6-15fe-4b43-8d39-d3950472e97c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:16:29.987777 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-32b9e5e6-15fe-4b43-8d39-d3950472e97c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 02 03:16:29.987777 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:29.987777 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:29.987777 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:29.987777 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:29.987777 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:29.987777 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:29.987777 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:29.987777 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:29.987777 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:29.987777 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:29.987777 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:29.987777 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:16:29.987777 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:16:29.987777 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:16:29.987777 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:16:29.988632 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:16:29.988632 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:16:29.988632 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:16:29.988632 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:16:29.988632 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:29.988632 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:29.988632 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:29.988632 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:29.988632 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:29.988632 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:29.988632 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:29.988632 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:29.988632 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:29.988632 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:29.988632 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:29.988632 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:29.989398 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:29.989398 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:29.989398 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:29.989398 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:29.989398 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:16:29.989398 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:16:29.989398 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:16:29.989398 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:16:29.989398 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:16:29.989398 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:16:29.989398 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 02 03:16:29.989398 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:16:29.989398 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 163/331] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Jul 2 03:16:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:16:29.995357 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a7e05-4694-44a2-b278-47ac7e8aef7b None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:30.023629 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:30.121400 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a7e05-4694-44a2-b278-47ac7e8aef7b None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:30.158328 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc404a9-3cae-45cb-8dbe-95ff381f72d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:30.159016 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc404a9-3cae-45cb-8dbe-95ff381f72d3 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:30.159328 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc404a9-3cae-45cb-8dbe-95ff381f72d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:30.159605 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc404a9-3cae-45cb-8dbe-95ff381f72d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:30.160372 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc404a9-3cae-45cb-8dbe-95ff381f72d3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:30.160680 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc404a9-3cae-45cb-8dbe-95ff381f72d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:30.162071 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc404a9-3cae-45cb-8dbe-95ff381f72d3 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:30.172238 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 169/332] 10.222.0.60 () {56 vars in 1101 bytes} [Sat Jul 2 03:16:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:30.177896 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b9e5e6-15fe-4b43-8d39-d3950472e97c None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:30.251206 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:30.300981 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b9e5e6-15fe-4b43-8d39-d3950472e97c None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:30.341046 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cc44c4-5f6d-48c2-ac58-892bba5fca03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:30.341937 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc44c4-5f6d-48c2-ac58-892bba5fca03 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:30.342231 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc44c4-5f6d-48c2-ac58-892bba5fca03 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:30.342494 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc44c4-5f6d-48c2-ac58-892bba5fca03 None admin] PATH_INFO: `/v3/users/a538897a433b4c378fefd40a54c0644a` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:30.343780 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cc44c4-5f6d-48c2-ac58-892bba5fca03 None admin] RBAC: Authorizing `identity:get_user(user_id=a538897a433b4c378fefd40a54c0644a)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:30.345243 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cc44c4-5f6d-48c2-ac58-892bba5fca03 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:30.351254 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 164/333] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Jul 2 03:16:30 2022] GET /identity/v3/users/a538897a433b4c378fefd40a54c0644a => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:30.353063 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc404a9-3cae-45cb-8dbe-95ff381f72d3 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:30.490737 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:30.508033 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc404a9-3cae-45cb-8dbe-95ff381f72d3 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:30.549133 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8745a5d5-81d9-4532-982e-3ab41fba5785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:30.550130 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8745a5d5-81d9-4532-982e-3ab41fba5785 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:30.550597 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8745a5d5-81d9-4532-982e-3ab41fba5785 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:30.551088 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8745a5d5-81d9-4532-982e-3ab41fba5785 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:30.552166 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8745a5d5-81d9-4532-982e-3ab41fba5785 None admin] RBAC: Adding query filter params (role.id=c43aada0326446c4ade0ab1262918fa4, user.id=a538897a433b4c378fefd40a54c0644a, scope.system=all) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:30.552664 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8745a5d5-81d9-4532-982e-3ab41fba5785 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:30.554294 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8745a5d5-81d9-4532-982e-3ab41fba5785 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:30.570109 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 170/334] 10.222.0.60 () {56 vars in 1308 bytes} [Sat Jul 2 03:16:30 2022] GET /identity/v3/role_assignments?user.id=a538897a433b4c378fefd40a54c0644a&scope.system=all&role.id=c43aada0326446c4ade0ab1262918fa4 => generated 510 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:31.881782 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f553414-b1dd-4dd5-a27d-e28896e4dee4 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:31.882310 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f553414-b1dd-4dd5-a27d-e28896e4dee4 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:31.882310 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f553414-b1dd-4dd5-a27d-e28896e4dee4 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:31.884177 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 165/335] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:16:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:16:31.889811 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b855f0-59ed-4160-aa5b-c41969e8f221 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:31.890233 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b855f0-59ed-4160-aa5b-c41969e8f221 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:31.890416 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b855f0-59ed-4160-aa5b-c41969e8f221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:31.907984 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-98b855f0-59ed-4160-aa5b-c41969e8f221 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:16:31.909204 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-98b855f0-59ed-4160-aa5b-c41969e8f221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:16:31.976095 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a72afd-cd37-4a2a-b216-a7d2368e13ae None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:31.976378 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a72afd-cd37-4a2a-b216-a7d2368e13ae None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:31.976656 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a72afd-cd37-4a2a-b216-a7d2368e13ae None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:31.978455 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 166/336] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:16:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:16:31.983042 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 171/337] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:16:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 03:16:31.983332 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edadccf-6dce-4051-bf04-16b2484d5f6c None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:31.983617 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edadccf-6dce-4051-bf04-16b2484d5f6c None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:31.983891 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edadccf-6dce-4051-bf04-16b2484d5f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:32.007815 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b855f0-59ed-4160-aa5b-c41969e8f221 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:32.010758 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-6edadccf-6dce-4051-bf04-16b2484d5f6c None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:16:32.012078 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-6edadccf-6dce-4051-bf04-16b2484d5f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:16:32.102327 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:32.147683 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 167/338] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:16:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 03:16:32.147865 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b855f0-59ed-4160-aa5b-c41969e8f221 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:32.202375 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edadccf-6dce-4051-bf04-16b2484d5f6c None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:32.203861 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d559bf1-f95b-429c-87ea-fcddf92720ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:32.204756 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d559bf1-f95b-429c-87ea-fcddf92720ed None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:32.205041 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d559bf1-f95b-429c-87ea-fcddf92720ed None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:32.207151 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d559bf1-f95b-429c-87ea-fcddf92720ed None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:32.224677 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d559bf1-f95b-429c-87ea-fcddf92720ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:16:32.239102 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-4d559bf1-f95b-429c-87ea-fcddf92720ed None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 02 03:16:32.239102 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:32.239102 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:32.239102 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:32.239102 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:32.239102 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:32.239102 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:32.239102 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:32.239102 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:32.239102 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:32.239102 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:32.239102 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:32.239102 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:16:32.239102 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:16:32.239102 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:16:32.239102 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:16:32.240176 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:16:32.240176 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:16:32.240176 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:16:32.240176 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:16:32.240176 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:32.240176 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:32.240176 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:32.240176 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:32.240176 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:32.240176 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:32.240176 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:32.240176 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:32.240176 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:32.240176 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:32.240176 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:32.240176 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:32.240968 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:32.240968 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:32.240968 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:32.240968 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:32.240968 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:16:32.240968 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:16:32.240968 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:16:32.240968 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:16:32.240968 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:16:32.240968 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:16:32.240968 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 02 03:16:32.240968 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:16:32.240968 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 172/339] 10.222.0.60 () {56 vars in 1114 bytes} [Sat Jul 2 03:16:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:16:32.247448 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d559bf1-f95b-429c-87ea-fcddf92720ed None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:32.321123 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:32.393210 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d559bf1-f95b-429c-87ea-fcddf92720ed None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:32.411447 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edadccf-6dce-4051-bf04-16b2484d5f6c None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:32.456093 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e8ebc-9d0c-473f-baae-31bc8a4b2bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:32.457331 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e8ebc-9d0c-473f-baae-31bc8a4b2bd5 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:32.457701 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e8ebc-9d0c-473f-baae-31bc8a4b2bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:32.458061 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e8ebc-9d0c-473f-baae-31bc8a4b2bd5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:32.468200 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:32.472507 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de822b-4f9a-4990-b0f9-7881927fc50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:32.473387 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de822b-4f9a-4990-b0f9-7881927fc50c None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:32.473833 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de822b-4f9a-4990-b0f9-7881927fc50c None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:32.476316 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de822b-4f9a-4990-b0f9-7881927fc50c None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:32.477278 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37de822b-4f9a-4990-b0f9-7881927fc50c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:32.477752 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37de822b-4f9a-4990-b0f9-7881927fc50c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:32.479343 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37de822b-4f9a-4990-b0f9-7881927fc50c None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:32.481777 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660e8ebc-9d0c-473f-baae-31bc8a4b2bd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:16:32.493810 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-660e8ebc-9d0c-473f-baae-31bc8a4b2bd5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 02 03:16:32.493810 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:32.493810 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:32.493810 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:32.493810 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:32.493810 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:32.493810 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:32.493810 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:32.493810 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:32.493810 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:32.493810 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:32.493810 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:32.493810 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:16:32.493810 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:16:32.493810 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:16:32.493810 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:16:32.494889 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:16:32.494889 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:16:32.494889 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:16:32.494889 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:16:32.494889 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:32.494889 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:32.494889 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:32.494889 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:32.494889 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:32.494889 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:32.494889 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:32.494889 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:32.494889 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:32.494889 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:32.494889 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:32.494889 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:32.496055 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:32.496055 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:32.496055 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:32.496055 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:32.496055 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:16:32.496055 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:16:32.496055 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:16:32.496055 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:16:32.496055 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:16:32.496055 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:16:32.496055 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 02 03:16:32.496055 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:16:32.499019 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 168/340] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Jul 2 03:16:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:16:32.503805 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 173/341] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Jul 2 03:16:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:32.507112 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e8ebc-9d0c-473f-baae-31bc8a4b2bd5 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:32.509045 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de822b-4f9a-4990-b0f9-7881927fc50c None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:32.683611 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de822b-4f9a-4990-b0f9-7881927fc50c None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:32.688004 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e8ebc-9d0c-473f-baae-31bc8a4b2bd5 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:32.715588 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:32.732089 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe154a-2eed-4aeb-a0f4-cba26e6b149d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:32.733196 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe154a-2eed-4aeb-a0f4-cba26e6b149d None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:32.733747 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe154a-2eed-4aeb-a0f4-cba26e6b149d None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:32.734229 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe154a-2eed-4aeb-a0f4-cba26e6b149d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:32.744458 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e590703-840e-4fc6-a42b-3a5ab7cdd002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:32.745148 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e590703-840e-4fc6-a42b-3a5ab7cdd002 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:32.745430 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e590703-840e-4fc6-a42b-3a5ab7cdd002 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:32.745708 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e590703-840e-4fc6-a42b-3a5ab7cdd002 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:32.746606 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e590703-840e-4fc6-a42b-3a5ab7cdd002 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:32.746917 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e590703-840e-4fc6-a42b-3a5ab7cdd002 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:32.748414 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e590703-840e-4fc6-a42b-3a5ab7cdd002 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:32.769838 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 169/342] 10.222.0.60 () {56 vars in 1101 bytes} [Sat Jul 2 03:16:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:32.771769 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e3e081-77a3-4af3-b8cf-8a15b0d29594 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:32.772268 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e3e081-77a3-4af3-b8cf-8a15b0d29594 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:32.772743 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e3e081-77a3-4af3-b8cf-8a15b0d29594 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:32.774367 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 170/343] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:16:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:16:32.776815 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e3e081-77a3-4af3-b8cf-8a15b0d29594 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:32.843498 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:32.845754 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fe154a-2eed-4aeb-a0f4-cba26e6b149d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:32.847520 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fe154a-2eed-4aeb-a0f4-cba26e6b149d None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:32.914049 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e3e081-77a3-4af3-b8cf-8a15b0d29594 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:32.954812 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9284f31f-b247-484c-b15c-b5eb8bfe703e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:32.956110 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9284f31f-b247-484c-b15c-b5eb8bfe703e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:32.956612 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9284f31f-b247-484c-b15c-b5eb8bfe703e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:32.961149 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 174/344] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Jul 2 03:16:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 03:16:32.961149 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0f7e7-965b-4a19-81d9-f65a56aa498d None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:32.961149 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0f7e7-965b-4a19-81d9-f65a56aa498d None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:32.961149 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0f7e7-965b-4a19-81d9-f65a56aa498d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:32.961774 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9284f31f-b247-484c-b15c-b5eb8bfe703e None admin] PATH_INFO: `/v3/users/b7dac73834204f43a93e3f8aaa4dae3a` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:32.963437 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9284f31f-b247-484c-b15c-b5eb8bfe703e None admin] RBAC: Authorizing `identity:get_user(user_id=b7dac73834204f43a93e3f8aaa4dae3a)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:32.966358 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9284f31f-b247-484c-b15c-b5eb8bfe703e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:32.969363 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 171/345] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Jul 2 03:16:32 2022] GET /identity/v3/users/b7dac73834204f43a93e3f8aaa4dae3a => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:32.970598 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4fe761-7e66-4496-81af-70b210c72be5 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:32.970875 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4fe761-7e66-4496-81af-70b210c72be5 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:32.971155 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4fe761-7e66-4496-81af-70b210c72be5 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:32.972434 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 172/346] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:16:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:16:32.973107 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4fe761-7e66-4496-81af-70b210c72be5 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:32.987986 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-00f0f7e7-965b-4a19-81d9-f65a56aa498d None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:16:32.990251 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-00f0f7e7-965b-4a19-81d9-f65a56aa498d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:16:33.049219 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:33.082176 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 175/347] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:16:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 03:16:33.083913 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0503502f-51b7-4fd4-97fd-4b5c40faa739 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:33.084450 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0503502f-51b7-4fd4-97fd-4b5c40faa739 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:33.085005 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0503502f-51b7-4fd4-97fd-4b5c40faa739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:33.112112 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-0503502f-51b7-4fd4-97fd-4b5c40faa739 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:16:33.113294 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-0503502f-51b7-4fd4-97fd-4b5c40faa739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:16:33.119920 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4fe761-7e66-4496-81af-70b210c72be5 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:33.138513 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:33.162075 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218bbfb5-feb6-4061-94c5-05e8507c1e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:33.163355 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218bbfb5-feb6-4061-94c5-05e8507c1e30 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:33.163836 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218bbfb5-feb6-4061-94c5-05e8507c1e30 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:33.164301 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218bbfb5-feb6-4061-94c5-05e8507c1e30 None admin] PATH_INFO: `/v3/projects/73025fb6edfa43b88c0c690d55906c19` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:33.167443 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218bbfb5-feb6-4061-94c5-05e8507c1e30 None admin] RBAC: Authorizing `identity:get_project(project_id=73025fb6edfa43b88c0c690d55906c19)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:33.169156 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218bbfb5-feb6-4061-94c5-05e8507c1e30 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:33.171140 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 173/348] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Jul 2 03:16:32 2022] GET /identity/v3/projects/73025fb6edfa43b88c0c690d55906c19 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:33.172165 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218bbfb5-feb6-4061-94c5-05e8507c1e30 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:33.204775 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 176/349] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:16:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 03:16:33.206291 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0503502f-51b7-4fd4-97fd-4b5c40faa739 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:33.306364 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218bbfb5-feb6-4061-94c5-05e8507c1e30 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:33.325279 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:33.345079 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0503502f-51b7-4fd4-97fd-4b5c40faa739 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:33.347580 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2791e5a-0870-45bf-9bb4-adbef3aaec98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:33.348470 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2791e5a-0870-45bf-9bb4-adbef3aaec98 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:33.348950 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2791e5a-0870-45bf-9bb4-adbef3aaec98 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:33.349420 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2791e5a-0870-45bf-9bb4-adbef3aaec98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:33.350564 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2791e5a-0870-45bf-9bb4-adbef3aaec98 None admin] RBAC: Adding query filter params (role.id=e7cdb23960ca4be7a9cd4c7685029db0, user.id=b7dac73834204f43a93e3f8aaa4dae3a, scope.system=all) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:33.351073 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2791e5a-0870-45bf-9bb4-adbef3aaec98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:33.352752 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2791e5a-0870-45bf-9bb4-adbef3aaec98 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:33.371267 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 174/350] 10.222.0.60 () {56 vars in 1308 bytes} [Sat Jul 2 03:16:33 2022] GET /identity/v3/role_assignments?user.id=b7dac73834204f43a93e3f8aaa4dae3a&scope.system=all&role.id=e7cdb23960ca4be7a9cd4c7685029db0 => generated 510 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:33.373518 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2791e5a-0870-45bf-9bb4-adbef3aaec98 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:33.398611 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df87cb40-85c3-4437-920a-14104bd798fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:33.399730 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87cb40-85c3-4437-920a-14104bd798fb None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:33.400063 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87cb40-85c3-4437-920a-14104bd798fb None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:33.400345 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87cb40-85c3-4437-920a-14104bd798fb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:33.414871 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df87cb40-85c3-4437-920a-14104bd798fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:16:33.425566 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-df87cb40-85c3-4437-920a-14104bd798fb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 02 03:16:33.425566 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:33.425566 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:33.425566 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:33.425566 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:33.425566 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:33.425566 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:33.425566 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:33.425566 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:33.425566 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:33.425566 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:33.425566 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:33.425566 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:16:33.425566 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:16:33.425566 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:16:33.425566 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:16:33.426546 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:16:33.426546 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:16:33.426546 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:16:33.426546 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:16:33.426546 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:33.426546 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:33.426546 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:33.426546 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:33.426546 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:33.426546 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:33.426546 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:33.426546 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:33.426546 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:33.426546 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:33.426546 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:33.426546 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:33.427850 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:33.427850 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:33.427850 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:33.427850 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:33.427850 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:16:33.427850 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:16:33.427850 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:16:33.427850 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:16:33.427850 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:16:33.427850 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:16:33.427850 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 02 03:16:33.427850 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:16:33.431835 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 177/351] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Jul 2 03:16:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:16:33.433122 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df87cb40-85c3-4437-920a-14104bd798fb None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:33.453475 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:33.561668 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df87cb40-85c3-4437-920a-14104bd798fb None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:33.565084 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2791e5a-0870-45bf-9bb4-adbef3aaec98 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:33.631905 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cad838-6af4-4c73-bd86-badfe133c2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:33.633040 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cad838-6af4-4c73-bd86-badfe133c2b6 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:33.633461 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cad838-6af4-4c73-bd86-badfe133c2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:33.633968 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cad838-6af4-4c73-bd86-badfe133c2b6 None admin] PATH_INFO: `/v3/groups/9ee0b4fa223c4863976bbbbc81d20df2` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:33.641458 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cad838-6af4-4c73-bd86-badfe133c2b6 None admin] RBAC: Authorizing `identity:get_group(group_id=9ee0b4fa223c4863976bbbbc81d20df2)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:33.643227 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cad838-6af4-4c73-bd86-badfe133c2b6 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:33.645772 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 175/352] 10.222.0.60 () {56 vars in 1180 bytes} [Sat Jul 2 03:16:33 2022] GET /identity/v3/groups/9ee0b4fa223c4863976bbbbc81d20df2 => generated 226 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:33.646787 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cad838-6af4-4c73-bd86-badfe133c2b6 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:33.649482 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961cf45a-063e-40cb-942e-63e13adce067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:33.649482 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961cf45a-063e-40cb-942e-63e13adce067 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:33.649482 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961cf45a-063e-40cb-942e-63e13adce067 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:33.649482 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961cf45a-063e-40cb-942e-63e13adce067 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:33.680108 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961cf45a-063e-40cb-942e-63e13adce067 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:16:33.688025 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-961cf45a-063e-40cb-942e-63e13adce067 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 02 03:16:33.688025 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:33.688025 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:33.688025 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:33.688025 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:33.688025 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:33.688025 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:33.688025 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:33.688025 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:33.688025 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:33.688025 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:33.688025 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:33.688025 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:16:33.688025 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:16:33.688025 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:16:33.688025 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:16:33.689094 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:16:33.689094 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:16:33.689094 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:16:33.689094 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:16:33.689094 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:33.689094 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:33.689094 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:33.689094 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:33.689094 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:33.689094 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:33.689094 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:33.689094 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:33.689094 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:33.689094 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:33.689094 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:33.689094 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:33.690024 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:33.690024 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:33.690024 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:33.690024 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:33.690024 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:16:33.690024 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:16:33.690024 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:16:33.690024 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:16:33.690024 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:16:33.690024 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:16:33.690024 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 02 03:16:33.690024 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:16:33.692059 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 178/353] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Jul 2 03:16:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:16:33.692242 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961cf45a-063e-40cb-942e-63e13adce067 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:33.703097 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:33.792553 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cad838-6af4-4c73-bd86-badfe133c2b6 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:33.813460 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:33.856148 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c22c151-1aaa-4b30-9c56-d1f37068a11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:33.857130 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22c151-1aaa-4b30-9c56-d1f37068a11d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:33.857414 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22c151-1aaa-4b30-9c56-d1f37068a11d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:33.859406 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961cf45a-063e-40cb-942e-63e13adce067 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:33.859632 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22c151-1aaa-4b30-9c56-d1f37068a11d None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:33.860632 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c22c151-1aaa-4b30-9c56-d1f37068a11d None admin] RBAC: Adding query filter params (name=member) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:33.861386 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c22c151-1aaa-4b30-9c56-d1f37068a11d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:33.864900 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c22c151-1aaa-4b30-9c56-d1f37068a11d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:33.876438 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 176/354] 10.222.0.60 () {56 vars in 1101 bytes} [Sat Jul 2 03:16:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:33.877596 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c22c151-1aaa-4b30-9c56-d1f37068a11d None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:33.912055 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc589d-76c1-4224-ba22-f01807cf8cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:33.912055 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc589d-76c1-4224-ba22-f01807cf8cf2 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:33.912055 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc589d-76c1-4224-ba22-f01807cf8cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:33.912055 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc589d-76c1-4224-ba22-f01807cf8cf2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:33.912446 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdc589d-76c1-4224-ba22-f01807cf8cf2 None admin] RBAC: Adding query filter params (group.id=9ee0b4fa223c4863976bbbbc81d20df2, role.id=a9792a930e0c4e139f287a712dfc7d4d, scope.project.id=73025fb6edfa43b88c0c690d55906c19) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:33.912446 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdc589d-76c1-4224-ba22-f01807cf8cf2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:33.912446 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdc589d-76c1-4224-ba22-f01807cf8cf2 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:33.920074 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 179/355] 10.222.0.60 () {56 vars in 1376 bytes} [Sat Jul 2 03:16:33 2022] GET /identity/v3/role_assignments?group.id=9ee0b4fa223c4863976bbbbc81d20df2&scope.project.id=73025fb6edfa43b88c0c690d55906c19&role.id=a9792a930e0c4e139f287a712dfc7d4d => generated 260 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:33.924853 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc589d-76c1-4224-ba22-f01807cf8cf2 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:34.030530 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:34.034549 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c22c151-1aaa-4b30-9c56-d1f37068a11d None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:34.070160 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc589d-76c1-4224-ba22-f01807cf8cf2 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:34.079685 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba13efa9-4827-4828-ae8f-3e074897bf7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:34.080948 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13efa9-4827-4828-ae8f-3e074897bf7d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:34.081491 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13efa9-4827-4828-ae8f-3e074897bf7d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:34.081984 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13efa9-4827-4828-ae8f-3e074897bf7d None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:34.083103 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba13efa9-4827-4828-ae8f-3e074897bf7d None admin] RBAC: Adding query filter params (name=member) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:34.083832 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba13efa9-4827-4828-ae8f-3e074897bf7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:34.085497 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba13efa9-4827-4828-ae8f-3e074897bf7d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:34.095993 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 177/356] 10.222.0.60 () {56 vars in 1101 bytes} [Sat Jul 2 03:16:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:34.099497 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092488f9-d2de-4cf9-a119-ff4cd04e3e94 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:34.100134 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092488f9-d2de-4cf9-a119-ff4cd04e3e94 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:34.100612 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092488f9-d2de-4cf9-a119-ff4cd04e3e94 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:34.102275 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 178/357] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:16:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:16:34.110564 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca0adb-5e81-4018-8c33-3fdd8ede2f40 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:34.111235 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca0adb-5e81-4018-8c33-3fdd8ede2f40 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:34.111819 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca0adb-5e81-4018-8c33-3fdd8ede2f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:34.114421 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c1c745-33bf-4c09-b0a5-83b52a264841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:34.115205 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c1c745-33bf-4c09-b0a5-83b52a264841 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:34.115548 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c1c745-33bf-4c09-b0a5-83b52a264841 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:34.115890 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c1c745-33bf-4c09-b0a5-83b52a264841 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:34.126035 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:34.132761 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-efca0adb-5e81-4018-8c33-3fdd8ede2f40 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:16:34.134378 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-efca0adb-5e81-4018-8c33-3fdd8ede2f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:16:34.203366 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c1c745-33bf-4c09-b0a5-83b52a264841 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:34.205536 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c1c745-33bf-4c09-b0a5-83b52a264841 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:34.219519 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 179/358] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:16:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 03:16:34.220759 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efca0adb-5e81-4018-8c33-3fdd8ede2f40 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:34.342233 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:34.345447 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 180/359] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Jul 2 03:16:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 03:16:34.348287 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c1c745-33bf-4c09-b0a5-83b52a264841 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:34.354102 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efca0adb-5e81-4018-8c33-3fdd8ede2f40 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:34.399658 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a0e8f8-b58a-4ef6-ad75-b5333208d538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:34.400350 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0e8f8-b58a-4ef6-ad75-b5333208d538 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:34.400624 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0e8f8-b58a-4ef6-ad75-b5333208d538 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:34.400893 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0e8f8-b58a-4ef6-ad75-b5333208d538 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:34.402553 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:34.480503 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c1c745-33bf-4c09-b0a5-83b52a264841 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:34.493354 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a0e8f8-b58a-4ef6-ad75-b5333208d538 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:34.494840 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a0e8f8-b58a-4ef6-ad75-b5333208d538 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:34.524991 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8017b00-3f50-4ff7-b45b-9f19cf55b8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:34.525986 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8017b00-3f50-4ff7-b45b-9f19cf55b8e7 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:34.526451 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8017b00-3f50-4ff7-b45b-9f19cf55b8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:34.526724 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8017b00-3f50-4ff7-b45b-9f19cf55b8e7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:34.540175 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8017b00-3f50-4ff7-b45b-9f19cf55b8e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:16:34.548692 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-f8017b00-3f50-4ff7-b45b-9f19cf55b8e7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 02 03:16:34.548692 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:34.548692 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:34.548692 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:34.548692 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:34.548692 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:34.548692 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:34.548692 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:34.548692 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:34.548692 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:34.548692 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:34.548692 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:34.548692 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:16:34.548692 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:16:34.548692 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:16:34.548692 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:16:34.549612 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:16:34.549612 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:16:34.549612 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:16:34.549612 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:16:34.549612 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:34.549612 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:34.549612 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:34.549612 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:34.549612 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:34.549612 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:34.549612 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:34.549612 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:34.549612 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:34.549612 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:34.549612 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:34.549612 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:34.550594 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:34.550594 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:34.550594 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:34.550594 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:34.550594 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:16:34.550594 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:16:34.550594 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:16:34.550594 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:16:34.550594 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:16:34.550594 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:16:34.550594 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 02 03:16:34.550594 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:16:34.550594 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 181/360] 10.222.0.60 () {56 vars in 1114 bytes} [Sat Jul 2 03:16:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:16:34.551490 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc3bddc-e907-42a5-99a3-1734a3dac610 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:34.551490 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc3bddc-e907-42a5-99a3-1734a3dac610 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:34.551817 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc3bddc-e907-42a5-99a3-1734a3dac610 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:34.553112 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 182/361] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:16:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:16:34.553714 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc3bddc-e907-42a5-99a3-1734a3dac610 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:34.616717 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:34.633266 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 180/362] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Jul 2 03:16:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 03:16:34.634231 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a0e8f8-b58a-4ef6-ad75-b5333208d538 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:34.689082 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:34.694391 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc3bddc-e907-42a5-99a3-1734a3dac610 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:34.736146 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5b6696-be4c-459b-801d-5bbaf2221a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:34.737116 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b6696-be4c-459b-801d-5bbaf2221a6d None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:34.737396 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b6696-be4c-459b-801d-5bbaf2221a6d None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:34.737668 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b6696-be4c-459b-801d-5bbaf2221a6d None admin] PATH_INFO: `/v3/projects/73025fb6edfa43b88c0c690d55906c19` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:34.739521 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5b6696-be4c-459b-801d-5bbaf2221a6d None admin] RBAC: Authorizing `identity:get_project(project_id=73025fb6edfa43b88c0c690d55906c19)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:34.740984 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5b6696-be4c-459b-801d-5bbaf2221a6d None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:34.742727 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 183/363] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Jul 2 03:16:34 2022] GET /identity/v3/projects/73025fb6edfa43b88c0c690d55906c19 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:34.744686 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b79bf1-8bd8-405e-b3e5-75bba508531d None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:34.744968 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b79bf1-8bd8-405e-b3e5-75bba508531d None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:34.745239 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b79bf1-8bd8-405e-b3e5-75bba508531d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:34.756639 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a0e8f8-b58a-4ef6-ad75-b5333208d538 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:34.764254 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-00b79bf1-8bd8-405e-b3e5-75bba508531d None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:16:34.766289 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-00b79bf1-8bd8-405e-b3e5-75bba508531d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:16:34.798667 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb30f4a7-d6ef-466e-8726-ebb5d19ad7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:34.799536 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb30f4a7-d6ef-466e-8726-ebb5d19ad7f4 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:34.799816 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb30f4a7-d6ef-466e-8726-ebb5d19ad7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:34.800084 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb30f4a7-d6ef-466e-8726-ebb5d19ad7f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:34.800992 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb30f4a7-d6ef-466e-8726-ebb5d19ad7f4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:34.801294 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb30f4a7-d6ef-466e-8726-ebb5d19ad7f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:34.802713 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb30f4a7-d6ef-466e-8726-ebb5d19ad7f4 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:34.813918 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 181/364] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Jul 2 03:16:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:34.814732 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb30f4a7-d6ef-466e-8726-ebb5d19ad7f4 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:34.861506 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 184/365] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:16:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 03:16:34.862887 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b79bf1-8bd8-405e-b3e5-75bba508531d None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:34.889831 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:34.951068 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb30f4a7-d6ef-466e-8726-ebb5d19ad7f4 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:34.984926 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:34.994463 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b79bf1-8bd8-405e-b3e5-75bba508531d None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:34.998507 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab2703-fe5d-45c7-8a19-f73445f84bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:34.999731 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab2703-fe5d-45c7-8a19-f73445f84bfa None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:35.000239 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab2703-fe5d-45c7-8a19-f73445f84bfa None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:35.000507 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab2703-fe5d-45c7-8a19-f73445f84bfa None admin] PATH_INFO: `/v3/projects/d260f7a9c3984a7d8d4d7f5aa78dcc78` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:35.003201 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abab2703-fe5d-45c7-8a19-f73445f84bfa None admin] RBAC: Authorizing `identity:get_project(project_id=d260f7a9c3984a7d8d4d7f5aa78dcc78)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:35.004677 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abab2703-fe5d-45c7-8a19-f73445f84bfa None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:35.006724 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 182/366] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Jul 2 03:16:34 2022] GET /identity/v3/projects/d260f7a9c3984a7d8d4d7f5aa78dcc78 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:35.011884 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab2703-fe5d-45c7-8a19-f73445f84bfa None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:35.037935 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ab41d6-ef91-4d88-a321-24d099c7ad49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:35.038815 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab41d6-ef91-4d88-a321-24d099c7ad49 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:35.039095 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab41d6-ef91-4d88-a321-24d099c7ad49 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:35.039522 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab41d6-ef91-4d88-a321-24d099c7ad49 None admin] PATH_INFO: `/v3/groups/9ee0b4fa223c4863976bbbbc81d20df2` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:35.040700 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ab41d6-ef91-4d88-a321-24d099c7ad49 None admin] RBAC: Authorizing `identity:get_group(group_id=9ee0b4fa223c4863976bbbbc81d20df2)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:35.042509 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ab41d6-ef91-4d88-a321-24d099c7ad49 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:35.045247 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 185/367] 10.222.0.60 () {56 vars in 1180 bytes} [Sat Jul 2 03:16:34 2022] GET /identity/v3/groups/9ee0b4fa223c4863976bbbbc81d20df2 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:35.045247 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ab41d6-ef91-4d88-a321-24d099c7ad49 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:35.134847 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab2703-fe5d-45c7-8a19-f73445f84bfa None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:35.165752 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:35.166436 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ab41d6-ef91-4d88-a321-24d099c7ad49 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:35.180955 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f733ca6-f522-430b-a794-acb32bd28270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:35.181774 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f733ca6-f522-430b-a794-acb32bd28270 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:35.182431 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f733ca6-f522-430b-a794-acb32bd28270 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:35.182721 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f733ca6-f522-430b-a794-acb32bd28270 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:35.209423 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d6f1f7-3368-47a2-9ab5-51bc2664a312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:35.210285 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d6f1f7-3368-47a2-9ab5-51bc2664a312 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:35.210567 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d6f1f7-3368-47a2-9ab5-51bc2664a312 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:35.211344 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d6f1f7-3368-47a2-9ab5-51bc2664a312 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:35.227148 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d6f1f7-3368-47a2-9ab5-51bc2664a312 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:16:35.236540 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-50d6f1f7-3368-47a2-9ab5-51bc2664a312 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 03:16:35.236540 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:35.236540 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:35.236540 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:35.236540 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:35.236540 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:35.236540 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:35.236540 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:35.236540 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:35.236540 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:35.236540 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:35.236540 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:35.236540 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:16:35.236540 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:16:35.236540 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:16:35.236540 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:16:35.237428 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:16:35.237428 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:16:35.237428 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:16:35.237428 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:16:35.237428 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:35.237428 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:35.237428 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:35.237428 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:35.237428 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:35.237428 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:35.237428 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:35.237428 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:35.237428 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:35.237428 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:35.237428 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:35.237428 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:35.238200 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:35.238200 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:35.238200 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:35.238200 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:35.238200 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:16:35.238200 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:16:35.238200 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:16:35.238200 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:16:35.238200 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:16:35.238200 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:16:35.238200 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 03:16:35.238200 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:16:35.239329 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 186/368] 10.222.0.60 () {56 vars in 1096 bytes} [Sat Jul 2 03:16:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:16:35.239329 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d6f1f7-3368-47a2-9ab5-51bc2664a312 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:35.273441 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f733ca6-f522-430b-a794-acb32bd28270 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:35.275322 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f733ca6-f522-430b-a794-acb32bd28270 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:35.286732 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:35.395850 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d6f1f7-3368-47a2-9ab5-51bc2664a312 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:35.402612 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 183/369] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Jul 2 03:16:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 03:16:35.403692 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f733ca6-f522-430b-a794-acb32bd28270 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:35.432701 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:35.438418 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c009f-a807-4816-890c-2822bb571eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:35.439655 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c009f-a807-4816-890c-2822bb571eec None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:35.440200 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c009f-a807-4816-890c-2822bb571eec None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:35.440491 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c009f-a807-4816-890c-2822bb571eec None admin] PATH_INFO: `/v3/groups/9ee0b4fa223c4863976bbbbc81d20df2` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:35.442264 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3c009f-a807-4816-890c-2822bb571eec None admin] RBAC: Authorizing `identity:get_group(group_id=9ee0b4fa223c4863976bbbbc81d20df2)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:35.444320 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3c009f-a807-4816-890c-2822bb571eec None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:35.446311 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 187/370] 10.222.0.60 () {56 vars in 1180 bytes} [Sat Jul 2 03:16:35 2022] GET /identity/v3/groups/9ee0b4fa223c4863976bbbbc81d20df2 => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:35.447909 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c009f-a807-4816-890c-2822bb571eec None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:35.527038 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f733ca6-f522-430b-a794-acb32bd28270 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:35.558550 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:35.569526 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c009f-a807-4816-890c-2822bb571eec None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:35.575311 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3571a8-78a1-4548-8c11-9779c7438726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:35.575975 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3571a8-78a1-4548-8c11-9779c7438726 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:35.576248 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3571a8-78a1-4548-8c11-9779c7438726 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:35.576518 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3571a8-78a1-4548-8c11-9779c7438726 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:35.577353 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3571a8-78a1-4548-8c11-9779c7438726 None admin] RBAC: Adding query filter params (group.id=9ee0b4fa223c4863976bbbbc81d20df2, role.id=c43aada0326446c4ade0ab1262918fa4, scope.project.id=73025fb6edfa43b88c0c690d55906c19) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:35.577658 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3571a8-78a1-4548-8c11-9779c7438726 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:35.579105 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3571a8-78a1-4548-8c11-9779c7438726 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:35.586144 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 184/371] 10.222.0.60 () {56 vars in 1376 bytes} [Sat Jul 2 03:16:35 2022] GET /identity/v3/role_assignments?group.id=9ee0b4fa223c4863976bbbbc81d20df2&scope.project.id=73025fb6edfa43b88c0c690d55906c19&role.id=c43aada0326446c4ade0ab1262918fa4 => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:35.588005 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3571a8-78a1-4548-8c11-9779c7438726 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:35.615098 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0118722c-2366-4f35-ab86-71bf419e6e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:35.615887 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0118722c-2366-4f35-ab86-71bf419e6e10 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:35.616165 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0118722c-2366-4f35-ab86-71bf419e6e10 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:35.616434 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0118722c-2366-4f35-ab86-71bf419e6e10 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:35.617204 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0118722c-2366-4f35-ab86-71bf419e6e10 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:35.617507 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0118722c-2366-4f35-ab86-71bf419e6e10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:35.620850 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0118722c-2366-4f35-ab86-71bf419e6e10 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:35.637251 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 188/372] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Jul 2 03:16:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:35.639332 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0118722c-2366-4f35-ab86-71bf419e6e10 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:35.712536 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:35.733120 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3571a8-78a1-4548-8c11-9779c7438726 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:35.782574 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dde8e73-7601-482b-9a6d-2cd0a8bba162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:35.783376 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde8e73-7601-482b-9a6d-2cd0a8bba162 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:35.783730 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde8e73-7601-482b-9a6d-2cd0a8bba162 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:35.784038 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde8e73-7601-482b-9a6d-2cd0a8bba162 None admin] PATH_INFO: `/v3/projects/d260f7a9c3984a7d8d4d7f5aa78dcc78` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:35.785315 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dde8e73-7601-482b-9a6d-2cd0a8bba162 None admin] RBAC: Authorizing `identity:get_project(project_id=d260f7a9c3984a7d8d4d7f5aa78dcc78)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:35.786897 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dde8e73-7601-482b-9a6d-2cd0a8bba162 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:35.788923 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 185/373] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Jul 2 03:16:35 2022] GET /identity/v3/projects/d260f7a9c3984a7d8d4d7f5aa78dcc78 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:35.789042 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0118722c-2366-4f35-ab86-71bf419e6e10 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:35.789487 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dde8e73-7601-482b-9a6d-2cd0a8bba162 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:35.834270 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c919dab-a950-4e08-af18-47badddc2877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:35.834927 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c919dab-a950-4e08-af18-47badddc2877 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:35.835229 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c919dab-a950-4e08-af18-47badddc2877 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:35.835516 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c919dab-a950-4e08-af18-47badddc2877 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:35.836347 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c919dab-a950-4e08-af18-47badddc2877 None admin] RBAC: Adding query filter params (group.id=9ee0b4fa223c4863976bbbbc81d20df2, role.id=c43aada0326446c4ade0ab1262918fa4, scope.project.id=d260f7a9c3984a7d8d4d7f5aa78dcc78) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:35.836654 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c919dab-a950-4e08-af18-47badddc2877 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:35.838093 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c919dab-a950-4e08-af18-47badddc2877 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:35.847758 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 189/374] 10.222.0.60 () {56 vars in 1376 bytes} [Sat Jul 2 03:16:35 2022] GET /identity/v3/role_assignments?group.id=9ee0b4fa223c4863976bbbbc81d20df2&scope.project.id=d260f7a9c3984a7d8d4d7f5aa78dcc78&role.id=c43aada0326446c4ade0ab1262918fa4 => generated 260 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:35.848596 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c919dab-a950-4e08-af18-47badddc2877 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:35.890964 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:35.919616 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dde8e73-7601-482b-9a6d-2cd0a8bba162 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:35.958340 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82701d16-cc90-4572-826a-4c2457f57229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:35.959474 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82701d16-cc90-4572-826a-4c2457f57229 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:35.960004 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82701d16-cc90-4572-826a-4c2457f57229 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:35.960496 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82701d16-cc90-4572-826a-4c2457f57229 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:36.015511 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:36.052626 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c919dab-a950-4e08-af18-47badddc2877 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:36.091866 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82701d16-cc90-4572-826a-4c2457f57229 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:36.093470 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82701d16-cc90-4572-826a-4c2457f57229 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:36.107727 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca11a5-bfbe-4184-a854-4a86b0064d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:36.108628 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca11a5-bfbe-4184-a854-4a86b0064d07 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:36.108907 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca11a5-bfbe-4184-a854-4a86b0064d07 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:36.109179 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca11a5-bfbe-4184-a854-4a86b0064d07 None admin] PATH_INFO: `/v3/groups/9ee0b4fa223c4863976bbbbc81d20df2` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:36.110485 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bca11a5-bfbe-4184-a854-4a86b0064d07 None admin] RBAC: Authorizing `identity:get_group(group_id=9ee0b4fa223c4863976bbbbc81d20df2)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:36.112073 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bca11a5-bfbe-4184-a854-4a86b0064d07 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:36.113636 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 190/375] 10.222.0.60 () {56 vars in 1180 bytes} [Sat Jul 2 03:16:35 2022] GET /identity/v3/groups/9ee0b4fa223c4863976bbbbc81d20df2 => generated 226 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:36.119634 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca11a5-bfbe-4184-a854-4a86b0064d07 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:36.209496 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 186/376] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Jul 2 03:16:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 03:16:36.210709 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079771f-6dda-4ab7-9c28-29e95f1c77ce None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:36.210999 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079771f-6dda-4ab7-9c28-29e95f1c77ce None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:36.211303 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079771f-6dda-4ab7-9c28-29e95f1c77ce None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:36.212936 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 187/377] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:16:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:16:36.214734 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5079771f-6dda-4ab7-9c28-29e95f1c77ce None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:36.225883 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:36.242787 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca11a5-bfbe-4184-a854-4a86b0064d07 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:36.285417 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d74f9a-13e7-4fe8-9a17-edd9e4560ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:36.286017 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d74f9a-13e7-4fe8-9a17-edd9e4560ee9 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:36.286578 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d74f9a-13e7-4fe8-9a17-edd9e4560ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:36.286861 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d74f9a-13e7-4fe8-9a17-edd9e4560ee9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:36.287728 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:36.287836 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d74f9a-13e7-4fe8-9a17-edd9e4560ee9 None admin] RBAC: Adding query filter params (group.id=9ee0b4fa223c4863976bbbbc81d20df2, role.id=a9792a930e0c4e139f287a712dfc7d4d, scope.project.id=d260f7a9c3984a7d8d4d7f5aa78dcc78) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:36.288201 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d74f9a-13e7-4fe8-9a17-edd9e4560ee9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:36.290260 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d74f9a-13e7-4fe8-9a17-edd9e4560ee9 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:36.299228 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 191/378] 10.222.0.60 () {56 vars in 1376 bytes} [Sat Jul 2 03:16:36 2022] GET /identity/v3/role_assignments?group.id=9ee0b4fa223c4863976bbbbc81d20df2&scope.project.id=d260f7a9c3984a7d8d4d7f5aa78dcc78&role.id=a9792a930e0c4e139f287a712dfc7d4d => generated 260 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:16:36.300505 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c49718-bc23-46a9-a7cd-a6c6a00d81bc None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:36.300954 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c49718-bc23-46a9-a7cd-a6c6a00d81bc None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:36.301235 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c49718-bc23-46a9-a7cd-a6c6a00d81bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:36.322830 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-21c49718-bc23-46a9-a7cd-a6c6a00d81bc None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:16:36.324423 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-21c49718-bc23-46a9-a7cd-a6c6a00d81bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:16:36.346217 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5079771f-6dda-4ab7-9c28-29e95f1c77ce None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:36.393885 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c94cfc6-5734-423c-8956-83be6a489142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:36.395071 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94cfc6-5734-423c-8956-83be6a489142 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:36.395389 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94cfc6-5734-423c-8956-83be6a489142 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:36.395711 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94cfc6-5734-423c-8956-83be6a489142 None admin] PATH_INFO: `/v3/projects/b5b36ebb11744ee2a29802eb5f4d8e11` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:36.398107 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c94cfc6-5734-423c-8956-83be6a489142 None admin] RBAC: Authorizing `identity:get_project(project_id=b5b36ebb11744ee2a29802eb5f4d8e11)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:36.399725 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c94cfc6-5734-423c-8956-83be6a489142 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:36.402545 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 188/379] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Jul 2 03:16:36 2022] GET /identity/v3/projects/b5b36ebb11744ee2a29802eb5f4d8e11 => generated 344 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:16:36.407875 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c94cfc6-5734-423c-8956-83be6a489142 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:36.422328 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 192/380] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:16:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 03:16:36.459479 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c49718-bc23-46a9-a7cd-a6c6a00d81bc None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:36.533484 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c94cfc6-5734-423c-8956-83be6a489142 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:36.560521 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:36.576452 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada821e-53d1-41b9-87b2-7c00427a3b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:36.577352 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada821e-53d1-41b9-87b2-7c00427a3b0d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:36.578021 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada821e-53d1-41b9-87b2-7c00427a3b0d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:36.578021 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada821e-53d1-41b9-87b2-7c00427a3b0d None admin] PATH_INFO: `/v3/groups/ae992c0a101b49c39360a1a2add0bbe6` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:36.586816 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ada821e-53d1-41b9-87b2-7c00427a3b0d None admin] RBAC: Authorizing `identity:get_group(group_id=ae992c0a101b49c39360a1a2add0bbe6)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:36.588370 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ada821e-53d1-41b9-87b2-7c00427a3b0d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:36.591252 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 189/381] 10.222.0.60 () {56 vars in 1180 bytes} [Sat Jul 2 03:16:36 2022] GET /identity/v3/groups/ae992c0a101b49c39360a1a2add0bbe6 => generated 229 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:16:36.596623 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada821e-53d1-41b9-87b2-7c00427a3b0d None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:36.599325 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:36.625049 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c49718-bc23-46a9-a7cd-a6c6a00d81bc None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:36.702751 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f457b-74ab-4256-9a46-87a82f999ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:36.703613 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f457b-74ab-4256-9a46-87a82f999ecc None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:36.703893 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f457b-74ab-4256-9a46-87a82f999ecc None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:36.704165 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f457b-74ab-4256-9a46-87a82f999ecc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:36.730735 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85f457b-74ab-4256-9a46-87a82f999ecc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:16:36.745552 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-f85f457b-74ab-4256-9a46-87a82f999ecc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 02 03:16:36.745552 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:36.745552 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:36.745552 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:36.745552 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:36.745552 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:36.745552 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:36.745552 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:36.745552 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:36.745552 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:36.745552 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:36.745552 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:36.745552 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:16:36.745552 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:16:36.745552 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:16:36.745552 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:16:36.746481 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:16:36.746481 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:16:36.746481 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:16:36.746481 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:16:36.746481 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:36.746481 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:36.746481 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:36.746481 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:36.746481 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:36.746481 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:36.746481 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:36.746481 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:36.746481 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:36.746481 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:36.746481 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:36.746481 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:36.747467 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:36.747467 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:36.747467 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:36.747467 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:36.747467 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:16:36.747467 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:16:36.747467 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:16:36.747467 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:16:36.747467 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:16:36.747467 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:16:36.747467 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 02 03:16:36.747467 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:16:36.747467 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 193/382] 10.222.0.60 () {56 vars in 1114 bytes} [Sat Jul 2 03:16:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 03:16:36.753296 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f457b-74ab-4256-9a46-87a82f999ecc None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:36.787240 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada821e-53d1-41b9-87b2-7c00427a3b0d None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:36.879931 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb3c053-a6c3-4a4b-8060-659a49c45fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:36.880962 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb3c053-a6c3-4a4b-8060-659a49c45fd1 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:36.881450 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb3c053-a6c3-4a4b-8060-659a49c45fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:36.882017 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb3c053-a6c3-4a4b-8060-659a49c45fd1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:36.883064 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb3c053-a6c3-4a4b-8060-659a49c45fd1 None admin] RBAC: Adding query filter params (group.id=ae992c0a101b49c39360a1a2add0bbe6, role.id=5dcd130cda6c490595e862dc2348e83d, scope.project.id=b5b36ebb11744ee2a29802eb5f4d8e11) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:36.883609 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb3c053-a6c3-4a4b-8060-659a49c45fd1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:36.885267 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb3c053-a6c3-4a4b-8060-659a49c45fd1 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:36.887385 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f457b-74ab-4256-9a46-87a82f999ecc None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:36.901545 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 190/383] 10.222.0.60 () {56 vars in 1376 bytes} [Sat Jul 2 03:16:36 2022] GET /identity/v3/role_assignments?group.id=ae992c0a101b49c39360a1a2add0bbe6&scope.project.id=b5b36ebb11744ee2a29802eb5f4d8e11&role.id=5dcd130cda6c490595e862dc2348e83d => generated 260 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:36.934960 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5f408c-a952-40fa-a0ab-b0b62dda6086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:36.935754 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f408c-a952-40fa-a0ab-b0b62dda6086 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:36.936040 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f408c-a952-40fa-a0ab-b0b62dda6086 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:36.936317 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f408c-a952-40fa-a0ab-b0b62dda6086 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:36.937109 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5f408c-a952-40fa-a0ab-b0b62dda6086 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:36.937419 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5f408c-a952-40fa-a0ab-b0b62dda6086 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:36.938894 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5f408c-a952-40fa-a0ab-b0b62dda6086 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:36.949173 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 194/384] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Jul 2 03:16:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:36.954692 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb3c053-a6c3-4a4b-8060-659a49c45fd1 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:37.041165 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:37.110330 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb3c053-a6c3-4a4b-8060-659a49c45fd1 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:37.151764 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fefffc5-e24e-4e9e-99b0-f21c429d57b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:37.152544 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fefffc5-e24e-4e9e-99b0-f21c429d57b2 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:37.152819 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fefffc5-e24e-4e9e-99b0-f21c429d57b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:37.153139 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fefffc5-e24e-4e9e-99b0-f21c429d57b2 None admin] PATH_INFO: `/v3/groups/9ee0b4fa223c4863976bbbbc81d20df2` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:37.154296 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fefffc5-e24e-4e9e-99b0-f21c429d57b2 None admin] RBAC: Authorizing `identity:get_group(group_id=9ee0b4fa223c4863976bbbbc81d20df2)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:37.155900 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fefffc5-e24e-4e9e-99b0-f21c429d57b2 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:37.157702 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 191/385] 10.222.0.60 () {56 vars in 1180 bytes} [Sat Jul 2 03:16:36 2022] GET /identity/v3/groups/9ee0b4fa223c4863976bbbbc81d20df2 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:37.163153 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5f408c-a952-40fa-a0ab-b0b62dda6086 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:37.166472 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:37.273912 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5f408c-a952-40fa-a0ab-b0b62dda6086 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:37.310710 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d366b6c4-7542-4602-80ae-21d11d49067b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:37.311602 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d366b6c4-7542-4602-80ae-21d11d49067b None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:37.311872 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d366b6c4-7542-4602-80ae-21d11d49067b None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:37.312133 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d366b6c4-7542-4602-80ae-21d11d49067b None admin] PATH_INFO: `/v3/projects/73025fb6edfa43b88c0c690d55906c19` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:37.314013 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d366b6c4-7542-4602-80ae-21d11d49067b None admin] RBAC: Authorizing `identity:get_project(project_id=73025fb6edfa43b88c0c690d55906c19)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:37.315461 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d366b6c4-7542-4602-80ae-21d11d49067b None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:37.317590 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 195/386] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Jul 2 03:16:37 2022] GET /identity/v3/projects/73025fb6edfa43b88c0c690d55906c19 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:16:37.323034 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fefffc5-e24e-4e9e-99b0-f21c429d57b2 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:37.435864 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fefffc5-e24e-4e9e-99b0-f21c429d57b2 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:37.452904 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:37.472330 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2eb348-23f1-46ad-8f7e-e6d9c7156d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:37.473218 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2eb348-23f1-46ad-8f7e-e6d9c7156d85 None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:37.473497 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2eb348-23f1-46ad-8f7e-e6d9c7156d85 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:37.473770 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2eb348-23f1-46ad-8f7e-e6d9c7156d85 None admin] PATH_INFO: `/v3/projects/73025fb6edfa43b88c0c690d55906c19/groups/9ee0b4fa223c4863976bbbbc81d20df2/roles/a9792a930e0c4e139f287a712dfc7d4d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:37.475986 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2eb348-23f1-46ad-8f7e-e6d9c7156d85 None admin] RBAC: Authorizing `identity:create_grant(project_id=73025fb6edfa43b88c0c690d55906c19, group_id=9ee0b4fa223c4863976bbbbc81d20df2, role_id=a9792a930e0c4e139f287a712dfc7d4d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:37.477515 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2eb348-23f1-46ad-8f7e-e6d9c7156d85 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:37.494915 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 192/387] 10.222.0.60 () {58 vars in 1442 bytes} [Sat Jul 2 03:16:37 2022] PUT /identity/v3/projects/73025fb6edfa43b88c0c690d55906c19/groups/9ee0b4fa223c4863976bbbbc81d20df2/roles/a9792a930e0c4e139f287a712dfc7d4d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:16:38.144228 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228be035-4ebc-4985-80b4-bf8137f18bc0 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:38.144961 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228be035-4ebc-4985-80b4-bf8137f18bc0 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:38.145431 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228be035-4ebc-4985-80b4-bf8137f18bc0 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:38.147290 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 196/388] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:16:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:16:38.152421 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e37419-0ed7-44ba-beed-b7229aa027bf None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:38.152713 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e37419-0ed7-44ba-beed-b7229aa027bf None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:38.153073 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e37419-0ed7-44ba-beed-b7229aa027bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:38.176242 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-32e37419-0ed7-44ba-beed-b7229aa027bf None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:16:38.177450 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-32e37419-0ed7-44ba-beed-b7229aa027bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:16:38.268488 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 193/389] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:16:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 03:16:38.312348 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228be035-4ebc-4985-80b4-bf8137f18bc0 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:38.412263 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:38.453336 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228be035-4ebc-4985-80b4-bf8137f18bc0 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:38.497391 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d0237-f4c2-4de3-a257-9d23219732bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:38.498212 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d0237-f4c2-4de3-a257-9d23219732bd None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:38.498500 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d0237-f4c2-4de3-a257-9d23219732bd None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:38.498778 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d0237-f4c2-4de3-a257-9d23219732bd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:38.510111 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71d0237-f4c2-4de3-a257-9d23219732bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:16:38.518127 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-f71d0237-f4c2-4de3-a257-9d23219732bd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 02 03:16:38.518127 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:38.518127 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:38.518127 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:38.518127 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:38.518127 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:38.518127 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:38.518127 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:38.518127 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:38.518127 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:38.518127 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:38.518127 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:38.518127 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:16:38.518127 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:16:38.518127 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:16:38.518127 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:16:38.519072 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:16:38.519072 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:16:38.519072 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:16:38.519072 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:16:38.519072 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:38.519072 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:38.519072 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:38.519072 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:38.519072 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:38.519072 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:38.519072 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:38.519072 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:38.519072 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:38.519072 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:38.519072 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:38.519072 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:38.519935 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:38.519935 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:38.519935 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:38.519935 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:38.519935 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:16:38.519935 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:16:38.519935 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:16:38.519935 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:16:38.519935 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:16:38.519935 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:16:38.519935 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 02 03:16:38.519935 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:16:38.519935 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 197/390] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Jul 2 03:16:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:16:38.527148 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e37419-0ed7-44ba-beed-b7229aa027bf None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:38.676579 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e37419-0ed7-44ba-beed-b7229aa027bf None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:38.686745 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:38.705236 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7100bf3-ec4c-4000-a5e3-058b90b353fb None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:38.705563 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7100bf3-ec4c-4000-a5e3-058b90b353fb None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:38.705784 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7100bf3-ec4c-4000-a5e3-058b90b353fb None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:38.707900 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 198/391] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:16:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 03:16:38.713525 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a38c7bb-b203-4f88-8fb0-c55142cf977f None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:38.714081 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a38c7bb-b203-4f88-8fb0-c55142cf977f None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:38.714863 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a38c7bb-b203-4f88-8fb0-c55142cf977f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:38.727826 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f192cb-77a1-4790-9609-d1a273c82748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:38.728502 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f192cb-77a1-4790-9609-d1a273c82748 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:38.728784 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f192cb-77a1-4790-9609-d1a273c82748 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:38.729058 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f192cb-77a1-4790-9609-d1a273c82748 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:38.729810 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f192cb-77a1-4790-9609-d1a273c82748 None admin] RBAC: Adding query filter params (name=member) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:38.730119 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f192cb-77a1-4790-9609-d1a273c82748 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:38.731638 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f192cb-77a1-4790-9609-d1a273c82748 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:38.734653 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-3a38c7bb-b203-4f88-8fb0-c55142cf977f None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:16:38.736136 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-3a38c7bb-b203-4f88-8fb0-c55142cf977f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:16:38.746523 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 194/392] 10.222.0.60 () {56 vars in 1101 bytes} [Sat Jul 2 03:16:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:38.752084 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f192cb-77a1-4790-9609-d1a273c82748 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:38.814255 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 199/393] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:16:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 02 03:16:38.841335 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a38c7bb-b203-4f88-8fb0-c55142cf977f None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:38.918827 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f192cb-77a1-4790-9609-d1a273c82748 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:38.956899 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:38.957430 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5457666a-0e22-4e15-af2f-befb139c3330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:38.958874 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5457666a-0e22-4e15-af2f-befb139c3330 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:38.959434 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5457666a-0e22-4e15-af2f-befb139c3330 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:38.959929 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5457666a-0e22-4e15-af2f-befb139c3330 None admin] PATH_INFO: `/v3/groups/9ee0b4fa223c4863976bbbbc81d20df2` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:38.961398 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5457666a-0e22-4e15-af2f-befb139c3330 None admin] RBAC: Authorizing `identity:get_group(group_id=9ee0b4fa223c4863976bbbbc81d20df2)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:38.963563 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5457666a-0e22-4e15-af2f-befb139c3330 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:38.965934 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 195/394] 10.222.0.60 () {56 vars in 1180 bytes} [Sat Jul 2 03:16:38 2022] GET /identity/v3/groups/9ee0b4fa223c4863976bbbbc81d20df2 => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:38.971446 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5457666a-0e22-4e15-af2f-befb139c3330 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:39.021871 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a38c7bb-b203-4f88-8fb0-c55142cf977f None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:39.061102 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d558f7d-4577-4ee0-8c93-6c6e0b1a51d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:39.062667 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d558f7d-4577-4ee0-8c93-6c6e0b1a51d4 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:39.063220 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d558f7d-4577-4ee0-8c93-6c6e0b1a51d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:39.063701 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d558f7d-4577-4ee0-8c93-6c6e0b1a51d4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:39.076027 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d558f7d-4577-4ee0-8c93-6c6e0b1a51d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:16:39.078616 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:39.084503 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-7d558f7d-4577-4ee0-8c93-6c6e0b1a51d4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 02 03:16:39.084503 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:39.084503 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:39.084503 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:39.084503 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:39.084503 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:39.084503 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:39.084503 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:39.084503 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:39.084503 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:39.084503 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:39.084503 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:39.084503 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:16:39.084503 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:16:39.084503 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:16:39.084503 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:16:39.085406 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:16:39.085406 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:16:39.085406 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:16:39.085406 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:16:39.085406 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:39.085406 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:39.085406 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:39.085406 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:39.085406 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:39.085406 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:39.085406 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:39.085406 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:39.085406 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:39.085406 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:39.085406 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:39.085406 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:39.086198 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:39.086198 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:39.086198 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:39.086198 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:39.086198 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:16:39.086198 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:16:39.086198 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:16:39.086198 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:16:39.086198 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:16:39.086198 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:16:39.086198 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 02 03:16:39.086198 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:16:39.088930 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 200/395] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Jul 2 03:16:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:16:39.090568 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4206e675-c3db-4f48-b3de-26de32fb4a3c None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:39.091077 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4206e675-c3db-4f48-b3de-26de32fb4a3c None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:39.091591 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4206e675-c3db-4f48-b3de-26de32fb4a3c None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:39.093383 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 201/396] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:16:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:16:39.094803 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4206e675-c3db-4f48-b3de-26de32fb4a3c None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:39.161302 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5457666a-0e22-4e15-af2f-befb139c3330 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:39.206745 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab5d1f-ecb8-4703-93b8-6396a8e5840b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:39.208013 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab5d1f-ecb8-4703-93b8-6396a8e5840b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:39.208462 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab5d1f-ecb8-4703-93b8-6396a8e5840b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:39.208882 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab5d1f-ecb8-4703-93b8-6396a8e5840b None admin] PATH_INFO: `/v3/projects/73025fb6edfa43b88c0c690d55906c19` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:39.209428 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4206e675-c3db-4f48-b3de-26de32fb4a3c None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:39.210269 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aab5d1f-ecb8-4703-93b8-6396a8e5840b None admin] RBAC: Authorizing `identity:get_project(project_id=73025fb6edfa43b88c0c690d55906c19)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:39.213136 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aab5d1f-ecb8-4703-93b8-6396a8e5840b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:39.215716 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 196/397] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Jul 2 03:16:38 2022] GET /identity/v3/projects/73025fb6edfa43b88c0c690d55906c19 => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:39.217244 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed4d5e-e840-4750-a8a9-23dbf3dad74e None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:39.217674 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed4d5e-e840-4750-a8a9-23dbf3dad74e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:39.218736 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed4d5e-e840-4750-a8a9-23dbf3dad74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:39.237725 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-83ed4d5e-e840-4750-a8a9-23dbf3dad74e None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:16:39.238863 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:39.239192 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-83ed4d5e-e840-4750-a8a9-23dbf3dad74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:16:39.261184 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d097e3-d894-40b4-9947-b926af5d5f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:39.262152 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d097e3-d894-40b4-9947-b926af5d5f80 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:39.262652 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d097e3-d894-40b4-9947-b926af5d5f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:39.263170 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d097e3-d894-40b4-9947-b926af5d5f80 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:39.264684 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d097e3-d894-40b4-9947-b926af5d5f80 None admin] RBAC: Adding query filter params (name=member) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:39.265146 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d097e3-d894-40b4-9947-b926af5d5f80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:39.267050 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d097e3-d894-40b4-9947-b926af5d5f80 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:39.286018 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 202/398] 10.222.0.60 () {56 vars in 1101 bytes} [Sat Jul 2 03:16:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:39.287813 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d097e3-d894-40b4-9947-b926af5d5f80 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:39.323410 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 197/399] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:16:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 03:16:39.324559 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ed4d5e-e840-4750-a8a9-23dbf3dad74e None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:39.388011 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:39.430536 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d097e3-d894-40b4-9947-b926af5d5f80 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:39.467954 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ed4d5e-e840-4750-a8a9-23dbf3dad74e None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:39.468183 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f63b95c-69f1-45c7-9b0c-c54c69c2177c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:39.469253 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f63b95c-69f1-45c7-9b0c-c54c69c2177c None admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:39.469678 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f63b95c-69f1-45c7-9b0c-c54c69c2177c None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:39.470087 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f63b95c-69f1-45c7-9b0c-c54c69c2177c None admin] PATH_INFO: `/v3/projects/73025fb6edfa43b88c0c690d55906c19/groups/9ee0b4fa223c4863976bbbbc81d20df2/roles/c43aada0326446c4ade0ab1262918fa4` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:39.472244 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f63b95c-69f1-45c7-9b0c-c54c69c2177c None admin] RBAC: Authorizing `identity:create_grant(project_id=73025fb6edfa43b88c0c690d55906c19, group_id=9ee0b4fa223c4863976bbbbc81d20df2, role_id=c43aada0326446c4ade0ab1262918fa4)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:39.473829 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f63b95c-69f1-45c7-9b0c-c54c69c2177c None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:39.488750 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 203/400] 10.222.0.60 () {58 vars in 1442 bytes} [Sat Jul 2 03:16:39 2022] PUT /identity/v3/projects/73025fb6edfa43b88c0c690d55906c19/groups/9ee0b4fa223c4863976bbbbc81d20df2/roles/c43aada0326446c4ade0ab1262918fa4 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:16:39.489854 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f63b95c-69f1-45c7-9b0c-c54c69c2177c None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:39.517382 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e1caa2-f9a6-4e5f-b2f1-434b43b6ba1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:39.518678 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1caa2-f9a6-4e5f-b2f1-434b43b6ba1b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:39.519138 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1caa2-f9a6-4e5f-b2f1-434b43b6ba1b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:39.519605 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1caa2-f9a6-4e5f-b2f1-434b43b6ba1b None admin] PATH_INFO: `/v3/groups/9ee0b4fa223c4863976bbbbc81d20df2` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:39.521094 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e1caa2-f9a6-4e5f-b2f1-434b43b6ba1b None admin] RBAC: Authorizing `identity:get_group(group_id=9ee0b4fa223c4863976bbbbc81d20df2)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:39.523031 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e1caa2-f9a6-4e5f-b2f1-434b43b6ba1b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:39.530125 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 198/401] 10.222.0.60 () {56 vars in 1180 bytes} [Sat Jul 2 03:16:39 2022] GET /identity/v3/groups/9ee0b4fa223c4863976bbbbc81d20df2 => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:39.532532 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14f2ae-74e0-4c79-8b14-931941e2109e None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:39.533091 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14f2ae-74e0-4c79-8b14-931941e2109e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:39.533508 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14f2ae-74e0-4c79-8b14-931941e2109e None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:39.535364 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 199/402] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:16:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:16:39.536291 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c14f2ae-74e0-4c79-8b14-931941e2109e None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:39.549956 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:39.625564 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f63b95c-69f1-45c7-9b0c-c54c69c2177c None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:39.668277 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c14f2ae-74e0-4c79-8b14-931941e2109e None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:39.673925 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:39.674065 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f6a9d7-b5dc-4709-b566-0f31a56b205e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:39.674065 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6a9d7-b5dc-4709-b566-0f31a56b205e None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:39.674065 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6a9d7-b5dc-4709-b566-0f31a56b205e None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:39.674065 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6a9d7-b5dc-4709-b566-0f31a56b205e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:39.688341 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f6a9d7-b5dc-4709-b566-0f31a56b205e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:16:39.696779 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-b9f6a9d7-b5dc-4709-b566-0f31a56b205e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 02 03:16:39.696779 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:39.696779 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:39.696779 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:39.696779 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:39.696779 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:39.696779 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:39.696779 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:39.696779 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:39.696779 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:39.696779 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:39.696779 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:39.696779 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:16:39.696779 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:16:39.696779 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:16:39.696779 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:16:39.697697 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:16:39.697697 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:16:39.697697 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:16:39.697697 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:16:39.697697 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:39.697697 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:39.697697 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:39.697697 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:39.697697 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:39.697697 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:39.697697 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:39.697697 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:39.697697 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:39.697697 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:39.697697 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:39.697697 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:39.698513 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:39.698513 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:39.698513 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:39.698513 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:39.698513 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:16:39.698513 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:16:39.698513 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:16:39.698513 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:16:39.698513 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:16:39.698513 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:16:39.698513 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 02 03:16:39.698513 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:16:39.698513 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 204/403] 10.222.0.60 () {56 vars in 1114 bytes} [Sat Jul 2 03:16:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:16:39.700747 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0b092-8c01-4737-be99-d5ead20adddd None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:39.700747 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0b092-8c01-4737-be99-d5ead20adddd None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:39.700906 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0b092-8c01-4737-be99-d5ead20adddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:39.717775 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-3ee0b092-8c01-4737-be99-d5ead20adddd None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:16:39.719034 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-3ee0b092-8c01-4737-be99-d5ead20adddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:16:39.722853 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b572dd5a-b80f-48d9-b8cc-acaa3c3f2390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:39.723964 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b572dd5a-b80f-48d9-b8cc-acaa3c3f2390 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:39.724337 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b572dd5a-b80f-48d9-b8cc-acaa3c3f2390 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:39.724671 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b572dd5a-b80f-48d9-b8cc-acaa3c3f2390 None admin] PATH_INFO: `/v3/projects/d260f7a9c3984a7d8d4d7f5aa78dcc78` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:39.725952 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b572dd5a-b80f-48d9-b8cc-acaa3c3f2390 None admin] RBAC: Authorizing `identity:get_project(project_id=d260f7a9c3984a7d8d4d7f5aa78dcc78)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:39.728093 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b572dd5a-b80f-48d9-b8cc-acaa3c3f2390 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:39.731173 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 200/404] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Jul 2 03:16:39 2022] GET /identity/v3/projects/d260f7a9c3984a7d8d4d7f5aa78dcc78 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:39.732291 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b572dd5a-b80f-48d9-b8cc-acaa3c3f2390 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:39.799233 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 205/405] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:16:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 03:16:39.800174 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee0b092-8c01-4737-be99-d5ead20adddd None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:39.841532 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:39.852087 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b572dd5a-b80f-48d9-b8cc-acaa3c3f2390 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:39.890311 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d47df7-f5fe-4ffe-82ae-19b12248f02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:39.891424 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d47df7-f5fe-4ffe-82ae-19b12248f02c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:39.891907 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d47df7-f5fe-4ffe-82ae-19b12248f02c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:39.892367 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d47df7-f5fe-4ffe-82ae-19b12248f02c None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:39.893411 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d47df7-f5fe-4ffe-82ae-19b12248f02c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:39.893988 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d47df7-f5fe-4ffe-82ae-19b12248f02c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:39.895667 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d47df7-f5fe-4ffe-82ae-19b12248f02c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:39.905324 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 201/406] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Jul 2 03:16:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:39.906470 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d47df7-f5fe-4ffe-82ae-19b12248f02c None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:39.922170 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee0b092-8c01-4737-be99-d5ead20adddd None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:39.953854 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:39.974628 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc53861-2d63-4b63-86de-4c56ec384ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:39.976613 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc53861-2d63-4b63-86de-4c56ec384ddf None admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:39.977077 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc53861-2d63-4b63-86de-4c56ec384ddf None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:39.977589 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc53861-2d63-4b63-86de-4c56ec384ddf None admin] PATH_INFO: `/v3/projects/d260f7a9c3984a7d8d4d7f5aa78dcc78/groups/9ee0b4fa223c4863976bbbbc81d20df2/roles/c43aada0326446c4ade0ab1262918fa4` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:39.980683 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc53861-2d63-4b63-86de-4c56ec384ddf None admin] RBAC: Authorizing `identity:create_grant(project_id=d260f7a9c3984a7d8d4d7f5aa78dcc78, group_id=9ee0b4fa223c4863976bbbbc81d20df2, role_id=c43aada0326446c4ade0ab1262918fa4)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:39.983272 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc53861-2d63-4b63-86de-4c56ec384ddf None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:40.009998 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 206/407] 10.222.0.60 () {58 vars in 1442 bytes} [Sat Jul 2 03:16:39 2022] PUT /identity/v3/projects/d260f7a9c3984a7d8d4d7f5aa78dcc78/groups/9ee0b4fa223c4863976bbbbc81d20df2/roles/c43aada0326446c4ade0ab1262918fa4 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:16:40.009998 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc53861-2d63-4b63-86de-4c56ec384ddf None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:40.039849 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d47df7-f5fe-4ffe-82ae-19b12248f02c None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:40.119310 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156802c0-ce15-4058-adb6-e0b51ef0ad0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:40.122062 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156802c0-ce15-4058-adb6-e0b51ef0ad0f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:40.123551 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156802c0-ce15-4058-adb6-e0b51ef0ad0f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:40.123832 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156802c0-ce15-4058-adb6-e0b51ef0ad0f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:40.148304 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156802c0-ce15-4058-adb6-e0b51ef0ad0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:16:40.158272 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-156802c0-ce15-4058-adb6-e0b51ef0ad0f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 03:16:40.158272 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:40.158272 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:40.158272 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:40.158272 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:40.158272 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:40.158272 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:40.158272 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:40.158272 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:40.158272 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:40.158272 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:40.158272 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:40.158272 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:16:40.158272 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:16:40.158272 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:16:40.158272 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:16:40.159265 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:16:40.159265 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:16:40.159265 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:16:40.159265 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:16:40.159265 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:40.159265 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:40.159265 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:40.159265 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:40.159265 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:40.159265 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:40.159265 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:40.159265 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:40.159265 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:40.159265 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:40.159265 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:40.159265 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:40.160060 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:40.160060 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:40.160060 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:40.160060 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:40.160060 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:16:40.160060 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:16:40.160060 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:16:40.160060 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:16:40.160060 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:16:40.160060 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:16:40.160060 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 03:16:40.160060 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:16:40.167782 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 202/408] 10.222.0.60 () {56 vars in 1096 bytes} [Sat Jul 2 03:16:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:16:40.176584 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156802c0-ce15-4058-adb6-e0b51ef0ad0f None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:40.192510 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:40.204236 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc53861-2d63-4b63-86de-4c56ec384ddf None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:40.248934 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4439c3e0-76ea-4650-ba45-9efedac6af8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:40.249804 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439c3e0-76ea-4650-ba45-9efedac6af8a None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:40.250079 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439c3e0-76ea-4650-ba45-9efedac6af8a None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:40.250343 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439c3e0-76ea-4650-ba45-9efedac6af8a None admin] PATH_INFO: `/v3/groups/9ee0b4fa223c4863976bbbbc81d20df2` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:40.251564 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4439c3e0-76ea-4650-ba45-9efedac6af8a None admin] RBAC: Authorizing `identity:get_group(group_id=9ee0b4fa223c4863976bbbbc81d20df2)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:40.253008 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4439c3e0-76ea-4650-ba45-9efedac6af8a None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:40.259099 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 207/409] 10.222.0.60 () {56 vars in 1180 bytes} [Sat Jul 2 03:16:40 2022] GET /identity/v3/groups/9ee0b4fa223c4863976bbbbc81d20df2 => generated 226 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:40.259099 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98fda4-52e0-4335-ae78-dc493c2a4b23 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:40.259099 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98fda4-52e0-4335-ae78-dc493c2a4b23 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:40.259099 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98fda4-52e0-4335-ae78-dc493c2a4b23 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:40.259099 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 208/410] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:16:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:16:40.261035 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c98fda4-52e0-4335-ae78-dc493c2a4b23 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:40.311521 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:40.319364 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156802c0-ce15-4058-adb6-e0b51ef0ad0f None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:40.358566 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7127dbe-a438-4fbc-9cc4-e3b39525f06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:40.360409 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7127dbe-a438-4fbc-9cc4-e3b39525f06a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:40.361196 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7127dbe-a438-4fbc-9cc4-e3b39525f06a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:40.362083 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7127dbe-a438-4fbc-9cc4-e3b39525f06a None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:40.363567 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7127dbe-a438-4fbc-9cc4-e3b39525f06a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:40.364163 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7127dbe-a438-4fbc-9cc4-e3b39525f06a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:40.365862 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7127dbe-a438-4fbc-9cc4-e3b39525f06a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:40.374690 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c98fda4-52e0-4335-ae78-dc493c2a4b23 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:40.387305 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 203/411] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Jul 2 03:16:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:40.388938 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af03848c-2892-4288-9ecc-48ebb3b3e972 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:40.389437 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af03848c-2892-4288-9ecc-48ebb3b3e972 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:40.389948 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af03848c-2892-4288-9ecc-48ebb3b3e972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:40.408423 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-af03848c-2892-4288-9ecc-48ebb3b3e972 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:16:40.410387 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-af03848c-2892-4288-9ecc-48ebb3b3e972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:16:40.418775 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b0f495-9964-4226-9922-2f1c0dc82e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:40.419656 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b0f495-9964-4226-9922-2f1c0dc82e72 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:40.419931 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b0f495-9964-4226-9922-2f1c0dc82e72 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:40.420210 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b0f495-9964-4226-9922-2f1c0dc82e72 None admin] PATH_INFO: `/v3/projects/d260f7a9c3984a7d8d4d7f5aa78dcc78` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:40.421375 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b0f495-9964-4226-9922-2f1c0dc82e72 None admin] RBAC: Authorizing `identity:get_project(project_id=d260f7a9c3984a7d8d4d7f5aa78dcc78)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:40.422932 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b0f495-9964-4226-9922-2f1c0dc82e72 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:40.429760 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 209/412] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Jul 2 03:16:40 2022] GET /identity/v3/projects/d260f7a9c3984a7d8d4d7f5aa78dcc78 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:40.429760 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b0f495-9964-4226-9922-2f1c0dc82e72 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:40.455381 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:40.503456 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 204/413] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:16:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 03:16:40.504684 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af03848c-2892-4288-9ecc-48ebb3b3e972 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:40.545696 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b0f495-9964-4226-9922-2f1c0dc82e72 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:40.582592 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c5c990-b328-4dcb-b279-a8ca904ad072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:40.583647 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5c990-b328-4dcb-b279-a8ca904ad072 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:40.583990 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5c990-b328-4dcb-b279-a8ca904ad072 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:40.584259 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5c990-b328-4dcb-b279-a8ca904ad072 None admin] PATH_INFO: `/v3/groups/ae992c0a101b49c39360a1a2add0bbe6` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:40.585479 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c5c990-b328-4dcb-b279-a8ca904ad072 None admin] RBAC: Authorizing `identity:get_group(group_id=ae992c0a101b49c39360a1a2add0bbe6)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:40.587084 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c5c990-b328-4dcb-b279-a8ca904ad072 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:40.593710 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:40.594525 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 210/414] 10.222.0.60 () {56 vars in 1180 bytes} [Sat Jul 2 03:16:40 2022] GET /identity/v3/groups/ae992c0a101b49c39360a1a2add0bbe6 => generated 229 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:40.596237 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c5c990-b328-4dcb-b279-a8ca904ad072 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:40.605855 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af03848c-2892-4288-9ecc-48ebb3b3e972 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:40.639821 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ae0f67-145c-4655-9bd8-e0851b30dfad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:40.640709 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae0f67-145c-4655-9bd8-e0851b30dfad None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:40.641009 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae0f67-145c-4655-9bd8-e0851b30dfad None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:40.641262 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae0f67-145c-4655-9bd8-e0851b30dfad None admin] PATH_INFO: `/v3/projects/d260f7a9c3984a7d8d4d7f5aa78dcc78/groups/9ee0b4fa223c4863976bbbbc81d20df2/roles/a9792a930e0c4e139f287a712dfc7d4d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:40.643516 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ae0f67-145c-4655-9bd8-e0851b30dfad None admin] RBAC: Authorizing `identity:create_grant(project_id=d260f7a9c3984a7d8d4d7f5aa78dcc78, group_id=9ee0b4fa223c4863976bbbbc81d20df2, role_id=a9792a930e0c4e139f287a712dfc7d4d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:40.644989 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ae0f67-145c-4655-9bd8-e0851b30dfad None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:40.663689 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 205/415] 10.222.0.60 () {58 vars in 1442 bytes} [Sat Jul 2 03:16:40 2022] PUT /identity/v3/projects/d260f7a9c3984a7d8d4d7f5aa78dcc78/groups/9ee0b4fa223c4863976bbbbc81d20df2/roles/a9792a930e0c4e139f287a712dfc7d4d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:16:40.664653 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ae0f67-145c-4655-9bd8-e0851b30dfad None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:40.703455 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:40.709351 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c5c990-b328-4dcb-b279-a8ca904ad072 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:40.751012 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05685e4c-e398-4fd8-a298-0eb55664f41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:40.752259 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05685e4c-e398-4fd8-a298-0eb55664f41d None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:40.752852 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05685e4c-e398-4fd8-a298-0eb55664f41d None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:40.753322 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05685e4c-e398-4fd8-a298-0eb55664f41d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:40.766855 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05685e4c-e398-4fd8-a298-0eb55664f41d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:16:40.776102 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-05685e4c-e398-4fd8-a298-0eb55664f41d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 02 03:16:40.776102 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:40.776102 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:40.776102 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:40.776102 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:40.776102 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:40.776102 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:40.776102 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:40.776102 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:40.776102 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:40.776102 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:40.776102 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:40.776102 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:16:40.776102 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:16:40.776102 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:16:40.776102 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:16:40.777038 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:16:40.777038 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:16:40.777038 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:16:40.777038 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:16:40.777038 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:40.777038 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:40.777038 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:40.777038 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:40.777038 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:40.777038 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:40.777038 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:40.777038 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:40.777038 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:40.777038 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:40.777038 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:40.777038 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:40.777893 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:40.777893 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:40.777893 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:40.777893 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:40.777893 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:16:40.777893 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:16:40.777893 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:16:40.777893 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:16:40.777893 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:16:40.777893 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:16:40.777893 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 02 03:16:40.777893 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:16:40.780821 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 211/416] 10.222.0.60 () {56 vars in 1114 bytes} [Sat Jul 2 03:16:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:16:40.786864 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05685e4c-e398-4fd8-a298-0eb55664f41d None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:40.921553 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05685e4c-e398-4fd8-a298-0eb55664f41d None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:40.946193 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ae0f67-145c-4655-9bd8-e0851b30dfad None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:40.982388 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f12492-9d2f-4ef2-8e20-62301abf570a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:40.984031 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f12492-9d2f-4ef2-8e20-62301abf570a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:40.984507 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f12492-9d2f-4ef2-8e20-62301abf570a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:40.985002 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f12492-9d2f-4ef2-8e20-62301abf570a None admin] PATH_INFO: `/v3/projects/b5b36ebb11744ee2a29802eb5f4d8e11` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:40.986379 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f12492-9d2f-4ef2-8e20-62301abf570a None admin] RBAC: Authorizing `identity:get_project(project_id=b5b36ebb11744ee2a29802eb5f4d8e11)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:40.988257 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f12492-9d2f-4ef2-8e20-62301abf570a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:40.990546 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 206/417] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Jul 2 03:16:40 2022] GET /identity/v3/projects/b5b36ebb11744ee2a29802eb5f4d8e11 => generated 344 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:40.997414 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f12492-9d2f-4ef2-8e20-62301abf570a None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:41.018143 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc995d7c-edc0-43df-b69e-71bdd1dfb831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:41.019864 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc995d7c-edc0-43df-b69e-71bdd1dfb831 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:41.020874 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc995d7c-edc0-43df-b69e-71bdd1dfb831 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:41.021454 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc995d7c-edc0-43df-b69e-71bdd1dfb831 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:41.023938 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc995d7c-edc0-43df-b69e-71bdd1dfb831 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:41.024555 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc995d7c-edc0-43df-b69e-71bdd1dfb831 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:41.027292 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc995d7c-edc0-43df-b69e-71bdd1dfb831 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:41.031681 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:41.047617 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 212/418] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Jul 2 03:16:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:16:41.054130 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc995d7c-edc0-43df-b69e-71bdd1dfb831 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:41.091738 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:41.139200 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f12492-9d2f-4ef2-8e20-62301abf570a None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:41.178524 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0b72a6-652a-4353-837c-cfb1685543d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:41.180244 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b72a6-652a-4353-837c-cfb1685543d5 None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:41.180735 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b72a6-652a-4353-837c-cfb1685543d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:41.181195 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b72a6-652a-4353-837c-cfb1685543d5 None admin] PATH_INFO: `/v3/projects/b5b36ebb11744ee2a29802eb5f4d8e11/groups/ae992c0a101b49c39360a1a2add0bbe6/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:41.183504 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0b72a6-652a-4353-837c-cfb1685543d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=b5b36ebb11744ee2a29802eb5f4d8e11, group_id=ae992c0a101b49c39360a1a2add0bbe6, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:41.185910 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0b72a6-652a-4353-837c-cfb1685543d5 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:41.211933 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 207/419] 10.222.0.60 () {58 vars in 1442 bytes} [Sat Jul 2 03:16:40 2022] PUT /identity/v3/projects/b5b36ebb11744ee2a29802eb5f4d8e11/groups/ae992c0a101b49c39360a1a2add0bbe6/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:16:41.254311 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc995d7c-edc0-43df-b69e-71bdd1dfb831 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:41.300494 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d740641-a0fb-4edc-9f1f-9e635624df54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:41.301584 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d740641-a0fb-4edc-9f1f-9e635624df54 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:41.302105 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d740641-a0fb-4edc-9f1f-9e635624df54 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:41.302620 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d740641-a0fb-4edc-9f1f-9e635624df54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:41.435307 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d740641-a0fb-4edc-9f1f-9e635624df54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:41.436804 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d740641-a0fb-4edc-9f1f-9e635624df54 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:41.465702 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:41.552328 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 213/420] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Jul 2 03:16:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 03:16:41.557610 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0b72a6-652a-4353-837c-cfb1685543d5 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:41.673744 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:41.708368 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0b72a6-652a-4353-837c-cfb1685543d5 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:41.758810 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7de444-97b5-4e69-b750-35c791280d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:41.759703 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7de444-97b5-4e69-b750-35c791280d3b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:41.759982 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7de444-97b5-4e69-b750-35c791280d3b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:41.760254 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7de444-97b5-4e69-b750-35c791280d3b None admin] PATH_INFO: `/v3/projects/73025fb6edfa43b88c0c690d55906c19` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:41.763852 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7de444-97b5-4e69-b750-35c791280d3b None admin] RBAC: Authorizing `identity:get_project(project_id=73025fb6edfa43b88c0c690d55906c19)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:41.765324 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7de444-97b5-4e69-b750-35c791280d3b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:41.767032 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 208/421] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Jul 2 03:16:41 2022] GET /identity/v3/projects/73025fb6edfa43b88c0c690d55906c19 => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:41.772826 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d740641-a0fb-4edc-9f1f-9e635624df54 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:41.921993 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d740641-a0fb-4edc-9f1f-9e635624df54 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:41.945483 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:41.952927 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2772660-618b-4953-a73c-e2f2cd4aeed0 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:41.953900 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2772660-618b-4953-a73c-e2f2cd4aeed0 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:41.954848 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2772660-618b-4953-a73c-e2f2cd4aeed0 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:41.956850 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 209/422] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:16:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 03:16:41.963032 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a53470-c07a-474a-9fc3-6ceb03cabe8e None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:41.963335 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a53470-c07a-474a-9fc3-6ceb03cabe8e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:41.963613 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a53470-c07a-474a-9fc3-6ceb03cabe8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:41.965417 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51970264-84b0-4015-8741-a1bbaa716f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:41.966445 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51970264-84b0-4015-8741-a1bbaa716f13 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:41.966868 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51970264-84b0-4015-8741-a1bbaa716f13 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:41.967334 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51970264-84b0-4015-8741-a1bbaa716f13 None admin] PATH_INFO: `/v3/groups/9ee0b4fa223c4863976bbbbc81d20df2` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:41.968667 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51970264-84b0-4015-8741-a1bbaa716f13 None admin] RBAC: Authorizing `identity:get_group(group_id=9ee0b4fa223c4863976bbbbc81d20df2)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:41.970276 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51970264-84b0-4015-8741-a1bbaa716f13 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:41.972391 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 214/423] 10.222.0.60 () {56 vars in 1180 bytes} [Sat Jul 2 03:16:41 2022] GET /identity/v3/groups/9ee0b4fa223c4863976bbbbc81d20df2 => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:41.979899 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51970264-84b0-4015-8741-a1bbaa716f13 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:41.999518 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-70a53470-c07a-474a-9fc3-6ceb03cabe8e None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:16:42.002346 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-70a53470-c07a-474a-9fc3-6ceb03cabe8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:16:42.116099 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51970264-84b0-4015-8741-a1bbaa716f13 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:42.146374 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 210/424] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:16:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 03:16:42.174351 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721fee45-f3b1-4cd8-94ef-4036a7120b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:42.174685 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a53470-c07a-474a-9fc3-6ceb03cabe8e None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:42.174930 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721fee45-f3b1-4cd8-94ef-4036a7120b2d None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:42.175227 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721fee45-f3b1-4cd8-94ef-4036a7120b2d None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:42.175493 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721fee45-f3b1-4cd8-94ef-4036a7120b2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:42.176336 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721fee45-f3b1-4cd8-94ef-4036a7120b2d None admin] RBAC: Adding query filter params (group.id=9ee0b4fa223c4863976bbbbc81d20df2, role.id=a9792a930e0c4e139f287a712dfc7d4d, scope.project.id=73025fb6edfa43b88c0c690d55906c19) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:42.176641 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721fee45-f3b1-4cd8-94ef-4036a7120b2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:42.178082 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721fee45-f3b1-4cd8-94ef-4036a7120b2d None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:42.191269 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 215/425] 10.222.0.60 () {56 vars in 1376 bytes} [Sat Jul 2 03:16:41 2022] GET /identity/v3/role_assignments?group.id=9ee0b4fa223c4863976bbbbc81d20df2&scope.project.id=73025fb6edfa43b88c0c690d55906c19&role.id=a9792a930e0c4e139f287a712dfc7d4d => generated 611 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:16:42.293884 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:42.314503 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab6a2bd-7f7e-45b3-9389-da88e2727a28 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:42.314826 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab6a2bd-7f7e-45b3-9389-da88e2727a28 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:42.315048 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab6a2bd-7f7e-45b3-9389-da88e2727a28 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:42.316778 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 216/426] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:16:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 03:16:42.322371 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da814ee-31ce-4e4b-bed2-8b733b2485e6 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:42.322674 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da814ee-31ce-4e4b-bed2-8b733b2485e6 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:42.323009 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da814ee-31ce-4e4b-bed2-8b733b2485e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:42.349322 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a53470-c07a-474a-9fc3-6ceb03cabe8e None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:42.364238 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-0da814ee-31ce-4e4b-bed2-8b733b2485e6 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:16:42.365458 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-0da814ee-31ce-4e4b-bed2-8b733b2485e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:16:42.395510 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0863202-308f-4f56-a4f1-f8d8746674da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:42.396685 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0863202-308f-4f56-a4f1-f8d8746674da None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:42.397265 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0863202-308f-4f56-a4f1-f8d8746674da None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:42.397729 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0863202-308f-4f56-a4f1-f8d8746674da None admin] PATH_INFO: `/v3/roles/member` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:42.410965 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0863202-308f-4f56-a4f1-f8d8746674da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:16:42.419275 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:42.419731 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-e0863202-308f-4f56-a4f1-f8d8746674da None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 02 03:16:42.419731 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:42.419731 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:42.419731 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:42.419731 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:42.419731 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:42.419731 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:42.419731 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:42.419731 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:42.419731 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:42.419731 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:42.419731 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:42.419731 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:16:42.419731 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:16:42.419731 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:16:42.419731 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:16:42.420578 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:16:42.420578 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:16:42.420578 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:16:42.420578 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:16:42.420578 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:42.420578 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:42.420578 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:42.420578 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:42.420578 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:42.420578 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:42.420578 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:42.420578 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:42.420578 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:42.420578 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:42.420578 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:42.420578 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:42.421336 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:42.421336 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:42.421336 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:42.421336 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:42.421336 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:16:42.421336 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:16:42.421336 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:16:42.421336 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:16:42.421336 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:16:42.421336 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:16:42.421336 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 02 03:16:42.421336 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:16:42.424059 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 211/427] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Jul 2 03:16:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 03:16:42.430092 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0863202-308f-4f56-a4f1-f8d8746674da None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:42.444030 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 217/428] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:16:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 02 03:16:42.467054 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da814ee-31ce-4e4b-bed2-8b733b2485e6 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:42.533393 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0863202-308f-4f56-a4f1-f8d8746674da None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:42.569756 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d6a534-c179-4d4b-8368-c36e738efe66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:42.570437 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6a534-c179-4d4b-8368-c36e738efe66 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:42.570723 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6a534-c179-4d4b-8368-c36e738efe66 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:42.571001 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6a534-c179-4d4b-8368-c36e738efe66 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:42.571794 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d6a534-c179-4d4b-8368-c36e738efe66 None admin] RBAC: Adding query filter params (name=member) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:42.572101 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d6a534-c179-4d4b-8368-c36e738efe66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:42.572571 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:42.574761 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d6a534-c179-4d4b-8368-c36e738efe66 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:42.584132 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 212/429] 10.222.0.60 () {56 vars in 1101 bytes} [Sat Jul 2 03:16:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:16:42.588037 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da814ee-31ce-4e4b-bed2-8b733b2485e6 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:42.589544 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d6a534-c179-4d4b-8368-c36e738efe66 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:42.622746 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f9b55-8460-4dcd-8e34-eef85c7477e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:42.623586 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f9b55-8460-4dcd-8e34-eef85c7477e3 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:42.623860 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f9b55-8460-4dcd-8e34-eef85c7477e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:42.624131 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f9b55-8460-4dcd-8e34-eef85c7477e3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:42.634650 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205f9b55-8460-4dcd-8e34-eef85c7477e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:16:42.642552 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-205f9b55-8460-4dcd-8e34-eef85c7477e3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 02 03:16:42.642552 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:42.642552 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:42.642552 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:42.642552 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:42.642552 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:42.642552 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:42.642552 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:42.642552 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:42.642552 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:42.642552 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:42.642552 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:42.642552 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:16:42.642552 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:16:42.642552 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:16:42.642552 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:16:42.643447 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:16:42.643447 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:16:42.643447 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:16:42.643447 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:16:42.643447 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:42.643447 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:42.643447 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:42.643447 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:42.643447 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:42.643447 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:42.643447 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:42.643447 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:42.643447 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:42.643447 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:42.643447 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:42.643447 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:42.644250 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:42.644250 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:42.644250 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:42.644250 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:42.644250 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:16:42.644250 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:16:42.644250 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:16:42.644250 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:16:42.644250 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:16:42.644250 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:16:42.644250 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 02 03:16:42.644250 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:16:42.644250 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 218/430] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Jul 2 03:16:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:16:42.650658 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f9b55-8460-4dcd-8e34-eef85c7477e3 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:42.696680 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d6a534-c179-4d4b-8368-c36e738efe66 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:42.709698 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:42.745800 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935f5179-736c-47f7-81f1-65ca5e51eae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:42.746519 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f5179-736c-47f7-81f1-65ca5e51eae0 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:42.746809 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f5179-736c-47f7-81f1-65ca5e51eae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:42.747088 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f5179-736c-47f7-81f1-65ca5e51eae0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:42.781452 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f9b55-8460-4dcd-8e34-eef85c7477e3 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:42.823687 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b3f0e0-e39b-4537-9eb5-291cac4e7a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:42.824817 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3f0e0-e39b-4537-9eb5-291cac4e7a6b None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:42.825196 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3f0e0-e39b-4537-9eb5-291cac4e7a6b None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:42.825638 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3f0e0-e39b-4537-9eb5-291cac4e7a6b None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:42.826396 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b3f0e0-e39b-4537-9eb5-291cac4e7a6b None admin] RBAC: Adding query filter params (name=member) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:42.826755 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b3f0e0-e39b-4537-9eb5-291cac4e7a6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:42.829014 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b3f0e0-e39b-4537-9eb5-291cac4e7a6b None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:42.838262 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:42.840476 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 219/431] 10.222.0.60 () {56 vars in 1101 bytes} [Sat Jul 2 03:16:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:16:42.850329 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b3f0e0-e39b-4537-9eb5-291cac4e7a6b None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:42.853040 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935f5179-736c-47f7-81f1-65ca5e51eae0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:42.854878 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935f5179-736c-47f7-81f1-65ca5e51eae0 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:42.973651 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b3f0e0-e39b-4537-9eb5-291cac4e7a6b None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:42.975231 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:42.982740 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 213/432] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Jul 2 03:16:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 02 03:16:42.982740 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade06dca-5eb0-4eaa-8a36-a56e3ea89305 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:42.982740 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade06dca-5eb0-4eaa-8a36-a56e3ea89305 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:42.982740 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade06dca-5eb0-4eaa-8a36-a56e3ea89305 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:42.983881 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 214/433] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:16:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:16:42.984444 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade06dca-5eb0-4eaa-8a36-a56e3ea89305 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:43.014657 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e325d-e195-4972-a56c-4b911f9c999b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:43.015415 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e325d-e195-4972-a56c-4b911f9c999b None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:43.015696 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e325d-e195-4972-a56c-4b911f9c999b None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:43.015971 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e325d-e195-4972-a56c-4b911f9c999b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:43.083638 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:43.089543 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78e325d-e195-4972-a56c-4b911f9c999b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:43.091057 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78e325d-e195-4972-a56c-4b911f9c999b None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:43.093180 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade06dca-5eb0-4eaa-8a36-a56e3ea89305 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:43.129434 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd2e7b-2a2f-4212-b120-3886632656df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:43.130298 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd2e7b-2a2f-4212-b120-3886632656df None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:43.130576 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd2e7b-2a2f-4212-b120-3886632656df None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:43.130845 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd2e7b-2a2f-4212-b120-3886632656df None admin] PATH_INFO: `/v3/projects/73025fb6edfa43b88c0c690d55906c19` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:43.132073 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bd2e7b-2a2f-4212-b120-3886632656df None admin] RBAC: Authorizing `identity:get_project(project_id=73025fb6edfa43b88c0c690d55906c19)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:43.133561 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bd2e7b-2a2f-4212-b120-3886632656df None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:43.135379 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 215/434] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Jul 2 03:16:42 2022] GET /identity/v3/projects/73025fb6edfa43b88c0c690d55906c19 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:43.141045 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109cab3a-0f17-46c2-a400-813cb59f106f None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:43.141331 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109cab3a-0f17-46c2-a400-813cb59f106f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:43.141606 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109cab3a-0f17-46c2-a400-813cb59f106f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:43.157943 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-109cab3a-0f17-46c2-a400-813cb59f106f None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:16:43.159047 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-109cab3a-0f17-46c2-a400-813cb59f106f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:16:43.204197 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 220/435] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Jul 2 03:16:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 03:16:43.204197 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e325d-e195-4972-a56c-4b911f9c999b None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:43.204197 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:43.231216 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 216/436] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:16:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 03:16:43.232310 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109cab3a-0f17-46c2-a400-813cb59f106f None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:43.323915 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e325d-e195-4972-a56c-4b911f9c999b None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:43.333186 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:43.343160 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109cab3a-0f17-46c2-a400-813cb59f106f None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:43.359759 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6f8bb6-fc8c-4ff6-8ec1-74cb42c6fae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:43.360922 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f8bb6-fc8c-4ff6-8ec1-74cb42c6fae7 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:43.361370 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f8bb6-fc8c-4ff6-8ec1-74cb42c6fae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:43.361802 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f8bb6-fc8c-4ff6-8ec1-74cb42c6fae7 None admin] PATH_INFO: `/v3/groups/9ee0b4fa223c4863976bbbbc81d20df2` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:43.363114 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6f8bb6-fc8c-4ff6-8ec1-74cb42c6fae7 None admin] RBAC: Authorizing `identity:get_group(group_id=9ee0b4fa223c4863976bbbbc81d20df2)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:43.364786 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6f8bb6-fc8c-4ff6-8ec1-74cb42c6fae7 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:43.366410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 221/437] 10.222.0.60 () {56 vars in 1180 bytes} [Sat Jul 2 03:16:43 2022] GET /identity/v3/groups/9ee0b4fa223c4863976bbbbc81d20df2 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:43.367177 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6f8bb6-fc8c-4ff6-8ec1-74cb42c6fae7 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:43.389950 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66bff5d-7cb9-4831-96a6-9287eb6cfecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:43.390824 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66bff5d-7cb9-4831-96a6-9287eb6cfecc None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:43.391106 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66bff5d-7cb9-4831-96a6-9287eb6cfecc None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:43.391408 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66bff5d-7cb9-4831-96a6-9287eb6cfecc None admin] PATH_INFO: `/v3/projects/d260f7a9c3984a7d8d4d7f5aa78dcc78` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:43.392591 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66bff5d-7cb9-4831-96a6-9287eb6cfecc None admin] RBAC: Authorizing `identity:get_project(project_id=d260f7a9c3984a7d8d4d7f5aa78dcc78)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:43.394033 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66bff5d-7cb9-4831-96a6-9287eb6cfecc None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:43.395781 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 217/438] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Jul 2 03:16:43 2022] GET /identity/v3/projects/d260f7a9c3984a7d8d4d7f5aa78dcc78 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:43.396546 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66bff5d-7cb9-4831-96a6-9287eb6cfecc None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:43.449937 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:43.483521 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6f8bb6-fc8c-4ff6-8ec1-74cb42c6fae7 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:43.502245 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66bff5d-7cb9-4831-96a6-9287eb6cfecc None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:43.519982 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd4ec9a-fdc8-4f8d-9a13-d851cab672ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:43.520799 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4ec9a-fdc8-4f8d-9a13-d851cab672ef None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:43.521086 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4ec9a-fdc8-4f8d-9a13-d851cab672ef None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:43.521357 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4ec9a-fdc8-4f8d-9a13-d851cab672ef None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:43.532482 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd4ec9a-fdc8-4f8d-9a13-d851cab672ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:16:43.537038 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe09912-e0cc-4478-9bc5-863729cb7895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:43.537879 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe09912-e0cc-4478-9bc5-863729cb7895 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:43.538324 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe09912-e0cc-4478-9bc5-863729cb7895 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:43.538759 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe09912-e0cc-4478-9bc5-863729cb7895 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:43.539807 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe09912-e0cc-4478-9bc5-863729cb7895 None admin] RBAC: Adding query filter params (group.id=9ee0b4fa223c4863976bbbbc81d20df2, role.id=c43aada0326446c4ade0ab1262918fa4, scope.project.id=73025fb6edfa43b88c0c690d55906c19) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:43.540303 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe09912-e0cc-4478-9bc5-863729cb7895 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:43.540542 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-7fd4ec9a-fdc8-4f8d-9a13-d851cab672ef None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 02 03:16:43.540542 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:43.540542 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:43.540542 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:43.540542 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:43.540542 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:43.540542 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:43.540542 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:43.540542 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:43.540542 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:43.540542 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:43.540542 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:43.540542 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:16:43.540542 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:16:43.540542 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:16:43.540542 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:16:43.541736 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:16:43.541736 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:16:43.541736 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:16:43.541736 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:16:43.541736 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:43.541736 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:43.541736 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:43.541736 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:43.541736 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:43.541736 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:43.541736 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:43.541736 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:43.541736 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:43.541736 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:43.541736 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:43.541736 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:43.542509 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:43.542509 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:43.542509 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:43.542509 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:43.542509 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:16:43.542509 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:16:43.542509 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:16:43.542509 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:16:43.542509 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:16:43.542509 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:16:43.542509 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 02 03:16:43.542509 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:16:43.542509 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 222/439] 10.222.0.60 () {56 vars in 1114 bytes} [Sat Jul 2 03:16:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:16:43.543160 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd4ec9a-fdc8-4f8d-9a13-d851cab672ef None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:43.545046 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe09912-e0cc-4478-9bc5-863729cb7895 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:43.552447 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 218/440] 10.222.0.60 () {56 vars in 1376 bytes} [Sat Jul 2 03:16:43 2022] GET /identity/v3/role_assignments?group.id=9ee0b4fa223c4863976bbbbc81d20df2&scope.project.id=73025fb6edfa43b88c0c690d55906c19&role.id=c43aada0326446c4ade0ab1262918fa4 => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:43.553256 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe09912-e0cc-4478-9bc5-863729cb7895 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:43.589466 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:43.674388 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd4ec9a-fdc8-4f8d-9a13-d851cab672ef None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:43.686324 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe09912-e0cc-4478-9bc5-863729cb7895 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:43.708073 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:43.716261 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba353cf-2267-43f3-9ea5-0c0aa61ef7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:43.717450 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba353cf-2267-43f3-9ea5-0c0aa61ef7e3 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:43.717945 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba353cf-2267-43f3-9ea5-0c0aa61ef7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:43.718286 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba353cf-2267-43f3-9ea5-0c0aa61ef7e3 None admin] PATH_INFO: `/v3/groups/9ee0b4fa223c4863976bbbbc81d20df2` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:43.719583 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba353cf-2267-43f3-9ea5-0c0aa61ef7e3 None admin] RBAC: Authorizing `identity:get_group(group_id=9ee0b4fa223c4863976bbbbc81d20df2)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:43.721040 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba353cf-2267-43f3-9ea5-0c0aa61ef7e3 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:43.728177 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 223/441] 10.222.0.60 () {56 vars in 1180 bytes} [Sat Jul 2 03:16:43 2022] GET /identity/v3/groups/9ee0b4fa223c4863976bbbbc81d20df2 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:43.728177 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69507f6-1a40-444d-99d5-47d5d7bf72fe None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:43.728177 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69507f6-1a40-444d-99d5-47d5d7bf72fe None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:43.728177 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69507f6-1a40-444d-99d5-47d5d7bf72fe None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:43.728177 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 224/442] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:16:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:16:43.728941 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69507f6-1a40-444d-99d5-47d5d7bf72fe None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:43.730134 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad0a04-42f9-4c17-99a2-81f9f4176f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:43.730746 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad0a04-42f9-4c17-99a2-81f9f4176f8e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:43.732495 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad0a04-42f9-4c17-99a2-81f9f4176f8e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:43.732495 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad0a04-42f9-4c17-99a2-81f9f4176f8e None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:43.732495 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ad0a04-42f9-4c17-99a2-81f9f4176f8e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:43.732495 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ad0a04-42f9-4c17-99a2-81f9f4176f8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:43.733976 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ad0a04-42f9-4c17-99a2-81f9f4176f8e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:43.743603 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 219/443] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Jul 2 03:16:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:43.744773 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411971fa-7c2f-4a37-8d91-641a34fe9c88 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:43.745792 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411971fa-7c2f-4a37-8d91-641a34fe9c88 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:43.746072 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411971fa-7c2f-4a37-8d91-641a34fe9c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:43.763814 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-411971fa-7c2f-4a37-8d91-641a34fe9c88 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:16:43.764999 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-411971fa-7c2f-4a37-8d91-641a34fe9c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:16:43.842527 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 220/444] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:16:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 03:16:43.843604 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411971fa-7c2f-4a37-8d91-641a34fe9c88 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:43.851836 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69507f6-1a40-444d-99d5-47d5d7bf72fe None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:43.864790 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:43.895650 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0568f3-a17a-4343-a780-91d23975fd23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:43.896316 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0568f3-a17a-4343-a780-91d23975fd23 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:43.896594 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0568f3-a17a-4343-a780-91d23975fd23 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:43.896870 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0568f3-a17a-4343-a780-91d23975fd23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:43.897727 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0568f3-a17a-4343-a780-91d23975fd23 None admin] RBAC: Adding query filter params (group.id=9ee0b4fa223c4863976bbbbc81d20df2, role.id=c43aada0326446c4ade0ab1262918fa4, scope.project.id=d260f7a9c3984a7d8d4d7f5aa78dcc78) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:43.898019 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0568f3-a17a-4343-a780-91d23975fd23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:43.899487 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0568f3-a17a-4343-a780-91d23975fd23 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:43.905932 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 225/445] 10.222.0.60 () {56 vars in 1376 bytes} [Sat Jul 2 03:16:43 2022] GET /identity/v3/role_assignments?group.id=9ee0b4fa223c4863976bbbbc81d20df2&scope.project.id=d260f7a9c3984a7d8d4d7f5aa78dcc78&role.id=c43aada0326446c4ade0ab1262918fa4 => generated 611 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:16:43.906738 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0568f3-a17a-4343-a780-91d23975fd23 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:43.976543 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411971fa-7c2f-4a37-8d91-641a34fe9c88 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:43.992916 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:44.022793 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621dcf5-1a06-4f14-b4ab-257c3680ce0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:44.022793 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621dcf5-1a06-4f14-b4ab-257c3680ce0a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:44.022793 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621dcf5-1a06-4f14-b4ab-257c3680ce0a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:44.022793 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621dcf5-1a06-4f14-b4ab-257c3680ce0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:44.045574 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0568f3-a17a-4343-a780-91d23975fd23 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:44.083820 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5085c8b-893e-46fc-a5f4-e651f2f23766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:44.084649 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5085c8b-893e-46fc-a5f4-e651f2f23766 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:44.084906 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5085c8b-893e-46fc-a5f4-e651f2f23766 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:44.085176 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5085c8b-893e-46fc-a5f4-e651f2f23766 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:44.098893 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5085c8b-893e-46fc-a5f4-e651f2f23766 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:16:44.109464 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-e5085c8b-893e-46fc-a5f4-e651f2f23766 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 03:16:44.109464 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:44.109464 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:44.109464 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:44.109464 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:44.109464 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:44.109464 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:44.109464 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:44.109464 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:44.109464 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:44.109464 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:44.109464 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:44.109464 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:16:44.109464 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:16:44.109464 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:16:44.109464 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:16:44.110473 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:16:44.110473 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:16:44.110473 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:16:44.110473 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:16:44.110473 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:44.110473 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:44.110473 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:44.110473 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:44.110473 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:44.110473 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:44.110473 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:44.110473 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:44.110473 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:44.110473 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:44.110473 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:44.110473 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:44.111299 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:44.111299 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:44.111299 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:44.111299 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:44.111299 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:16:44.111299 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:16:44.111299 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:16:44.111299 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:16:44.111299 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:16:44.111299 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:16:44.111299 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 03:16:44.111299 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:16:44.112283 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5621dcf5-1a06-4f14-b4ab-257c3680ce0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:44.112356 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 226/446] 10.222.0.60 () {56 vars in 1096 bytes} [Sat Jul 2 03:16:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:16:44.112430 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5621dcf5-1a06-4f14-b4ab-257c3680ce0a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:44.118562 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5085c8b-893e-46fc-a5f4-e651f2f23766 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:44.138320 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:44.243490 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5085c8b-893e-46fc-a5f4-e651f2f23766 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:44.244069 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 221/447] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Jul 2 03:16:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 03:16:44.251252 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621dcf5-1a06-4f14-b4ab-257c3680ce0a None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:44.270719 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:44.286797 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172c39df-d7fa-427e-8c51-80653cba9015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:44.287862 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c39df-d7fa-427e-8c51-80653cba9015 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:44.288324 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c39df-d7fa-427e-8c51-80653cba9015 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:44.288780 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c39df-d7fa-427e-8c51-80653cba9015 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:44.290112 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172c39df-d7fa-427e-8c51-80653cba9015 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:44.290973 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172c39df-d7fa-427e-8c51-80653cba9015 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:44.293383 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172c39df-d7fa-427e-8c51-80653cba9015 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:44.304088 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 227/448] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Jul 2 03:16:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:16:44.310153 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172c39df-d7fa-427e-8c51-80653cba9015 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:44.373204 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621dcf5-1a06-4f14-b4ab-257c3680ce0a None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:44.392101 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:44.410952 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da06a46-6843-4643-89a8-899002ac016e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:44.411865 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da06a46-6843-4643-89a8-899002ac016e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:44.412153 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da06a46-6843-4643-89a8-899002ac016e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:44.412418 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da06a46-6843-4643-89a8-899002ac016e None admin] PATH_INFO: `/v3/projects/d260f7a9c3984a7d8d4d7f5aa78dcc78` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:44.413616 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da06a46-6843-4643-89a8-899002ac016e None admin] RBAC: Authorizing `identity:get_project(project_id=d260f7a9c3984a7d8d4d7f5aa78dcc78)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:44.415102 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da06a46-6843-4643-89a8-899002ac016e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:44.417178 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 222/449] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Jul 2 03:16:44 2022] GET /identity/v3/projects/d260f7a9c3984a7d8d4d7f5aa78dcc78 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:44.425262 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172c39df-d7fa-427e-8c51-80653cba9015 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:44.430061 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da06a46-6843-4643-89a8-899002ac016e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:44.458286 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b693e62-bf1d-41ce-a24b-d69514818d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:44.459256 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b693e62-bf1d-41ce-a24b-d69514818d50 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:44.459547 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b693e62-bf1d-41ce-a24b-d69514818d50 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:44.459822 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b693e62-bf1d-41ce-a24b-d69514818d50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:44.512152 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:44.529309 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b693e62-bf1d-41ce-a24b-d69514818d50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:44.530288 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da06a46-6843-4643-89a8-899002ac016e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:44.530766 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b693e62-bf1d-41ce-a24b-d69514818d50 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:44.565733 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d6bdb-7d44-4c7f-a515-17c95a06615a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:44.566579 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d6bdb-7d44-4c7f-a515-17c95a06615a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:44.566872 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d6bdb-7d44-4c7f-a515-17c95a06615a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:44.567160 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d6bdb-7d44-4c7f-a515-17c95a06615a None admin] PATH_INFO: `/v3/groups/9ee0b4fa223c4863976bbbbc81d20df2` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:44.568380 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689d6bdb-7d44-4c7f-a515-17c95a06615a None admin] RBAC: Authorizing `identity:get_group(group_id=9ee0b4fa223c4863976bbbbc81d20df2)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:44.569825 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689d6bdb-7d44-4c7f-a515-17c95a06615a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:44.571493 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 223/450] 10.222.0.60 () {56 vars in 1180 bytes} [Sat Jul 2 03:16:44 2022] GET /identity/v3/groups/9ee0b4fa223c4863976bbbbc81d20df2 => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:16:44.577494 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d6bdb-7d44-4c7f-a515-17c95a06615a None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:44.629814 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:44.636322 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 228/451] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Jul 2 03:16:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 02 03:16:44.641926 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b693e62-bf1d-41ce-a24b-d69514818d50 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:44.678155 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d6bdb-7d44-4c7f-a515-17c95a06615a None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:44.712451 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dc2a18-a356-417b-b687-93a46f15f17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:44.713107 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc2a18-a356-417b-b687-93a46f15f17b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:44.713390 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc2a18-a356-417b-b687-93a46f15f17b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:44.713657 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc2a18-a356-417b-b687-93a46f15f17b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:44.714495 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dc2a18-a356-417b-b687-93a46f15f17b None admin] RBAC: Adding query filter params (group.id=9ee0b4fa223c4863976bbbbc81d20df2, role.id=a9792a930e0c4e139f287a712dfc7d4d, scope.project.id=d260f7a9c3984a7d8d4d7f5aa78dcc78) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:44.714806 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dc2a18-a356-417b-b687-93a46f15f17b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:44.716297 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dc2a18-a356-417b-b687-93a46f15f17b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:44.722053 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 224/452] 10.222.0.60 () {56 vars in 1376 bytes} [Sat Jul 2 03:16:44 2022] GET /identity/v3/role_assignments?group.id=9ee0b4fa223c4863976bbbbc81d20df2&scope.project.id=d260f7a9c3984a7d8d4d7f5aa78dcc78&role.id=a9792a930e0c4e139f287a712dfc7d4d => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:16:44.722759 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:44.739783 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b693e62-bf1d-41ce-a24b-d69514818d50 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:44.778870 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9246f65-45f5-4286-ab14-8266e4f6b37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:44.779692 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9246f65-45f5-4286-ab14-8266e4f6b37e None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:44.779967 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9246f65-45f5-4286-ab14-8266e4f6b37e None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:44.780235 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9246f65-45f5-4286-ab14-8266e4f6b37e None admin] PATH_INFO: `/v3/projects/b5b36ebb11744ee2a29802eb5f4d8e11` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:44.781540 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9246f65-45f5-4286-ab14-8266e4f6b37e None admin] RBAC: Authorizing `identity:get_project(project_id=b5b36ebb11744ee2a29802eb5f4d8e11)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:44.783020 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9246f65-45f5-4286-ab14-8266e4f6b37e None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:44.784815 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 229/453] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Jul 2 03:16:44 2022] GET /identity/v3/projects/b5b36ebb11744ee2a29802eb5f4d8e11 => generated 344 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:16:44.791065 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dc2a18-a356-417b-b687-93a46f15f17b None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:44.901546 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dc2a18-a356-417b-b687-93a46f15f17b None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:44.918284 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:44.935394 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3077fc5-5069-4798-9961-7d6b49992abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:44.936286 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3077fc5-5069-4798-9961-7d6b49992abc None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:44.936565 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3077fc5-5069-4798-9961-7d6b49992abc None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:44.936904 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3077fc5-5069-4798-9961-7d6b49992abc None admin] PATH_INFO: `/v3/groups/ae992c0a101b49c39360a1a2add0bbe6` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:44.938312 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3077fc5-5069-4798-9961-7d6b49992abc None admin] RBAC: Authorizing `identity:get_group(group_id=ae992c0a101b49c39360a1a2add0bbe6)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:44.940163 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3077fc5-5069-4798-9961-7d6b49992abc None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:44.942065 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 225/454] 10.222.0.60 () {56 vars in 1180 bytes} [Sat Jul 2 03:16:44 2022] GET /identity/v3/groups/ae992c0a101b49c39360a1a2add0bbe6 => generated 229 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:44.948092 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9246f65-45f5-4286-ab14-8266e4f6b37e None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:45.051196 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9246f65-45f5-4286-ab14-8266e4f6b37e None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:45.087344 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b8f7f6-0e6d-4af3-8945-c232129493cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:45.092607 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b8f7f6-0e6d-4af3-8945-c232129493cf None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:45.092607 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b8f7f6-0e6d-4af3-8945-c232129493cf None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:45.092607 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b8f7f6-0e6d-4af3-8945-c232129493cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:45.092607 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b8f7f6-0e6d-4af3-8945-c232129493cf None admin] RBAC: Adding query filter params (group.id=ae992c0a101b49c39360a1a2add0bbe6, role.id=5dcd130cda6c490595e862dc2348e83d, scope.project.id=b5b36ebb11744ee2a29802eb5f4d8e11) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:45.092607 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b8f7f6-0e6d-4af3-8945-c232129493cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:45.092607 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b8f7f6-0e6d-4af3-8945-c232129493cf None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:45.097889 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 230/455] 10.222.0.60 () {56 vars in 1376 bytes} [Sat Jul 2 03:16:44 2022] GET /identity/v3/role_assignments?group.id=ae992c0a101b49c39360a1a2add0bbe6&scope.project.id=b5b36ebb11744ee2a29802eb5f4d8e11&role.id=5dcd130cda6c490595e862dc2348e83d => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:16:47.567312 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79d8eb-1a29-4a40-9557-ac442fe7b461 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:47.567868 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79d8eb-1a29-4a40-9557-ac442fe7b461 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:47.567868 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79d8eb-1a29-4a40-9557-ac442fe7b461 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:47.569510 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 226/456] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:16:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:16:47.582131 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add5e4b-79b3-4016-8608-296b4a99bd44 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:47.582924 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add5e4b-79b3-4016-8608-296b4a99bd44 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:47.583400 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add5e4b-79b3-4016-8608-296b4a99bd44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:47.608090 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-0add5e4b-79b3-4016-8608-296b4a99bd44 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:16:47.609553 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-0add5e4b-79b3-4016-8608-296b4a99bd44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:16:47.620851 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:47.695091 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 231/457] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:16:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 03:16:47.729847 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79d8eb-1a29-4a40-9557-ac442fe7b461 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:47.793992 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb95e98-5a92-4cba-a5b8-ca0b18d0652b None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:47.794627 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb95e98-5a92-4cba-a5b8-ca0b18d0652b None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:47.795143 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb95e98-5a92-4cba-a5b8-ca0b18d0652b None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:47.796738 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 232/458] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:16:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:16:47.801915 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6275e0b-4261-4cc5-aa2d-7135d42299c5 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:47.802464 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6275e0b-4261-4cc5-aa2d-7135d42299c5 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:47.802935 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6275e0b-4261-4cc5-aa2d-7135d42299c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:47.836165 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-f6275e0b-4261-4cc5-aa2d-7135d42299c5 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:16:47.842602 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-f6275e0b-4261-4cc5-aa2d-7135d42299c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:16:47.892062 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79d8eb-1a29-4a40-9557-ac442fe7b461 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:47.955583 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0fd6dd-c3fd-43b3-9b0b-2d09bab59c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:47.957886 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0fd6dd-c3fd-43b3-9b0b-2d09bab59c3f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:47.959140 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0fd6dd-c3fd-43b3-9b0b-2d09bab59c3f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:47.960157 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0fd6dd-c3fd-43b3-9b0b-2d09bab59c3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:47.966574 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 233/459] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:16:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 02 03:16:47.974692 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0fd6dd-c3fd-43b3-9b0b-2d09bab59c3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:47.976582 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0fd6dd-c3fd-43b3-9b0b-2d09bab59c3f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:47.996863 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6275e0b-4261-4cc5-aa2d-7135d42299c5 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:48.016613 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-0e0fd6dd-c3fd-43b3-9b0b-2d09bab59c3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:16:48.016613 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:48.016613 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:48.016613 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:48.016613 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:48.016613 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:48.016613 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:48.016613 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:48.016613 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:48.016613 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:48.016613 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:48.016613 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:48.016613 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:16:48.016613 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:16:48.016613 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:16:48.017556 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:16:48.017556 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:48.017556 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:48.017556 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:48.017556 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:48.017556 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:48.017556 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:48.017556 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:48.017556 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:48.017556 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:48.017556 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:48.017556 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:48.017556 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:48.017556 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:48.017556 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:48.017556 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:48.017556 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:48.018409 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:16:48.018409 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:16:48.018409 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:16:48.018409 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:16:48.020965 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 227/460] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:16:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:16:48.028726 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0fd6dd-c3fd-43b3-9b0b-2d09bab59c3f None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:48.083541 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:48.095339 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:48.128529 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6275e0b-4261-4cc5-aa2d-7135d42299c5 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:48.167612 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0fd6dd-c3fd-43b3-9b0b-2d09bab59c3f None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:48.176108 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7cb746-4795-4d8e-b13f-04dfbab4f07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:48.177067 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7cb746-4795-4d8e-b13f-04dfbab4f07f None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:48.177446 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7cb746-4795-4d8e-b13f-04dfbab4f07f None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:48.178257 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7cb746-4795-4d8e-b13f-04dfbab4f07f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:48.192906 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7cb746-4795-4d8e-b13f-04dfbab4f07f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:48.194811 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7cb746-4795-4d8e-b13f-04dfbab4f07f None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:48.203572 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192bbe63-c8d8-4dc5-baa4-c3cddb9fdd51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:48.204495 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192bbe63-c8d8-4dc5-baa4-c3cddb9fdd51 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:48.205012 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192bbe63-c8d8-4dc5-baa4-c3cddb9fdd51 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:48.205512 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192bbe63-c8d8-4dc5-baa4-c3cddb9fdd51 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:48.206649 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192bbe63-c8d8-4dc5-baa4-c3cddb9fdd51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:48.207180 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192bbe63-c8d8-4dc5-baa4-c3cddb9fdd51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:48.208765 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192bbe63-c8d8-4dc5-baa4-c3cddb9fdd51 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:48.215801 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-7a7cb746-4795-4d8e-b13f-04dfbab4f07f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:16:48.215801 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:48.215801 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:48.215801 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:48.215801 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:48.215801 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:48.215801 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:48.215801 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:48.215801 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:48.215801 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:48.215801 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:48.215801 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:48.215801 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:16:48.215801 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:16:48.215801 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:16:48.216620 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:16:48.216620 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:48.216620 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:48.216620 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:48.216620 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:48.216620 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:48.216620 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:48.216620 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:48.216620 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:48.216620 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:48.216620 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:48.216620 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:48.216620 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:48.216620 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:48.216620 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:48.216620 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:48.216620 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:48.222069 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:16:48.222069 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:16:48.222069 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:16:48.222069 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:16:48.222069 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 234/461] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:16:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 03:16:48.222069 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceafe3e7-3772-491e-89d1-64283025edb5 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:48.222069 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceafe3e7-3772-491e-89d1-64283025edb5 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:48.222069 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceafe3e7-3772-491e-89d1-64283025edb5 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:48.222069 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 235/462] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:16:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:16:48.225856 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceafe3e7-3772-491e-89d1-64283025edb5 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:48.230672 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 228/463] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:16:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:48.232413 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f14bc04-92ed-4b81-bd7a-1ff5d5901472 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:48.233006 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f14bc04-92ed-4b81-bd7a-1ff5d5901472 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:48.233484 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f14bc04-92ed-4b81-bd7a-1ff5d5901472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:48.250394 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-3f14bc04-92ed-4b81-bd7a-1ff5d5901472 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:16:48.251950 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3f14bc04-92ed-4b81-bd7a-1ff5d5901472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:16:48.331674 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 229/464] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:16:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 03:16:48.332994 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f14bc04-92ed-4b81-bd7a-1ff5d5901472 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:48.366084 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceafe3e7-3772-491e-89d1-64283025edb5 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:48.368401 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:48.400224 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:48.409969 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c29c4-7262-465b-8ad5-689041827dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:48.410705 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c29c4-7262-465b-8ad5-689041827dec None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:48.410978 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c29c4-7262-465b-8ad5-689041827dec None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:48.411276 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c29c4-7262-465b-8ad5-689041827dec None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:48.411999 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535c29c4-7262-465b-8ad5-689041827dec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:48.412298 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535c29c4-7262-465b-8ad5-689041827dec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:48.413653 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535c29c4-7262-465b-8ad5-689041827dec None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:48.426059 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 236/465] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:16:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:48.431972 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e109f3a-7f42-41e8-a6ba-218317faee50 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:48.432262 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e109f3a-7f42-41e8-a6ba-218317faee50 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:48.432529 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e109f3a-7f42-41e8-a6ba-218317faee50 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:48.433989 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 237/466] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:16:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:16:48.434828 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e109f3a-7f42-41e8-a6ba-218317faee50 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:48.454178 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f14bc04-92ed-4b81-bd7a-1ff5d5901472 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:48.490557 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b931a7-bf62-4f85-8cab-82da91e7f55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:48.491197 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b931a7-bf62-4f85-8cab-82da91e7f55e None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:48.491477 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b931a7-bf62-4f85-8cab-82da91e7f55e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:48.491751 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b931a7-bf62-4f85-8cab-82da91e7f55e None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:48.492452 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b931a7-bf62-4f85-8cab-82da91e7f55e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:48.493903 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b931a7-bf62-4f85-8cab-82da91e7f55e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:48.527374 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 230/467] 10.222.0.60 () {60 vars in 1132 bytes} [Sat Jul 2 03:16:48 2022] POST /identity/v3/users => generated 246 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:16:48.528637 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b931a7-bf62-4f85-8cab-82da91e7f55e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:48.552256 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e109f3a-7f42-41e8-a6ba-218317faee50 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:48.595130 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2406e-90a1-442c-b45a-8a3783a7ba76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:48.596084 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2406e-90a1-442c-b45a-8a3783a7ba76 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:48.596573 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2406e-90a1-442c-b45a-8a3783a7ba76 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:48.597059 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2406e-90a1-442c-b45a-8a3783a7ba76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:48.609815 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c2406e-90a1-442c-b45a-8a3783a7ba76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:48.611742 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c2406e-90a1-442c-b45a-8a3783a7ba76 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:48.630940 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-70c2406e-90a1-442c-b45a-8a3783a7ba76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:16:48.630940 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:48.630940 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:48.630940 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:48.630940 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:48.630940 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:48.630940 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:48.630940 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:48.630940 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:48.630940 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:48.630940 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:48.630940 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:48.630940 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:16:48.630940 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:16:48.630940 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:16:48.631891 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:16:48.631891 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:48.631891 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:48.631891 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:48.631891 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:48.631891 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:48.631891 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:48.631891 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:48.631891 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:48.631891 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:48.631891 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:48.631891 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:48.631891 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:48.631891 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:48.631891 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:48.631891 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:48.631891 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:48.632727 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:16:48.632727 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:16:48.632727 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:16:48.632727 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:16:48.639895 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 238/468] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:16:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:16:48.641716 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60b99e-797a-4dc7-a75a-547bde6ebd51 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:48.642211 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60b99e-797a-4dc7-a75a-547bde6ebd51 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:48.642723 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60b99e-797a-4dc7-a75a-547bde6ebd51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:48.651228 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:48.664221 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-9a60b99e-797a-4dc7-a75a-547bde6ebd51 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:16:48.666239 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-9a60b99e-797a-4dc7-a75a-547bde6ebd51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:16:48.680679 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b931a7-bf62-4f85-8cab-82da91e7f55e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:48.708883 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:48.725159 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d83aa5-1222-4ac0-a1cc-f495b480dc06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:48.725843 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d83aa5-1222-4ac0-a1cc-f495b480dc06 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:48.726172 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d83aa5-1222-4ac0-a1cc-f495b480dc06 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:48.726449 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d83aa5-1222-4ac0-a1cc-f495b480dc06 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:48.727185 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d83aa5-1222-4ac0-a1cc-f495b480dc06 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:48.728659 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d83aa5-1222-4ac0-a1cc-f495b480dc06 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:48.753345 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 239/469] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:16:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 03:16:48.753959 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a60b99e-797a-4dc7-a75a-547bde6ebd51 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:48.758369 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 231/470] 10.222.0.60 () {60 vars in 1132 bytes} [Sat Jul 2 03:16:48 2022] POST /identity/v3/users => generated 248 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:16:48.790101 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d83aa5-1222-4ac0-a1cc-f495b480dc06 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:48.883837 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a60b99e-797a-4dc7-a75a-547bde6ebd51 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:48.947374 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d83aa5-1222-4ac0-a1cc-f495b480dc06 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:48.952695 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9e0892-ddc6-419c-829e-55c84b8d58b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:48.953370 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e0892-ddc6-419c-829e-55c84b8d58b3 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:48.953647 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e0892-ddc6-419c-829e-55c84b8d58b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:48.953920 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e0892-ddc6-419c-829e-55c84b8d58b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:48.954644 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9e0892-ddc6-419c-829e-55c84b8d58b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:48.954944 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9e0892-ddc6-419c-829e-55c84b8d58b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:48.956385 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9e0892-ddc6-419c-829e-55c84b8d58b3 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:48.969390 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 240/471] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:16:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:48.974625 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9e0892-ddc6-419c-829e-55c84b8d58b3 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:48.984045 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ce228-4e69-4438-b198-6360027ccdd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:48.984862 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ce228-4e69-4438-b198-6360027ccdd9 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:48.985139 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ce228-4e69-4438-b198-6360027ccdd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:48.985410 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ce228-4e69-4438-b198-6360027ccdd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:48.992473 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:48.996612 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321ce228-4e69-4438-b198-6360027ccdd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:48.998160 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321ce228-4e69-4438-b198-6360027ccdd9 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:49.007928 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:49.017042 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-321ce228-4e69-4438-b198-6360027ccdd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:16:49.017042 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:49.017042 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:49.017042 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:49.017042 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:49.017042 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:49.017042 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:49.017042 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:49.017042 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:49.017042 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:49.017042 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:49.017042 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:49.017042 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:16:49.017042 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:16:49.017042 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:16:49.017917 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:16:49.017917 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:49.017917 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:49.017917 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:49.017917 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:49.017917 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:49.017917 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:49.017917 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:49.017917 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:49.017917 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:49.017917 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:49.017917 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:49.017917 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:49.017917 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:49.017917 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:49.017917 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:49.017917 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:49.018781 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:16:49.018781 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:16:49.018781 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:16:49.018781 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:16:49.018998 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 232/472] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:16:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:16:49.027386 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ce228-4e69-4438-b198-6360027ccdd9 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:49.087031 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9e0892-ddc6-419c-829e-55c84b8d58b3 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:49.130432 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a271920e-a096-45ce-a036-f7e3bc35020e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:49.131305 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a271920e-a096-45ce-a036-f7e3bc35020e None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:49.131514 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a271920e-a096-45ce-a036-f7e3bc35020e None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:49.131780 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a271920e-a096-45ce-a036-f7e3bc35020e None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:49.132491 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a271920e-a096-45ce-a036-f7e3bc35020e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:49.133925 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a271920e-a096-45ce-a036-f7e3bc35020e None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:49.153633 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ce228-4e69-4438-b198-6360027ccdd9 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:49.159597 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 241/473] 10.222.0.60 () {60 vars in 1132 bytes} [Sat Jul 2 03:16:48 2022] POST /identity/v3/users => generated 248 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 03:16:49.160920 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4d30d-0260-435c-a730-9718fa76d49b None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:49.161204 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4d30d-0260-435c-a730-9718fa76d49b None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:49.161916 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4d30d-0260-435c-a730-9718fa76d49b None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:49.163532 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 242/474] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:16:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:16:49.171675 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5540f4-7f4f-4dbc-8015-de84942884ea None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:49.172008 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5540f4-7f4f-4dbc-8015-de84942884ea None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:49.172217 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5540f4-7f4f-4dbc-8015-de84942884ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:49.202640 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-df5540f4-7f4f-4dbc-8015-de84942884ea None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:16:49.204088 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-df5540f4-7f4f-4dbc-8015-de84942884ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:16:49.212691 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a042f5e-0f88-4558-bbe2-389a34ece243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:49.213431 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a042f5e-0f88-4558-bbe2-389a34ece243 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:49.213713 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a042f5e-0f88-4558-bbe2-389a34ece243 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:49.213983 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a042f5e-0f88-4558-bbe2-389a34ece243 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:49.214741 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a042f5e-0f88-4558-bbe2-389a34ece243 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:49.215105 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a042f5e-0f88-4558-bbe2-389a34ece243 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:49.216667 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a042f5e-0f88-4558-bbe2-389a34ece243 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:49.246650 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 233/475] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:16:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:49.249452 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a042f5e-0f88-4558-bbe2-389a34ece243 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:49.335542 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:49.342186 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 243/476] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:16:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 03:16:49.373761 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5540f4-7f4f-4dbc-8015-de84942884ea None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:49.402494 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a042f5e-0f88-4558-bbe2-389a34ece243 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:49.425375 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:49.445899 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3732a7b5-eefe-491a-8d8c-026ae90d31b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:49.446936 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732a7b5-eefe-491a-8d8c-026ae90d31b7 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:49.447441 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732a7b5-eefe-491a-8d8c-026ae90d31b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:49.447975 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732a7b5-eefe-491a-8d8c-026ae90d31b7 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:49.448912 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3732a7b5-eefe-491a-8d8c-026ae90d31b7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:49.450699 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3732a7b5-eefe-491a-8d8c-026ae90d31b7 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:49.475538 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 234/477] 10.222.0.60 () {60 vars in 1132 bytes} [Sat Jul 2 03:16:49 2022] POST /identity/v3/users => generated 249 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 03:16:49.516943 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5540f4-7f4f-4dbc-8015-de84942884ea None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:49.557472 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6d316d-77ba-4453-a4ed-6e802cfb2850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:49.558611 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d316d-77ba-4453-a4ed-6e802cfb2850 None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:49.559092 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d316d-77ba-4453-a4ed-6e802cfb2850 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:49.559649 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d316d-77ba-4453-a4ed-6e802cfb2850 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:49.560659 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6d316d-77ba-4453-a4ed-6e802cfb2850 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:49.562459 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6d316d-77ba-4453-a4ed-6e802cfb2850 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:49.570888 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.sql.core [None req-8c6d316d-77ba-4453-a4ed-6e802cfb2850 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 02 03:16:49.570888 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 02 03:16:49.570888 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [parameters: {'id': '84415c2ff1e44d3bb4a63e157c2084bc', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 02 03:16:49.570888 dv-cinder-846842-9-smb devstack@keystone.service[80233]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80233) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 02 03:16:49.590786 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-8c6d316d-77ba-4453-a4ed-6e802cfb2850 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 02 03:16:49.590786 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:49.590786 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 02 03:16:49.590786 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 02 03:16:49.590786 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 02 03:16:49.590786 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 02 03:16:49.590786 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 02 03:16:49.590786 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application result = self._query(query) Jul 02 03:16:49.590786 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 02 03:16:49.590786 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application conn.query(q) Jul 02 03:16:49.590786 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 02 03:16:49.590786 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 02 03:16:49.590786 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 02 03:16:49.590786 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application result.read() Jul 02 03:16:49.590786 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 02 03:16:49.591779 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 02 03:16:49.591779 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 02 03:16:49.591779 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 02 03:16:49.591779 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 02 03:16:49.591779 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 02 03:16:49.591779 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 02 03:16:49.591779 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 02 03:16:49.591779 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 02 03:16:49.591779 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:16:49.591779 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 02 03:16:49.591779 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:16:49.591779 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:49.591779 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 02 03:16:49.591779 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 02 03:16:49.591779 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 02 03:16:49.591779 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return ref.to_dict() Jul 02 03:16:49.591779 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 02 03:16:49.591779 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application next(self.gen) Jul 02 03:16:49.592718 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 02 03:16:49.592718 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application yield resource Jul 02 03:16:49.592718 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 02 03:16:49.592718 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application next(self.gen) Jul 02 03:16:49.592718 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 02 03:16:49.592718 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self.session.rollback() Jul 02 03:16:49.592718 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 02 03:16:49.592718 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self.force_reraise() Jul 02 03:16:49.592718 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 02 03:16:49.592718 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise self.value Jul 02 03:16:49.592718 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 02 03:16:49.592718 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 02 03:16:49.592718 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 02 03:16:49.592718 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application session.commit() Jul 02 03:16:49.592718 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 02 03:16:49.592718 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 02 03:16:49.592718 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 02 03:16:49.593566 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._prepare_impl() Jul 02 03:16:49.593566 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 02 03:16:49.593566 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self.session.flush() Jul 02 03:16:49.593566 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 02 03:16:49.593566 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._flush(objects) Jul 02 03:16:49.593566 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 02 03:16:49.593566 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 02 03:16:49.593566 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 02 03:16:49.593566 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application compat.raise_( Jul 02 03:16:49.593566 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 02 03:16:49.593566 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception Jul 02 03:16:49.593566 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 02 03:16:49.593566 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application flush_context.execute() Jul 02 03:16:49.593566 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 02 03:16:49.593566 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rec.execute(self) Jul 02 03:16:49.593566 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 02 03:16:49.593566 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 02 03:16:49.594528 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 02 03:16:49.594528 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 02 03:16:49.594528 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 02 03:16:49.594528 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 02 03:16:49.594528 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 02 03:16:49.594528 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 02 03:16:49.594528 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 02 03:16:49.594528 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 02 03:16:49.594528 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 02 03:16:49.594528 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 02 03:16:49.594528 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 02 03:16:49.594528 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 02 03:16:49.594528 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 02 03:16:49.594528 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 02 03:16:49.594528 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 02 03:16:49.594528 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception Jul 02 03:16:49.598178 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 02 03:16:49.598178 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 02 03:16:49.598178 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 02 03:16:49.598178 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 02 03:16:49.598178 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 02 03:16:49.598178 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application result = self._query(query) Jul 02 03:16:49.598178 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 02 03:16:49.598178 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application conn.query(q) Jul 02 03:16:49.598178 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 02 03:16:49.598178 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 02 03:16:49.598178 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 02 03:16:49.598178 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application result.read() Jul 02 03:16:49.598178 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 02 03:16:49.598178 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 02 03:16:49.598178 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 02 03:16:49.598178 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 02 03:16:49.600501 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 02 03:16:49.600501 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 02 03:16:49.600501 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 02 03:16:49.600501 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 02 03:16:49.600501 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 02 03:16:49.600501 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 02 03:16:49.600501 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [parameters: {'id': '84415c2ff1e44d3bb4a63e157c2084bc', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 02 03:16:49.600501 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 02 03:16:49.600501 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:16:49.600501 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 03:16:49.600501 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:16:49.600501 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:49.600501 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:49.600501 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:49.600501 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:49.600501 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:49.603279 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:49.603279 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:49.603279 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:49.603279 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:49.603279 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:49.603279 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:49.603279 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 02 03:16:49.603279 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 02 03:16:49.603279 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:49.603279 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:49.603279 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 02 03:16:49.603279 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 02 03:16:49.603279 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 02 03:16:49.603279 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 02 03:16:49.603279 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 02 03:16:49.603279 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:16:49.607004 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 244/478] 10.222.0.60 () {60 vars in 1131 bytes} [Sat Jul 2 03:16:49 2022] POST /identity/v3/roles => generated 144 bytes in 233 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:16:49.612632 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3732a7b5-eefe-491a-8d8c-026ae90d31b7 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:49.736454 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3732a7b5-eefe-491a-8d8c-026ae90d31b7 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:49.744235 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:49.773126 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b18083-d94f-478e-806e-59641af2a470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:49.773939 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b18083-d94f-478e-806e-59641af2a470 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:49.774215 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b18083-d94f-478e-806e-59641af2a470 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:49.774487 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b18083-d94f-478e-806e-59641af2a470 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:49.784958 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b18083-d94f-478e-806e-59641af2a470 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:16:49.793428 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-b6b18083-d94f-478e-806e-59641af2a470 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 02 03:16:49.793428 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:49.793428 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:49.793428 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:49.793428 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:49.793428 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:49.793428 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:49.793428 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:49.793428 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:49.793428 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:49.793428 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:49.793428 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:49.793428 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:16:49.793428 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:16:49.793428 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:16:49.793428 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:16:49.794319 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:16:49.794319 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:16:49.794319 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:16:49.794319 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:16:49.794319 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:49.794319 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:49.794319 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:49.794319 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:49.794319 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:49.794319 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:49.794319 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:49.794319 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:49.794319 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:49.794319 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:49.794319 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:49.794319 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:49.795103 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:49.795103 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:49.795103 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:49.795103 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:49.795103 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:16:49.795103 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:16:49.795103 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:16:49.795103 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:16:49.795103 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:16:49.795103 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:16:49.795103 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 02 03:16:49.795103 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:16:49.796221 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 235/479] 10.222.0.60 () {56 vars in 1114 bytes} [Sat Jul 2 03:16:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:16:49.801157 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6d316d-77ba-4453-a4ed-6e802cfb2850 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:49.888855 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:49.915948 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6d316d-77ba-4453-a4ed-6e802cfb2850 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:49.960792 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6912d1ea-4b9f-48de-b085-f8b9bdf00a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:49.961463 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912d1ea-4b9f-48de-b085-f8b9bdf00a85 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:49.961739 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912d1ea-4b9f-48de-b085-f8b9bdf00a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:49.962010 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912d1ea-4b9f-48de-b085-f8b9bdf00a85 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:49.962763 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6912d1ea-4b9f-48de-b085-f8b9bdf00a85 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:49.963067 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6912d1ea-4b9f-48de-b085-f8b9bdf00a85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:49.964471 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6912d1ea-4b9f-48de-b085-f8b9bdf00a85 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:49.975872 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 245/480] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Jul 2 03:16:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:51.005540 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3fb6fd-de62-41bc-a56d-a52d2e897f28 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:51.006107 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3fb6fd-de62-41bc-a56d-a52d2e897f28 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:51.006107 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3fb6fd-de62-41bc-a56d-a52d2e897f28 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:51.008180 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 236/481] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:16:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:16:51.015082 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910a355-e8e3-4a1e-85d5-3bf66752e88a None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:51.015633 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910a355-e8e3-4a1e-85d5-3bf66752e88a None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:51.015633 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910a355-e8e3-4a1e-85d5-3bf66752e88a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:51.042911 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-e910a355-e8e3-4a1e-85d5-3bf66752e88a None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:16:51.044153 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-e910a355-e8e3-4a1e-85d5-3bf66752e88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:16:51.133748 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 246/482] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:16:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 03:16:51.177097 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3fb6fd-de62-41bc-a56d-a52d2e897f28 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:51.273486 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28298214-08e8-4b32-9245-6c788c0bdb77 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:51.273676 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28298214-08e8-4b32-9245-6c788c0bdb77 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:51.273947 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28298214-08e8-4b32-9245-6c788c0bdb77 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:51.275747 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 247/483] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:16:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:16:51.280540 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c055148-25f6-4054-930e-a8422ed00707 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:51.280837 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c055148-25f6-4054-930e-a8422ed00707 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:51.281110 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c055148-25f6-4054-930e-a8422ed00707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:51.299932 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3fb6fd-de62-41bc-a56d-a52d2e897f28 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:51.311267 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-4c055148-25f6-4054-930e-a8422ed00707 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:16:51.312486 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-4c055148-25f6-4054-930e-a8422ed00707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:16:51.385348 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c426cb38-b9bb-4c1a-96b5-fec452c4962a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:51.385348 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c426cb38-b9bb-4c1a-96b5-fec452c4962a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:51.385348 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c426cb38-b9bb-4c1a-96b5-fec452c4962a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:51.385348 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c426cb38-b9bb-4c1a-96b5-fec452c4962a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:51.407503 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c426cb38-b9bb-4c1a-96b5-fec452c4962a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:16:51.422806 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-c426cb38-b9bb-4c1a-96b5-fec452c4962a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 02 03:16:51.422806 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:51.422806 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:51.422806 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:51.422806 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:51.422806 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:51.422806 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:51.422806 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:51.422806 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:51.422806 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:51.422806 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:51.422806 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:51.422806 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:16:51.422806 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:16:51.422806 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:16:51.422806 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:16:51.423775 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:16:51.423775 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:16:51.423775 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:16:51.423775 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:16:51.423775 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:51.423775 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:51.423775 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:51.423775 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:51.423775 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:51.423775 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:51.423775 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:51.423775 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:51.423775 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:51.423775 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:51.423775 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:51.423775 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:51.424554 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:51.424554 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:51.424554 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:51.424554 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:51.424554 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:16:51.424554 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:16:51.424554 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:16:51.424554 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:16:51.424554 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:16:51.424554 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:16:51.424554 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 02 03:16:51.424554 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:16:51.426989 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 237/484] 10.222.0.60 () {56 vars in 1102 bytes} [Sat Jul 2 03:16:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:16:51.434179 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c426cb38-b9bb-4c1a-96b5-fec452c4962a None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:51.441282 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 248/485] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:16:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 02 03:16:51.487485 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:51.496455 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c055148-25f6-4054-930e-a8422ed00707 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:51.499201 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:51.606355 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c426cb38-b9bb-4c1a-96b5-fec452c4962a None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:51.648518 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c055148-25f6-4054-930e-a8422ed00707 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:51.683346 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf9572-8e33-4e98-a13f-32cb0d25d1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:51.684485 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf9572-8e33-4e98-a13f-32cb0d25d1d6 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:51.687663 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf9572-8e33-4e98-a13f-32cb0d25d1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:51.688176 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf9572-8e33-4e98-a13f-32cb0d25d1d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:51.689144 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bf9572-8e33-4e98-a13f-32cb0d25d1d6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:51.689648 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bf9572-8e33-4e98-a13f-32cb0d25d1d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:51.691272 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bf9572-8e33-4e98-a13f-32cb0d25d1d6 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:51.706890 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 238/486] 10.222.0.60 () {56 vars in 1103 bytes} [Sat Jul 2 03:16:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:51.713718 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf9572-8e33-4e98-a13f-32cb0d25d1d6 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:51.728401 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be6b54-5465-4843-be22-6e667c260613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:51.729573 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be6b54-5465-4843-be22-6e667c260613 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:51.730053 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be6b54-5465-4843-be22-6e667c260613 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:51.730552 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be6b54-5465-4843-be22-6e667c260613 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:51.749481 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4be6b54-5465-4843-be22-6e667c260613 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:16:51.758510 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-a4be6b54-5465-4843-be22-6e667c260613 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 02 03:16:51.758510 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:51.758510 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:51.758510 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:51.758510 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:51.758510 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:51.758510 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:51.758510 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:51.758510 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:51.758510 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:51.758510 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:51.758510 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:51.758510 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:16:51.758510 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:16:51.758510 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:16:51.758510 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:16:51.759412 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:16:51.759412 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:16:51.759412 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:16:51.759412 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:16:51.759412 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:51.759412 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:51.759412 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:51.759412 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:51.759412 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:51.759412 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:51.759412 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:51.759412 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:51.759412 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:51.759412 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:51.759412 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:51.759412 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:51.760216 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:51.760216 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:51.760216 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:51.760216 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:51.760216 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:16:51.760216 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:16:51.760216 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:16:51.760216 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:16:51.760216 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:16:51.760216 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:16:51.760216 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 02 03:16:51.760216 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:16:51.767809 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 249/487] 10.222.0.60 () {56 vars in 1102 bytes} [Sat Jul 2 03:16:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 03:16:51.769842 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be6b54-5465-4843-be22-6e667c260613 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:51.887244 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:51.907537 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:51.922284 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf9572-8e33-4e98-a13f-32cb0d25d1d6 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:51.938224 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be6b54-5465-4843-be22-6e667c260613 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:51.956578 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016fabef-40d6-42c0-976e-35e6b1576685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:51.957695 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016fabef-40d6-42c0-976e-35e6b1576685 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:51.958205 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016fabef-40d6-42c0-976e-35e6b1576685 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:51.958672 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016fabef-40d6-42c0-976e-35e6b1576685 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:51.969677 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016fabef-40d6-42c0-976e-35e6b1576685 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:51.971484 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016fabef-40d6-42c0-976e-35e6b1576685 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:51.973414 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aed4b9-9078-4f17-8c03-9388f47fadd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:51.974089 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aed4b9-9078-4f17-8c03-9388f47fadd0 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:51.974365 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aed4b9-9078-4f17-8c03-9388f47fadd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:51.974634 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aed4b9-9078-4f17-8c03-9388f47fadd0 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:51.975426 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aed4b9-9078-4f17-8c03-9388f47fadd0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:51.975732 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aed4b9-9078-4f17-8c03-9388f47fadd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:51.977283 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aed4b9-9078-4f17-8c03-9388f47fadd0 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:51.991723 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 250/488] 10.222.0.60 () {56 vars in 1103 bytes} [Sat Jul 2 03:16:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:51.993081 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f743610-09ab-4b8f-950b-8af600554349 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:51.993368 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f743610-09ab-4b8f-950b-8af600554349 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:51.993646 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f743610-09ab-4b8f-950b-8af600554349 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:51.995168 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 251/489] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:16:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:16:51.995381 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-016fabef-40d6-42c0-976e-35e6b1576685 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:16:51.995381 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:51.995381 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:51.995381 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:51.995381 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:51.995381 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:51.995381 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:51.995381 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:51.995381 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:51.995381 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:51.995381 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:51.995381 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:51.995381 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:16:51.995381 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:16:51.995381 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:16:51.996272 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:16:51.996272 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:51.996272 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:51.996272 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:51.996272 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:51.996272 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:51.996272 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:51.996272 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:51.996272 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:51.996272 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:51.996272 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:51.996272 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:51.996272 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:51.996272 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:51.996272 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:51.996272 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:51.996272 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:51.997139 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:16:51.997139 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:16:51.997139 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:16:51.997139 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:16:51.997354 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f743610-09ab-4b8f-950b-8af600554349 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:51.999433 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 239/490] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:16:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:16:52.002191 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f2899-c876-4007-bb42-590c0fc31a3b None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:52.002694 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f2899-c876-4007-bb42-590c0fc31a3b None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:52.003180 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f2899-c876-4007-bb42-590c0fc31a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:52.026236 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-6a7f2899-c876-4007-bb42-590c0fc31a3b None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:16:52.028604 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-6a7f2899-c876-4007-bb42-590c0fc31a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:16:52.106687 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f743610-09ab-4b8f-950b-8af600554349 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:52.107427 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 240/491] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:16:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 03:16:52.108281 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7f2899-c876-4007-bb42-590c0fc31a3b None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:52.141668 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:52.152079 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2537725-63e2-4efe-adec-211fd7b0c3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:52.152902 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2537725-63e2-4efe-adec-211fd7b0c3ad None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:52.153186 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2537725-63e2-4efe-adec-211fd7b0c3ad None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:52.153459 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2537725-63e2-4efe-adec-211fd7b0c3ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:52.164460 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2537725-63e2-4efe-adec-211fd7b0c3ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:52.166310 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2537725-63e2-4efe-adec-211fd7b0c3ad None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:52.183769 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-a2537725-63e2-4efe-adec-211fd7b0c3ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:16:52.183769 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:52.183769 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:52.183769 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:52.183769 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:52.183769 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:52.183769 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:52.183769 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:52.183769 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:52.183769 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:52.183769 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:52.183769 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:52.183769 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:16:52.183769 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:16:52.183769 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:16:52.184622 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:16:52.184622 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:52.184622 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:52.184622 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:52.184622 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:52.184622 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:52.184622 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:52.184622 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:52.184622 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:52.184622 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:52.184622 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:52.184622 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:52.184622 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:52.184622 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:52.184622 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:52.184622 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:52.184622 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:52.185442 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:16:52.185442 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:16:52.185442 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:16:52.185442 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:16:52.185442 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 252/492] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:16:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:16:52.186357 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb02123-6bc0-42fa-85df-516f90bc5247 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:52.186466 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb02123-6bc0-42fa-85df-516f90bc5247 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:52.186728 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb02123-6bc0-42fa-85df-516f90bc5247 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:52.188136 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 253/493] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:16:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:16:52.188684 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb02123-6bc0-42fa-85df-516f90bc5247 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:52.196758 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:52.232922 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7f2899-c876-4007-bb42-590c0fc31a3b None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:52.269421 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be6fff9-c38c-41aa-a55f-b743966e81f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:52.270372 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6fff9-c38c-41aa-a55f-b743966e81f3 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:52.270828 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6fff9-c38c-41aa-a55f-b743966e81f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:52.271701 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6fff9-c38c-41aa-a55f-b743966e81f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:52.272630 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be6fff9-c38c-41aa-a55f-b743966e81f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:52.273456 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be6fff9-c38c-41aa-a55f-b743966e81f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:52.275604 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be6fff9-c38c-41aa-a55f-b743966e81f3 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:52.293083 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 241/494] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:16:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:52.293083 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f42a5-db25-475c-b55e-0f749c806d64 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:52.293083 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f42a5-db25-475c-b55e-0f749c806d64 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:52.293083 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f42a5-db25-475c-b55e-0f749c806d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:52.302886 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb02123-6bc0-42fa-85df-516f90bc5247 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:52.308453 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-6f8f42a5-db25-475c-b55e-0f749c806d64 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:16:52.309670 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-6f8f42a5-db25-475c-b55e-0f749c806d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:16:52.337452 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f5c602-9638-4afc-af20-09ec25a4991d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:52.338598 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f5c602-9638-4afc-af20-09ec25a4991d None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:52.339040 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f5c602-9638-4afc-af20-09ec25a4991d None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:52.339347 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f5c602-9638-4afc-af20-09ec25a4991d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:52.349687 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f5c602-9638-4afc-af20-09ec25a4991d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:16:52.357558 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-88f5c602-9638-4afc-af20-09ec25a4991d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 02 03:16:52.357558 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:52.357558 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:52.357558 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:52.357558 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:52.357558 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:52.357558 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:52.357558 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:52.357558 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:52.357558 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:52.357558 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:52.357558 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:52.357558 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:16:52.357558 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:16:52.357558 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:16:52.357558 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:16:52.358456 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:16:52.358456 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:16:52.358456 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:16:52.358456 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:16:52.358456 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:52.358456 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:52.358456 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:52.358456 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:52.358456 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:52.358456 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:52.358456 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:52.358456 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:52.358456 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:52.358456 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:52.358456 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:52.358456 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:52.359283 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:52.359283 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:52.359283 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:52.359283 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:52.359283 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:16:52.359283 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:16:52.359283 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:16:52.359283 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:16:52.359283 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:16:52.359283 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:16:52.359283 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 02 03:16:52.359283 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:16:52.359283 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 254/495] 10.222.0.60 () {56 vars in 1102 bytes} [Sat Jul 2 03:16:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:16:52.359936 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f5c602-9638-4afc-af20-09ec25a4991d None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:52.399224 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 242/496] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:16:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 03:16:52.399224 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f42a5-db25-475c-b55e-0f749c806d64 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:52.412011 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:52.454003 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:52.483605 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f5c602-9638-4afc-af20-09ec25a4991d None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:52.494769 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f42a5-db25-475c-b55e-0f749c806d64 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:52.520248 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc9cfe9-8eb8-4885-911a-be78ceff3ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:52.521016 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc9cfe9-8eb8-4885-911a-be78ceff3ca8 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:52.521369 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc9cfe9-8eb8-4885-911a-be78ceff3ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:52.521641 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc9cfe9-8eb8-4885-911a-be78ceff3ca8 None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:52.522362 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc9cfe9-8eb8-4885-911a-be78ceff3ca8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:52.522665 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc9cfe9-8eb8-4885-911a-be78ceff3ca8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:52.524216 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc9cfe9-8eb8-4885-911a-be78ceff3ca8 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:52.529925 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e38f3a-2bf1-4376-af57-5c606991f9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:52.530716 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e38f3a-2bf1-4376-af57-5c606991f9e6 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:52.530987 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e38f3a-2bf1-4376-af57-5c606991f9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:52.531294 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e38f3a-2bf1-4376-af57-5c606991f9e6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:52.541098 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 255/497] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:16:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:52.541098 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc9cfe9-8eb8-4885-911a-be78ceff3ca8 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:52.541294 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e38f3a-2bf1-4376-af57-5c606991f9e6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:52.542622 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e38f3a-2bf1-4376-af57-5c606991f9e6 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:52.559778 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-34e38f3a-2bf1-4376-af57-5c606991f9e6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 02 03:16:52.559778 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:52.559778 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:52.559778 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:52.559778 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:52.559778 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:52.559778 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:52.559778 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:52.559778 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:52.559778 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:52.559778 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:52.559778 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:52.559778 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 03:16:52.559778 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 03:16:52.559778 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 03:16:52.559778 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 03:16:52.560739 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:52.560739 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:52.560739 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 03:16:52.560739 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 03:16:52.560739 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 03:16:52.560739 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 03:16:52.560739 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:52.560739 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:52.560739 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:52.560739 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:52.560739 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:52.560739 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:52.560739 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:52.560739 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:52.560739 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:52.560739 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:52.560739 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:52.560739 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:52.561620 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:52.561620 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:52.561620 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 03:16:52.561620 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 03:16:52.561620 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 03:16:52.561620 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 03:16:52.561620 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 03:16:52.561620 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 03:16:52.561620 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 02 03:16:52.561620 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:16:52.561620 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 243/498] 10.222.0.60 () {56 vars in 1093 bytes} [Sat Jul 2 03:16:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:16:52.562167 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e38f3a-2bf1-4376-af57-5c606991f9e6 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:52.647989 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:52.655025 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc9cfe9-8eb8-4885-911a-be78ceff3ca8 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:52.666051 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e38f3a-2bf1-4376-af57-5c606991f9e6 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:52.686770 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:52.692791 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a81823-39cf-49d5-80b1-61e02c23e6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:52.693461 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a81823-39cf-49d5-80b1-61e02c23e6e0 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:52.693741 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a81823-39cf-49d5-80b1-61e02c23e6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:52.694004 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a81823-39cf-49d5-80b1-61e02c23e6e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:52.694857 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a81823-39cf-49d5-80b1-61e02c23e6e0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:52.695061 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a81823-39cf-49d5-80b1-61e02c23e6e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:52.696450 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a81823-39cf-49d5-80b1-61e02c23e6e0 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:52.702646 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e45c64c-f7f2-42ae-af42-b8788ffbc920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:52.703486 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45c64c-f7f2-42ae-af42-b8788ffbc920 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:52.703768 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45c64c-f7f2-42ae-af42-b8788ffbc920 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:52.704043 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45c64c-f7f2-42ae-af42-b8788ffbc920 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:52.709577 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 256/499] 10.222.0.60 () {56 vars in 1103 bytes} [Sat Jul 2 03:16:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:52.709577 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a81823-39cf-49d5-80b1-61e02c23e6e0 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:52.718998 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e45c64c-f7f2-42ae-af42-b8788ffbc920 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:16:52.726852 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-8e45c64c-f7f2-42ae-af42-b8788ffbc920 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 02 03:16:52.726852 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:52.726852 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:52.726852 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:52.726852 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:52.726852 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:52.726852 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:52.726852 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:52.726852 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:52.726852 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:52.726852 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:52.726852 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:52.726852 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:16:52.726852 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:16:52.726852 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:16:52.726852 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:16:52.727752 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:16:52.727752 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:16:52.727752 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:16:52.727752 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:16:52.727752 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:52.727752 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:52.727752 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:52.727752 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:52.727752 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:52.727752 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:52.727752 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:52.727752 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:52.727752 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:52.727752 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:52.727752 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:52.727752 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:52.728548 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:52.728548 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:52.728548 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:52.728548 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:52.728548 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:16:52.728548 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:16:52.728548 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:16:52.728548 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:16:52.728548 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:16:52.728548 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:16:52.728548 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 02 03:16:52.728548 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:16:52.728548 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 244/500] 10.222.0.60 () {56 vars in 1102 bytes} [Sat Jul 2 03:16:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:16:52.729190 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e45c64c-f7f2-42ae-af42-b8788ffbc920 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:52.817211 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a81823-39cf-49d5-80b1-61e02c23e6e0 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:52.828743 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e45c64c-f7f2-42ae-af42-b8788ffbc920 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:52.849381 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6cc531-bd6c-4992-92a0-ceee7544b32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:52.850173 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6cc531-bd6c-4992-92a0-ceee7544b32a None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:52.850451 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6cc531-bd6c-4992-92a0-ceee7544b32a None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:52.850720 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6cc531-bd6c-4992-92a0-ceee7544b32a None admin] PATH_INFO: `/v3/users/glance` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:52.858266 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6cc531-bd6c-4992-92a0-ceee7544b32a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:52.859786 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6cc531-bd6c-4992-92a0-ceee7544b32a None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:52.861224 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be0c23-3219-4e62-a5ee-fa132b989e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:52.861897 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be0c23-3219-4e62-a5ee-fa132b989e82 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:52.862181 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be0c23-3219-4e62-a5ee-fa132b989e82 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:52.862459 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be0c23-3219-4e62-a5ee-fa132b989e82 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:52.863354 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35be0c23-3219-4e62-a5ee-fa132b989e82 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:52.863666 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35be0c23-3219-4e62-a5ee-fa132b989e82 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:52.865118 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35be0c23-3219-4e62-a5ee-fa132b989e82 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:52.875147 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-6c6cc531-bd6c-4992-92a0-ceee7544b32a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 02 03:16:52.875147 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:52.875147 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:52.875147 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:52.875147 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:52.875147 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:52.875147 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:52.875147 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:52.875147 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:52.875147 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:52.875147 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:52.875147 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:52.875147 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 03:16:52.875147 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 03:16:52.875147 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 03:16:52.875147 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 03:16:52.876181 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:52.876181 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:52.876181 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 03:16:52.876181 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 03:16:52.876181 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 03:16:52.876181 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 03:16:52.876181 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:52.876181 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:52.876181 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:52.876181 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:52.876181 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:52.876181 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:52.876181 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:52.876181 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:52.876181 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:52.876181 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:52.876181 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:52.876181 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:52.877080 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:52.877080 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:52.877080 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 03:16:52.877080 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 03:16:52.877080 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 03:16:52.877080 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 03:16:52.877080 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 03:16:52.877080 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 03:16:52.877080 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 02 03:16:52.877080 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:16:52.877080 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 257/501] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Jul 2 03:16:52 2022] GET /identity/v3/users/glance => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:16:52.877080 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6cc531-bd6c-4992-92a0-ceee7544b32a None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:52.895878 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:52.910455 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 245/502] 10.222.0.60 () {56 vars in 1133 bytes} [Sat Jul 2 03:16:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:52.910455 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be0c23-3219-4e62-a5ee-fa132b989e82 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:52.948890 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:52.980857 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6cc531-bd6c-4992-92a0-ceee7544b32a None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:53.007224 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be0c23-3219-4e62-a5ee-fa132b989e82 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:53.014375 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188ebea0-3a4d-4a08-b13f-29df8d486faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:53.015218 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ebea0-3a4d-4a08-b13f-29df8d486faf None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:53.015500 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ebea0-3a4d-4a08-b13f-29df8d486faf None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:53.015773 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ebea0-3a4d-4a08-b13f-29df8d486faf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:53.026374 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188ebea0-3a4d-4a08-b13f-29df8d486faf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:53.027867 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188ebea0-3a4d-4a08-b13f-29df8d486faf None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:53.040832 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc620536-cdbd-4285-a2fd-bdcb075af205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:53.041495 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc620536-cdbd-4285-a2fd-bdcb075af205 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:53.041772 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc620536-cdbd-4285-a2fd-bdcb075af205 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:53.042041 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc620536-cdbd-4285-a2fd-bdcb075af205 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:53.042890 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc620536-cdbd-4285-a2fd-bdcb075af205 None admin] RBAC: Adding query filter params (name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:53.043240 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc620536-cdbd-4285-a2fd-bdcb075af205 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:53.044627 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc620536-cdbd-4285-a2fd-bdcb075af205 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:53.045169 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-188ebea0-3a4d-4a08-b13f-29df8d486faf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:16:53.045169 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:53.045169 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:53.045169 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:53.045169 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:53.045169 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:53.045169 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:53.045169 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:53.045169 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:53.045169 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:53.045169 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:53.045169 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:53.045169 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:16:53.045169 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:16:53.045169 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:16:53.046031 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:16:53.046031 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:53.046031 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:53.046031 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:53.046031 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:53.046031 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:53.046031 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:53.046031 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:53.046031 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:53.046031 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:53.046031 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:53.046031 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:53.046031 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:53.046031 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:53.046031 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:53.046031 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:53.046031 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:53.046854 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:16:53.046854 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:16:53.046854 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:16:53.046854 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:16:53.046854 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 258/503] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:16:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:16:53.047615 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102af7d0-e148-49a9-9134-29e183b0771a None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:53.047891 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102af7d0-e148-49a9-9134-29e183b0771a None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:53.048162 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102af7d0-e148-49a9-9134-29e183b0771a None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:53.049411 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 259/504] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:16:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:16:53.050096 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102af7d0-e148-49a9-9134-29e183b0771a None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:53.058541 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 246/505] 10.222.0.60 () {56 vars in 1103 bytes} [Sat Jul 2 03:16:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:53.059726 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc620536-cdbd-4285-a2fd-bdcb075af205 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:53.120638 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:53.151633 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102af7d0-e148-49a9-9134-29e183b0771a None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:53.156818 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:53.159777 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc620536-cdbd-4285-a2fd-bdcb075af205 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:53.184403 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5480161-a839-47f9-b7ab-c84f0bf8b8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:53.185007 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5480161-a839-47f9-b7ab-c84f0bf8b8e3 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:53.185282 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5480161-a839-47f9-b7ab-c84f0bf8b8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:53.185554 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5480161-a839-47f9-b7ab-c84f0bf8b8e3 None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:53.186379 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5480161-a839-47f9-b7ab-c84f0bf8b8e3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:53.186680 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5480161-a839-47f9-b7ab-c84f0bf8b8e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:53.188136 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5480161-a839-47f9-b7ab-c84f0bf8b8e3 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:53.195218 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0472362f-800a-4175-acbb-47a40a24d12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:53.195862 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472362f-800a-4175-acbb-47a40a24d12c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:53.196142 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472362f-800a-4175-acbb-47a40a24d12c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:53.196411 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472362f-800a-4175-acbb-47a40a24d12c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:53.223651 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 260/506] 10.222.0.60 () {56 vars in 1137 bytes} [Sat Jul 2 03:16:53 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:53.228382 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5480161-a839-47f9-b7ab-c84f0bf8b8e3 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:53.264049 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0472362f-800a-4175-acbb-47a40a24d12c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:53.265545 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0472362f-800a-4175-acbb-47a40a24d12c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:53.322578 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5480161-a839-47f9-b7ab-c84f0bf8b8e3 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:53.349492 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:53.357674 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79026b3b-27e9-486f-a39f-2cf275b24f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:53.358328 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79026b3b-27e9-486f-a39f-2cf275b24f48 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:53.358606 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79026b3b-27e9-486f-a39f-2cf275b24f48 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:53.358876 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79026b3b-27e9-486f-a39f-2cf275b24f48 None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:53.359627 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79026b3b-27e9-486f-a39f-2cf275b24f48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:53.359928 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79026b3b-27e9-486f-a39f-2cf275b24f48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:53.361307 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79026b3b-27e9-486f-a39f-2cf275b24f48 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:53.361702 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:53.365604 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 247/507] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Jul 2 03:16:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 03:16:53.371563 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10960e5d-f82a-42d1-be3b-f7ce02bc9b02 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:53.371887 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10960e5d-f82a-42d1-be3b-f7ce02bc9b02 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:53.372170 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10960e5d-f82a-42d1-be3b-f7ce02bc9b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:53.377969 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 261/508] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:16:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:53.377969 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79026b3b-27e9-486f-a39f-2cf275b24f48 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:53.389427 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-10960e5d-f82a-42d1-be3b-f7ce02bc9b02 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:16:53.390615 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-10960e5d-f82a-42d1-be3b-f7ce02bc9b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:16:53.454238 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 248/509] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:16:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 03:16:53.454810 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10960e5d-f82a-42d1-be3b-f7ce02bc9b02 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:53.488702 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79026b3b-27e9-486f-a39f-2cf275b24f48 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:53.522506 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd05565b-8e5e-48ea-8af6-0ba99622a1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:53.523325 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd05565b-8e5e-48ea-8af6-0ba99622a1ee None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:53.523605 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd05565b-8e5e-48ea-8af6-0ba99622a1ee None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:53.523874 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd05565b-8e5e-48ea-8af6-0ba99622a1ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:53.534625 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd05565b-8e5e-48ea-8af6-0ba99622a1ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:53.536122 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd05565b-8e5e-48ea-8af6-0ba99622a1ee None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:53.550307 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10960e5d-f82a-42d1-be3b-f7ce02bc9b02 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:53.553426 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-dd05565b-8e5e-48ea-8af6-0ba99622a1ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:16:53.553426 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:53.553426 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:53.553426 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:53.553426 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:53.553426 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:53.553426 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:53.553426 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:53.553426 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:53.553426 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:53.553426 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:53.553426 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:53.553426 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:16:53.553426 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:16:53.553426 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:16:53.554438 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:16:53.554438 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:53.554438 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:53.554438 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:53.554438 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:53.554438 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:53.554438 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:53.554438 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:53.554438 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:53.554438 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:53.554438 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:53.554438 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:53.554438 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:53.554438 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:53.554438 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:53.554438 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:53.554438 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:53.555576 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:16:53.555576 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:16:53.555576 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:16:53.555576 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:16:53.555576 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 262/510] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:16:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:16:53.555576 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd05565b-8e5e-48ea-8af6-0ba99622a1ee None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:53.579584 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:53.585763 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f40b2d0-c778-4e14-aa61-ec0266b4ce57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:53.586411 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40b2d0-c778-4e14-aa61-ec0266b4ce57 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:53.586687 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40b2d0-c778-4e14-aa61-ec0266b4ce57 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:53.586955 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40b2d0-c778-4e14-aa61-ec0266b4ce57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:53.596207 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:53.652537 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f40b2d0-c778-4e14-aa61-ec0266b4ce57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:53.654005 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f40b2d0-c778-4e14-aa61-ec0266b4ce57 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:53.655052 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd05565b-8e5e-48ea-8af6-0ba99622a1ee None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:53.689535 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3055c4d-3868-4ef6-a79f-4fffce0b59fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:53.690318 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3055c4d-3868-4ef6-a79f-4fffce0b59fb None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:53.690593 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3055c4d-3868-4ef6-a79f-4fffce0b59fb None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:53.690854 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3055c4d-3868-4ef6-a79f-4fffce0b59fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:53.701264 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3055c4d-3868-4ef6-a79f-4fffce0b59fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:53.702703 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3055c4d-3868-4ef6-a79f-4fffce0b59fb None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:53.719356 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-e3055c4d-3868-4ef6-a79f-4fffce0b59fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:16:53.719356 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:53.719356 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:53.719356 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:53.719356 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:53.719356 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:53.719356 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:53.719356 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:53.719356 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:53.719356 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:53.719356 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:53.719356 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:53.719356 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:16:53.719356 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:16:53.719356 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:16:53.720219 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:16:53.720219 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:53.720219 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:53.720219 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:53.720219 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:53.720219 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:53.720219 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:53.720219 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:53.720219 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:53.720219 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:53.720219 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:53.720219 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:53.720219 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:53.720219 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:53.720219 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:53.720219 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:53.720219 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:53.721071 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:16:53.721071 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:16:53.721071 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:16:53.721071 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:16:53.721071 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 263/511] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:16:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:16:53.721334 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3055c4d-3868-4ef6-a79f-4fffce0b59fb None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:53.748144 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 249/512] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Jul 2 03:16:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 03:16:53.748984 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f40b2d0-c778-4e14-aa61-ec0266b4ce57 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:53.777751 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:53.818772 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:53.827520 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3055c4d-3868-4ef6-a79f-4fffce0b59fb None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:53.845708 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f40b2d0-c778-4e14-aa61-ec0266b4ce57 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:53.862563 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464bda87-cd65-4f5c-beba-769694616d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:53.863402 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464bda87-cd65-4f5c-beba-769694616d7a None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:53.863681 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464bda87-cd65-4f5c-beba-769694616d7a None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:53.863960 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464bda87-cd65-4f5c-beba-769694616d7a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:53.871686 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464bda87-cd65-4f5c-beba-769694616d7a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:53.873153 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464bda87-cd65-4f5c-beba-769694616d7a None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:53.879611 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abb151c-2bdc-414f-877a-379d4333aa4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:53.880395 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb151c-2bdc-414f-877a-379d4333aa4c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:53.880669 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb151c-2bdc-414f-877a-379d4333aa4c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:53.880941 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb151c-2bdc-414f-877a-379d4333aa4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:53.887287 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-464bda87-cd65-4f5c-beba-769694616d7a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 02 03:16:53.887287 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:53.887287 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:53.887287 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:53.887287 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:53.887287 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:53.887287 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:53.887287 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:53.887287 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:53.887287 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:53.887287 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:53.887287 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:53.887287 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 03:16:53.887287 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 03:16:53.887287 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 03:16:53.887287 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 03:16:53.888359 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:53.888359 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:53.888359 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 03:16:53.888359 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 03:16:53.888359 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 03:16:53.888359 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 03:16:53.888359 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:53.888359 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:53.888359 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:53.888359 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:53.888359 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:53.888359 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:53.888359 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:53.888359 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:53.888359 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:53.888359 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:53.888359 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:53.888359 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:53.889477 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:53.889477 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:53.889477 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 03:16:53.889477 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 03:16:53.889477 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 03:16:53.889477 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 03:16:53.889477 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 03:16:53.889477 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 03:16:53.889477 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 02 03:16:53.889477 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:16:53.889477 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 264/513] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Jul 2 03:16:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:16:53.890135 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464bda87-cd65-4f5c-beba-769694616d7a None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:53.893343 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abb151c-2bdc-414f-877a-379d4333aa4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:53.894833 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abb151c-2bdc-414f-877a-379d4333aa4c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:53.912305 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-1abb151c-2bdc-414f-877a-379d4333aa4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:16:53.912305 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:53.912305 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:53.912305 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:53.912305 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:53.912305 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:53.912305 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:53.912305 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:53.912305 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:53.912305 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:53.912305 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:53.912305 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:53.912305 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:16:53.912305 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:16:53.912305 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:16:53.913121 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:16:53.913121 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:53.913121 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:53.913121 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:53.913121 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:53.913121 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:53.913121 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:53.913121 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:53.913121 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:53.913121 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:53.913121 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:53.913121 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:53.913121 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:53.913121 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:53.913121 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:53.913121 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:53.913121 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:53.913927 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:16:53.913927 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:16:53.913927 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:16:53.913927 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:16:53.915614 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 250/514] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:16:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:16:53.916633 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abb151c-2bdc-414f-877a-379d4333aa4c None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:53.987666 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464bda87-cd65-4f5c-beba-769694616d7a None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:53.997643 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:54.016151 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abb151c-2bdc-414f-877a-379d4333aa4c None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:54.020792 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae424900-446f-495b-9deb-5c17ea196756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:54.021447 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae424900-446f-495b-9deb-5c17ea196756 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:54.021727 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae424900-446f-495b-9deb-5c17ea196756 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:54.021994 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae424900-446f-495b-9deb-5c17ea196756 None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:54.022712 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae424900-446f-495b-9deb-5c17ea196756 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:54.023014 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae424900-446f-495b-9deb-5c17ea196756 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:54.026800 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae424900-446f-495b-9deb-5c17ea196756 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:54.038579 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 265/515] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:16:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:54.039399 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae424900-446f-495b-9deb-5c17ea196756 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:54.050073 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add8d9df-decd-4971-8bbc-6f10ec3f6a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:54.050818 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add8d9df-decd-4971-8bbc-6f10ec3f6a6b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:54.051066 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add8d9df-decd-4971-8bbc-6f10ec3f6a6b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:54.051335 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add8d9df-decd-4971-8bbc-6f10ec3f6a6b None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:54.052053 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add8d9df-decd-4971-8bbc-6f10ec3f6a6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:54.052359 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add8d9df-decd-4971-8bbc-6f10ec3f6a6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:54.053750 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add8d9df-decd-4971-8bbc-6f10ec3f6a6b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:54.057964 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:54.066166 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 251/516] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:16:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:54.066985 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add8d9df-decd-4971-8bbc-6f10ec3f6a6b None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:54.143130 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae424900-446f-495b-9deb-5c17ea196756 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:54.167769 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add8d9df-decd-4971-8bbc-6f10ec3f6a6b None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:54.175854 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b8db9d-8912-40ef-ad0b-f3c6ee09e2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:54.176650 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8db9d-8912-40ef-ad0b-f3c6ee09e2b4 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:54.176930 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8db9d-8912-40ef-ad0b-f3c6ee09e2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:54.177205 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8db9d-8912-40ef-ad0b-f3c6ee09e2b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:54.187238 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b8db9d-8912-40ef-ad0b-f3c6ee09e2b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:54.188706 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b8db9d-8912-40ef-ad0b-f3c6ee09e2b4 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:54.200010 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72bcf0e-3de2-4cb3-aba6-3f5f507b5fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:54.200672 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72bcf0e-3de2-4cb3-aba6-3f5f507b5fcb None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:54.200950 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72bcf0e-3de2-4cb3-aba6-3f5f507b5fcb None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:54.201223 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72bcf0e-3de2-4cb3-aba6-3f5f507b5fcb None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:54.202049 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72bcf0e-3de2-4cb3-aba6-3f5f507b5fcb None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:54.202354 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72bcf0e-3de2-4cb3-aba6-3f5f507b5fcb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:54.203851 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72bcf0e-3de2-4cb3-aba6-3f5f507b5fcb None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:54.205743 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-58b8db9d-8912-40ef-ad0b-f3c6ee09e2b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:16:54.205743 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:54.205743 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:54.205743 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:54.205743 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:54.205743 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:54.205743 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:54.205743 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:54.205743 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:54.205743 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:54.205743 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:54.205743 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:54.205743 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:16:54.205743 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:16:54.205743 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:16:54.206552 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:16:54.206552 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:54.206552 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:54.206552 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:54.206552 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:54.206552 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:54.206552 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:54.206552 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:54.206552 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:54.206552 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:54.206552 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:54.206552 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:54.206552 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:54.206552 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:54.206552 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:54.206552 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:54.206552 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:54.207644 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:16:54.207644 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:16:54.207644 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:16:54.207644 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:16:54.207644 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 266/517] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:16:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:16:54.207892 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b8db9d-8912-40ef-ad0b-f3c6ee09e2b4 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:54.220219 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:54.228789 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 252/518] 10.222.0.60 () {56 vars in 1137 bytes} [Sat Jul 2 03:16:54 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:54.229638 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72bcf0e-3de2-4cb3-aba6-3f5f507b5fcb None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:54.268018 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:54.305698 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b8db9d-8912-40ef-ad0b-f3c6ee09e2b4 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:54.325910 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72bcf0e-3de2-4cb3-aba6-3f5f507b5fcb None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:54.338472 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112efd6-7a59-4117-a244-5b680739f971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:54.339141 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112efd6-7a59-4117-a244-5b680739f971 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:54.339437 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112efd6-7a59-4117-a244-5b680739f971 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:54.339741 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112efd6-7a59-4117-a244-5b680739f971 None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:54.340459 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e112efd6-7a59-4117-a244-5b680739f971 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:54.340759 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e112efd6-7a59-4117-a244-5b680739f971 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:54.342135 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e112efd6-7a59-4117-a244-5b680739f971 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:54.353252 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 267/519] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:16:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:54.354027 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112efd6-7a59-4117-a244-5b680739f971 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:54.363711 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e3255-b793-478c-b5f1-043d9ef887db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:54.364503 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e3255-b793-478c-b5f1-043d9ef887db None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:54.364792 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e3255-b793-478c-b5f1-043d9ef887db None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:54.365063 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e3255-b793-478c-b5f1-043d9ef887db None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:54.375558 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4e3255-b793-478c-b5f1-043d9ef887db None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:54.377049 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4e3255-b793-478c-b5f1-043d9ef887db None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:54.391890 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-fa4e3255-b793-478c-b5f1-043d9ef887db None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 02 03:16:54.391890 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:54.391890 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:54.391890 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:54.391890 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:54.391890 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:54.391890 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:54.391890 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:54.391890 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:54.391890 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:54.391890 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:54.391890 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:54.391890 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 03:16:54.391890 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 03:16:54.391890 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 03:16:54.391890 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 03:16:54.392806 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:54.392806 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:54.392806 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 03:16:54.392806 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 03:16:54.392806 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 03:16:54.392806 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 03:16:54.392806 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:54.392806 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:54.392806 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:54.392806 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:54.392806 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:54.392806 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:54.392806 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:54.392806 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:54.392806 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:54.392806 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:54.392806 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:54.392806 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:54.393661 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:54.393661 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:54.393661 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 03:16:54.393661 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 03:16:54.393661 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 03:16:54.393661 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 03:16:54.393661 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 03:16:54.393661 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 03:16:54.393661 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 02 03:16:54.393661 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:16:54.393661 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 253/520] 10.222.0.60 () {56 vars in 1102 bytes} [Sat Jul 2 03:16:54 2022] GET /identity/v3/users/neutron => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:16:54.394736 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e3255-b793-478c-b5f1-043d9ef887db None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:54.453229 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:54.456864 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112efd6-7a59-4117-a244-5b680739f971 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:54.479694 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:54.491063 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe4083-dc17-4455-8bcc-9e14e6b619a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:54.491881 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe4083-dc17-4455-8bcc-9e14e6b619a7 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:54.492157 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe4083-dc17-4455-8bcc-9e14e6b619a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:54.492421 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe4083-dc17-4455-8bcc-9e14e6b619a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:54.493731 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e3255-b793-478c-b5f1-043d9ef887db None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:54.498980 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fe4083-dc17-4455-8bcc-9e14e6b619a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:54.500489 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fe4083-dc17-4455-8bcc-9e14e6b619a7 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:54.515016 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-67fe4083-dc17-4455-8bcc-9e14e6b619a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 03:16:54.515016 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:54.515016 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:54.515016 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:54.515016 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:54.515016 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:54.515016 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:54.515016 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:54.515016 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:54.515016 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:54.515016 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:54.515016 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:54.515016 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 03:16:54.515016 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 03:16:54.515016 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 03:16:54.515871 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 03:16:54.515871 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:54.515871 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:54.515871 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:54.515871 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:54.515871 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:54.515871 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:54.515871 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:54.515871 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:54.515871 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:54.515871 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:54.515871 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:54.515871 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:54.515871 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:54.515871 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:54.515871 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:54.515871 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:54.516704 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 03:16:54.516704 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 03:16:54.516704 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 03:16:54.516704 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 03:16:54.516704 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 03:16:54.516704 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 03:16:54.516704 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 03:16:54.516704 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:16:54.516704 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 268/521] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Jul 2 03:16:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:16:54.517174 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe4083-dc17-4455-8bcc-9e14e6b619a7 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:54.528789 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b44ef-f59f-4064-b59b-8e68c2681da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:54.529389 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b44ef-f59f-4064-b59b-8e68c2681da5 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:54.529675 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b44ef-f59f-4064-b59b-8e68c2681da5 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:54.529922 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b44ef-f59f-4064-b59b-8e68c2681da5 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:54.530663 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333b44ef-f59f-4064-b59b-8e68c2681da5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:54.530963 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333b44ef-f59f-4064-b59b-8e68c2681da5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:54.532357 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333b44ef-f59f-4064-b59b-8e68c2681da5 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:54.544243 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 254/522] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:16:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:54.544997 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b44ef-f59f-4064-b59b-8e68c2681da5 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:54.617352 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe4083-dc17-4455-8bcc-9e14e6b619a7 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:54.647158 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b44ef-f59f-4064-b59b-8e68c2681da5 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:54.651504 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02661beb-58d4-41f8-b5f3-edfaf518c81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:54.652188 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02661beb-58d4-41f8-b5f3-edfaf518c81a None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:54.652463 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02661beb-58d4-41f8-b5f3-edfaf518c81a None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:54.652731 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02661beb-58d4-41f8-b5f3-edfaf518c81a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:54.666873 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:54.682358 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd5234-df57-4328-a8ee-c0a3b4ef7938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:54.683019 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd5234-df57-4328-a8ee-c0a3b4ef7938 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:54.683454 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd5234-df57-4328-a8ee-c0a3b4ef7938 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:54.683725 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd5234-df57-4328-a8ee-c0a3b4ef7938 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:54.684432 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bd5234-df57-4328-a8ee-c0a3b4ef7938 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:54.685861 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bd5234-df57-4328-a8ee-c0a3b4ef7938 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:54.704804 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 255/523] 10.222.0.60 () {60 vars in 1132 bytes} [Sat Jul 2 03:16:54 2022] POST /identity/v3/users => generated 247 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:16:54.705545 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:54.705654 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd5234-df57-4328-a8ee-c0a3b4ef7938 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:54.738684 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02661beb-58d4-41f8-b5f3-edfaf518c81a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:54.740412 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02661beb-58d4-41f8-b5f3-edfaf518c81a None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:54.816366 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd5234-df57-4328-a8ee-c0a3b4ef7938 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:54.851932 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 269/524] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Jul 2 03:16:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 03:16:54.852801 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02661beb-58d4-41f8-b5f3-edfaf518c81a None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:54.860352 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbbe3cd-2e06-4636-94b4-4544ae2cf881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:54.861097 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbbe3cd-2e06-4636-94b4-4544ae2cf881 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:54.861625 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbbe3cd-2e06-4636-94b4-4544ae2cf881 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:54.861706 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbbe3cd-2e06-4636-94b4-4544ae2cf881 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:54.862706 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbbe3cd-2e06-4636-94b4-4544ae2cf881 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:54.862816 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbbe3cd-2e06-4636-94b4-4544ae2cf881 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:54.864770 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbbe3cd-2e06-4636-94b4-4544ae2cf881 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:54.884461 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 256/525] 10.222.0.60 () {56 vars in 1139 bytes} [Sat Jul 2 03:16:54 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:54.885283 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbbe3cd-2e06-4636-94b4-4544ae2cf881 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:54.925302 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:54.954598 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:54.972025 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02661beb-58d4-41f8-b5f3-edfaf518c81a None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:54.994491 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbbe3cd-2e06-4636-94b4-4544ae2cf881 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:55.008310 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12894e4a-c60a-4aae-88c3-c6859dafc928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:55.008973 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12894e4a-c60a-4aae-88c3-c6859dafc928 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:55.009256 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12894e4a-c60a-4aae-88c3-c6859dafc928 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:55.009697 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12894e4a-c60a-4aae-88c3-c6859dafc928 None admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:55.010298 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12894e4a-c60a-4aae-88c3-c6859dafc928 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:55.010602 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12894e4a-c60a-4aae-88c3-c6859dafc928 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:55.012130 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12894e4a-c60a-4aae-88c3-c6859dafc928 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:55.034497 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 270/526] 10.222.0.60 () {56 vars in 1148 bytes} [Sat Jul 2 03:16:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:55.034672 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c6b90-63a0-467f-9397-46a69a6f4b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:55.034779 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12894e4a-c60a-4aae-88c3-c6859dafc928 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:55.034887 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c6b90-63a0-467f-9397-46a69a6f4b13 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:55.034887 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c6b90-63a0-467f-9397-46a69a6f4b13 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:55.034887 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c6b90-63a0-467f-9397-46a69a6f4b13 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:55.042091 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055c6b90-63a0-467f-9397-46a69a6f4b13 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:55.043650 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055c6b90-63a0-467f-9397-46a69a6f4b13 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:55.058448 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-055c6b90-63a0-467f-9397-46a69a6f4b13 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 03:16:55.058448 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:55.058448 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:55.058448 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:55.058448 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:55.058448 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:55.058448 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:55.058448 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:55.058448 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:55.058448 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:55.058448 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:55.058448 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:55.058448 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 03:16:55.058448 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 03:16:55.058448 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 03:16:55.059936 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 03:16:55.059936 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:55.059936 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:55.059936 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:55.059936 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:55.059936 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:55.059936 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:55.059936 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:55.059936 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:55.059936 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:55.059936 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:55.059936 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:55.059936 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:55.059936 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:55.059936 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:55.059936 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:55.059936 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:55.060896 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 03:16:55.060896 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 03:16:55.060896 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 03:16:55.060896 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 03:16:55.060896 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 03:16:55.060896 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 03:16:55.060896 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 03:16:55.060896 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:16:55.060896 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 257/527] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Jul 2 03:16:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:16:55.061345 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c6b90-63a0-467f-9397-46a69a6f4b13 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:55.153709 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12894e4a-c60a-4aae-88c3-c6859dafc928 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:55.161821 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:55.170396 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c6b90-63a0-467f-9397-46a69a6f4b13 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:55.189276 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f73c14-af17-42d1-ae13-33df52d7f76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:55.190174 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f73c14-af17-42d1-ae13-33df52d7f76b None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:55.190437 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f73c14-af17-42d1-ae13-33df52d7f76b None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:55.190701 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f73c14-af17-42d1-ae13-33df52d7f76b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:55.201835 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f73c14-af17-42d1-ae13-33df52d7f76b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:55.203322 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f73c14-af17-42d1-ae13-33df52d7f76b None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:55.203720 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd71dc5-5011-4b35-9838-17b53164768f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:55.204376 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd71dc5-5011-4b35-9838-17b53164768f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:55.204660 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd71dc5-5011-4b35-9838-17b53164768f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:55.204937 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd71dc5-5011-4b35-9838-17b53164768f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:55.206136 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:55.223410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-38f73c14-af17-42d1-ae13-33df52d7f76b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:16:55.223410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:55.223410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:55.223410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:55.223410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:55.223410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:55.223410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:55.223410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:55.223410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:55.223410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:55.223410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:55.223410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:55.223410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:16:55.223410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:16:55.223410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:16:55.224410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:16:55.224410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:55.224410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:55.224410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:55.224410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:55.224410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:55.224410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:55.224410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:55.224410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:55.224410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:55.224410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:55.224410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:55.224410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:55.224410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:55.224410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:55.224410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:55.224410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:55.225250 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:16:55.225250 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:16:55.225250 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:16:55.225250 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:16:55.225899 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 271/528] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:16:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:16:55.226738 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f73c14-af17-42d1-ae13-33df52d7f76b None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:55.283666 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd71dc5-5011-4b35-9838-17b53164768f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:55.285547 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd71dc5-5011-4b35-9838-17b53164768f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:55.336807 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f73c14-af17-42d1-ae13-33df52d7f76b None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:55.376690 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c9b7be-9db3-4dc0-a10e-ce8b14251519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:55.380093 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c9b7be-9db3-4dc0-a10e-ce8b14251519 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:55.380093 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c9b7be-9db3-4dc0-a10e-ce8b14251519 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:55.380093 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c9b7be-9db3-4dc0-a10e-ce8b14251519 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:55.380093 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c9b7be-9db3-4dc0-a10e-ce8b14251519 None admin] RBAC: Adding query filter params (role.id=3c71d0e875cd4a00849f14227be8f7ed, scope.project.id=e09dc5d9d4904c2b89b0cabed237d55e, user.id=13530240e2d446b6bf26a431d001362a) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:55.380093 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c9b7be-9db3-4dc0-a10e-ce8b14251519 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:55.381439 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c9b7be-9db3-4dc0-a10e-ce8b14251519 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:55.387645 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:55.395162 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 272/529] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Jul 2 03:16:55 2022] GET /identity/v3/role_assignments?user.id=13530240e2d446b6bf26a431d001362a&scope.project.id=e09dc5d9d4904c2b89b0cabed237d55e&role.id=3c71d0e875cd4a00849f14227be8f7ed => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:55.395162 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c9b7be-9db3-4dc0-a10e-ce8b14251519 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:55.412879 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 258/530] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Jul 2 03:16:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 03:16:55.413713 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd71dc5-5011-4b35-9838-17b53164768f None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:55.467014 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:55.527137 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c9b7be-9db3-4dc0-a10e-ce8b14251519 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:55.545664 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd71dc5-5011-4b35-9838-17b53164768f None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:55.580624 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce9f9c9-6ad1-4229-93bd-448f6e821a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:55.581292 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce9f9c9-6ad1-4229-93bd-448f6e821a48 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:55.581566 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce9f9c9-6ad1-4229-93bd-448f6e821a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:55.581834 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce9f9c9-6ad1-4229-93bd-448f6e821a48 None admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:55.582620 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce9f9c9-6ad1-4229-93bd-448f6e821a48 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:55.582928 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce9f9c9-6ad1-4229-93bd-448f6e821a48 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:55.584484 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce9f9c9-6ad1-4229-93bd-448f6e821a48 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:55.593076 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2162dc5-3925-463b-8bbc-ec2e8ae856fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:55.594530 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2162dc5-3925-463b-8bbc-ec2e8ae856fc None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:55.595037 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2162dc5-3925-463b-8bbc-ec2e8ae856fc None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:55.595811 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2162dc5-3925-463b-8bbc-ec2e8ae856fc None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:55.596738 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2162dc5-3925-463b-8bbc-ec2e8ae856fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:55.597238 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2162dc5-3925-463b-8bbc-ec2e8ae856fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:55.597716 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 273/531] 10.222.0.60 () {56 vars in 1148 bytes} [Sat Jul 2 03:16:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:55.598547 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce9f9c9-6ad1-4229-93bd-448f6e821a48 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:55.599540 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2162dc5-3925-463b-8bbc-ec2e8ae856fc None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:55.615815 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 259/532] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:16:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:55.620486 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2162dc5-3925-463b-8bbc-ec2e8ae856fc None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:55.678442 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:55.727825 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce9f9c9-6ad1-4229-93bd-448f6e821a48 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:55.738779 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2162dc5-3925-463b-8bbc-ec2e8ae856fc None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:55.749031 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:55.765191 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9830b6-368e-4a4c-b0fa-dc7bb92312fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:55.766291 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9830b6-368e-4a4c-b0fa-dc7bb92312fc None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:55.766291 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9830b6-368e-4a4c-b0fa-dc7bb92312fc None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:55.766585 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9830b6-368e-4a4c-b0fa-dc7bb92312fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:55.776952 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9830b6-368e-4a4c-b0fa-dc7bb92312fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:55.778398 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9830b6-368e-4a4c-b0fa-dc7bb92312fc None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:55.783216 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feec9732-ddfe-4336-92a7-430afc423d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:55.784113 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec9732-ddfe-4336-92a7-430afc423d25 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:55.784607 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec9732-ddfe-4336-92a7-430afc423d25 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:55.785073 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec9732-ddfe-4336-92a7-430afc423d25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:55.786470 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feec9732-ddfe-4336-92a7-430afc423d25 None admin] RBAC: Adding query filter params (role.id=3c71d0e875cd4a00849f14227be8f7ed, scope.project.id=e09dc5d9d4904c2b89b0cabed237d55e, user.id=6470ccbf858f47bf9bb884476bf4235e) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:55.787409 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feec9732-ddfe-4336-92a7-430afc423d25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:55.789349 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feec9732-ddfe-4336-92a7-430afc423d25 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:55.796164 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 260/533] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Jul 2 03:16:55 2022] GET /identity/v3/role_assignments?user.id=6470ccbf858f47bf9bb884476bf4235e&scope.project.id=e09dc5d9d4904c2b89b0cabed237d55e&role.id=3c71d0e875cd4a00849f14227be8f7ed => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:55.796769 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-8f9830b6-368e-4a4c-b0fa-dc7bb92312fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:16:55.796769 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:55.796769 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:55.796769 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:55.796769 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:55.796769 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:55.796769 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:55.796769 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:55.796769 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:55.796769 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:55.796769 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:55.796769 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:55.796769 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:16:55.796769 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:16:55.796769 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:16:55.797569 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:16:55.797569 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:55.797569 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:55.797569 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:55.797569 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:55.797569 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:55.797569 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:55.797569 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:55.797569 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:55.797569 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:55.797569 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:55.797569 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:55.797569 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:55.797569 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:55.797569 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:55.797569 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:55.797569 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:55.798504 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:16:55.798504 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:16:55.798504 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:16:55.798504 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:16:55.798504 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 274/534] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:16:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:16:55.803922 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feec9732-ddfe-4336-92a7-430afc423d25 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:55.807627 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9830b6-368e-4a4c-b0fa-dc7bb92312fc None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:55.926229 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feec9732-ddfe-4336-92a7-430afc423d25 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:55.947432 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:55.983907 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc900478-1e2a-48b0-8866-a0643b332103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:55.985483 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc900478-1e2a-48b0-8866-a0643b332103 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:55.987466 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc900478-1e2a-48b0-8866-a0643b332103 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:55.987952 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc900478-1e2a-48b0-8866-a0643b332103 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:56.003769 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc900478-1e2a-48b0-8866-a0643b332103 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:56.005250 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc900478-1e2a-48b0-8866-a0643b332103 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:56.025353 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-dc900478-1e2a-48b0-8866-a0643b332103 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 03:16:56.025353 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:56.025353 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:56.025353 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:56.025353 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:56.025353 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:56.025353 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:56.025353 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:56.025353 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:56.025353 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:56.025353 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:56.025353 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:56.025353 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 03:16:56.025353 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 03:16:56.025353 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 03:16:56.026244 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 03:16:56.026244 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:56.026244 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:56.026244 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:56.026244 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:56.026244 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:56.026244 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:56.026244 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:56.026244 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:56.026244 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:56.026244 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:56.026244 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:56.026244 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:56.026244 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:56.026244 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:56.026244 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:56.026244 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:56.027163 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 03:16:56.027163 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 03:16:56.027163 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 03:16:56.027163 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 03:16:56.027163 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 03:16:56.027163 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 03:16:56.027163 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 03:16:56.027163 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:16:56.027163 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 261/535] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Jul 2 03:16:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:16:56.036226 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc900478-1e2a-48b0-8866-a0643b332103 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:56.037612 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9830b6-368e-4a4c-b0fa-dc7bb92312fc None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:56.076835 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eeeeaf-c262-489a-b532-5889d377b1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:56.078000 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eeeeaf-c262-489a-b532-5889d377b1ca None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:56.078617 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eeeeaf-c262-489a-b532-5889d377b1ca None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:56.079085 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eeeeaf-c262-489a-b532-5889d377b1ca None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:56.080326 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eeeeaf-c262-489a-b532-5889d377b1ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:56.080840 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eeeeaf-c262-489a-b532-5889d377b1ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:56.082518 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eeeeaf-c262-489a-b532-5889d377b1ca None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:56.102743 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 275/536] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:16:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:56.108533 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eeeeaf-c262-489a-b532-5889d377b1ca None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:56.158958 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:56.193962 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc900478-1e2a-48b0-8866-a0643b332103 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:56.255844 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28766ce-2b00-42f7-a4dd-378bcf34560a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:56.256515 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28766ce-2b00-42f7-a4dd-378bcf34560a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:56.256794 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28766ce-2b00-42f7-a4dd-378bcf34560a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:56.257063 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28766ce-2b00-42f7-a4dd-378bcf34560a None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:56.257858 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28766ce-2b00-42f7-a4dd-378bcf34560a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:56.258511 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28766ce-2b00-42f7-a4dd-378bcf34560a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:56.260834 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28766ce-2b00-42f7-a4dd-378bcf34560a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:56.289321 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eeeeaf-c262-489a-b532-5889d377b1ca None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:56.294244 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 262/537] 10.222.0.60 () {56 vars in 1148 bytes} [Sat Jul 2 03:16:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:56.300685 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28766ce-2b00-42f7-a4dd-378bcf34560a None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:56.359936 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:56.366101 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f37082-e1ed-4d68-821e-5f80efa5083f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:56.367477 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f37082-e1ed-4d68-821e-5f80efa5083f None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:56.367477 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f37082-e1ed-4d68-821e-5f80efa5083f None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:56.367631 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f37082-e1ed-4d68-821e-5f80efa5083f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:56.377296 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f37082-e1ed-4d68-821e-5f80efa5083f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:56.379220 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f37082-e1ed-4d68-821e-5f80efa5083f None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:56.409595 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-76f37082-e1ed-4d68-821e-5f80efa5083f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 03:16:56.409595 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:56.409595 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:56.409595 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:56.409595 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:56.409595 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:56.409595 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:56.409595 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:56.409595 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:56.409595 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:56.409595 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:56.409595 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:56.409595 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 03:16:56.409595 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 03:16:56.409595 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 03:16:56.410506 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 03:16:56.410506 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:56.410506 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:56.410506 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:56.410506 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:56.410506 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:56.410506 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:56.410506 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:56.410506 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:56.410506 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:56.410506 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:56.410506 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:56.410506 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:56.410506 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:56.410506 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:56.410506 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:56.410506 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:56.411486 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 03:16:56.411486 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 03:16:56.411486 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 03:16:56.411486 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 03:16:56.411486 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 03:16:56.411486 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 03:16:56.411486 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 03:16:56.411486 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:16:56.413392 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 276/538] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Jul 2 03:16:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 03:16:56.418857 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f37082-e1ed-4d68-821e-5f80efa5083f None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:56.469663 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28766ce-2b00-42f7-a4dd-378bcf34560a None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:56.529817 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ebb248-bf14-490d-92ba-efc5988b0b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:56.530392 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebb248-bf14-490d-92ba-efc5988b0b89 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:56.530669 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebb248-bf14-490d-92ba-efc5988b0b89 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:56.530939 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebb248-bf14-490d-92ba-efc5988b0b89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:56.531807 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ebb248-bf14-490d-92ba-efc5988b0b89 None admin] RBAC: Adding query filter params (role.id=3c71d0e875cd4a00849f14227be8f7ed, scope.project.id=e09dc5d9d4904c2b89b0cabed237d55e, user.id=c7c2bef2013546cd882013cdcb4cd929) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:56.532110 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ebb248-bf14-490d-92ba-efc5988b0b89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:56.533573 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ebb248-bf14-490d-92ba-efc5988b0b89 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:56.549721 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 263/539] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Jul 2 03:16:56 2022] GET /identity/v3/role_assignments?user.id=c7c2bef2013546cd882013cdcb4cd929&scope.project.id=e09dc5d9d4904c2b89b0cabed237d55e&role.id=3c71d0e875cd4a00849f14227be8f7ed => generated 259 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:56.583545 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:56.590640 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f37082-e1ed-4d68-821e-5f80efa5083f None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:56.644323 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ca75f1-5c21-485b-80f7-0f19513e89dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:56.645457 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca75f1-5c21-485b-80f7-0f19513e89dd None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:56.645943 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca75f1-5c21-485b-80f7-0f19513e89dd None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:56.646429 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca75f1-5c21-485b-80f7-0f19513e89dd None admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:56.647506 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ca75f1-5c21-485b-80f7-0f19513e89dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:56.648034 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ca75f1-5c21-485b-80f7-0f19513e89dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:56.649798 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ca75f1-5c21-485b-80f7-0f19513e89dd None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:56.673656 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 277/540] 10.222.0.60 () {56 vars in 1148 bytes} [Sat Jul 2 03:16:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:56.675464 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ebb248-bf14-490d-92ba-efc5988b0b89 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:56.838235 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f8b879-818b-4556-920c-b250223db7cc None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:56.838552 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f8b879-818b-4556-920c-b250223db7cc None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:56.838746 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f8b879-818b-4556-920c-b250223db7cc None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:56.840479 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 278/541] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:16:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:16:56.842608 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ebb248-bf14-490d-92ba-efc5988b0b89 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:56.844446 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:56.846184 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b76b1cb-813d-4ef5-8cfc-7112714b0087 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:56.846473 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b76b1cb-813d-4ef5-8cfc-7112714b0087 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:56.846793 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b76b1cb-813d-4ef5-8cfc-7112714b0087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:56.864898 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-9b76b1cb-813d-4ef5-8cfc-7112714b0087 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:16:56.866202 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-9b76b1cb-813d-4ef5-8cfc-7112714b0087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:16:56.908066 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383df151-9289-4633-af17-791110168cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:56.908731 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383df151-9289-4633-af17-791110168cc6 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:56.909014 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383df151-9289-4633-af17-791110168cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:56.909292 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383df151-9289-4633-af17-791110168cc6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:56.910126 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383df151-9289-4633-af17-791110168cc6 None admin] RBAC: Adding query filter params (role.id=3c71d0e875cd4a00849f14227be8f7ed, scope.project.id=e09dc5d9d4904c2b89b0cabed237d55e, user.id=b0e8a3ba6f84477bb9b4780918f357c0) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:56.910492 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383df151-9289-4633-af17-791110168cc6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:56.911935 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383df151-9289-4633-af17-791110168cc6 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:56.928593 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 264/542] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Jul 2 03:16:56 2022] GET /identity/v3/role_assignments?user.id=b0e8a3ba6f84477bb9b4780918f357c0&scope.project.id=e09dc5d9d4904c2b89b0cabed237d55e&role.id=3c71d0e875cd4a00849f14227be8f7ed => generated 259 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:56.967040 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 279/543] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:16:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 02 03:16:56.990575 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383df151-9289-4633-af17-791110168cc6 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:57.118010 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383df151-9289-4633-af17-791110168cc6 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:57.177516 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe9d16d-7a37-4b4a-a180-faf7815aab13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:57.178727 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe9d16d-7a37-4b4a-a180-faf7815aab13 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:57.179280 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe9d16d-7a37-4b4a-a180-faf7815aab13 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:57.179758 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe9d16d-7a37-4b4a-a180-faf7815aab13 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:57.199706 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe9d16d-7a37-4b4a-a180-faf7815aab13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:16:57.208668 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-bfe9d16d-7a37-4b4a-a180-faf7815aab13 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 02 03:16:57.208668 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:57.208668 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:57.208668 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:57.208668 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:57.208668 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:57.208668 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:57.208668 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:57.208668 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:57.208668 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:57.208668 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:57.208668 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:57.208668 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:16:57.208668 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:16:57.208668 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:16:57.208668 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:16:57.209600 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:16:57.209600 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:16:57.209600 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:16:57.209600 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:16:57.209600 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:57.209600 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:57.209600 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:57.209600 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:57.209600 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:57.209600 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:57.209600 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:57.209600 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:57.209600 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:57.209600 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:57.209600 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:57.209600 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:57.210374 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:57.210374 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:57.210374 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:57.210374 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:57.210374 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:16:57.210374 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:16:57.210374 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:16:57.210374 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:16:57.210374 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:16:57.210374 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:16:57.210374 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 02 03:16:57.210374 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:16:57.213346 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 265/544] 10.222.0.60 () {56 vars in 1102 bytes} [Sat Jul 2 03:16:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:16:57.219554 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b76b1cb-813d-4ef5-8cfc-7112714b0087 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:57.312593 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:57.332756 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b76b1cb-813d-4ef5-8cfc-7112714b0087 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:57.373133 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdc7eac-8847-41ba-9501-f6b0c8cb0bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:57.374164 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc7eac-8847-41ba-9501-f6b0c8cb0bd1 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:57.374413 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc7eac-8847-41ba-9501-f6b0c8cb0bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:57.374687 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc7eac-8847-41ba-9501-f6b0c8cb0bd1 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:57.375494 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdc7eac-8847-41ba-9501-f6b0c8cb0bd1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:57.375796 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdc7eac-8847-41ba-9501-f6b0c8cb0bd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:57.377158 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdc7eac-8847-41ba-9501-f6b0c8cb0bd1 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:57.386487 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 280/545] 10.222.0.60 () {56 vars in 1103 bytes} [Sat Jul 2 03:16:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:57.391984 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe9d16d-7a37-4b4a-a180-faf7815aab13 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:57.420793 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:57.520776 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe9d16d-7a37-4b4a-a180-faf7815aab13 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:57.562844 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd39593-1e33-44e1-b2b8-f85f01cd7a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:57.563673 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd39593-1e33-44e1-b2b8-f85f01cd7a6f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:57.563951 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd39593-1e33-44e1-b2b8-f85f01cd7a6f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:57.564222 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd39593-1e33-44e1-b2b8-f85f01cd7a6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:57.580359 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd39593-1e33-44e1-b2b8-f85f01cd7a6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:57.581818 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd39593-1e33-44e1-b2b8-f85f01cd7a6f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:57.602649 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-abd39593-1e33-44e1-b2b8-f85f01cd7a6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:16:57.602649 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:57.602649 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:57.602649 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:57.602649 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:57.602649 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:57.602649 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:57.602649 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:57.602649 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:57.602649 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:57.602649 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:57.602649 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:57.602649 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:16:57.602649 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:16:57.602649 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:16:57.603564 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:16:57.603564 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:57.603564 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:57.603564 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:57.603564 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:57.603564 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:57.603564 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:57.603564 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:57.603564 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:57.603564 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:57.603564 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:57.603564 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:57.603564 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:57.603564 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:57.603564 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:57.603564 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:57.603564 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:57.604381 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:16:57.604381 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:16:57.604381 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:16:57.604381 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:16:57.604381 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 266/546] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:16:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:16:57.609941 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdc7eac-8847-41ba-9501-f6b0c8cb0bd1 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:57.641146 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a72cf-b10e-437d-8f4d-3622a346bb76 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:57.641435 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a72cf-b10e-437d-8f4d-3622a346bb76 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:57.641608 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a72cf-b10e-437d-8f4d-3622a346bb76 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:57.643403 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 267/547] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:16:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 03:16:57.653061 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2714eff4-2ea1-4e6f-a750-a5e6ba01fe2a None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:57.653472 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2714eff4-2ea1-4e6f-a750-a5e6ba01fe2a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:57.653890 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2714eff4-2ea1-4e6f-a750-a5e6ba01fe2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:57.683363 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-2714eff4-2ea1-4e6f-a750-a5e6ba01fe2a None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:16:57.684711 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2714eff4-2ea1-4e6f-a750-a5e6ba01fe2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:16:57.722507 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdc7eac-8847-41ba-9501-f6b0c8cb0bd1 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:57.761230 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf55d89-3454-449e-a208-4b7b3218a3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:57.762148 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf55d89-3454-449e-a208-4b7b3218a3ac None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:57.763384 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf55d89-3454-449e-a208-4b7b3218a3ac None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:57.763899 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf55d89-3454-449e-a208-4b7b3218a3ac None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:57.769570 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf55d89-3454-449e-a208-4b7b3218a3ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:57.770065 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf55d89-3454-449e-a208-4b7b3218a3ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:57.771640 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf55d89-3454-449e-a208-4b7b3218a3ac None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:57.792893 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 281/548] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:16:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:57.798404 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf55d89-3454-449e-a208-4b7b3218a3ac None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:57.805300 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:57.829052 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 268/549] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:16:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 03:16:57.870445 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2714eff4-2ea1-4e6f-a750-a5e6ba01fe2a None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:57.881997 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:57.941428 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf55d89-3454-449e-a208-4b7b3218a3ac None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:58.004652 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba94c10-285a-4de2-9b63-8d425a3ccd2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:58.005770 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba94c10-285a-4de2-9b63-8d425a3ccd2c None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:58.006186 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba94c10-285a-4de2-9b63-8d425a3ccd2c None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:58.006591 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba94c10-285a-4de2-9b63-8d425a3ccd2c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:58.018631 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba94c10-285a-4de2-9b63-8d425a3ccd2c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:58.020357 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba94c10-285a-4de2-9b63-8d425a3ccd2c None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:58.042791 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-eba94c10-285a-4de2-9b63-8d425a3ccd2c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 02 03:16:58.042791 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:58.042791 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:58.042791 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:58.042791 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:58.042791 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:58.042791 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:58.042791 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:58.042791 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:58.042791 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:58.042791 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:58.042791 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:58.042791 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 03:16:58.042791 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 03:16:58.042791 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 03:16:58.042791 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 03:16:58.044449 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:58.044449 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:58.044449 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 03:16:58.044449 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 03:16:58.044449 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 03:16:58.044449 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 03:16:58.044449 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:58.044449 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:58.044449 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:58.044449 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:58.044449 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:58.044449 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:58.044449 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:58.044449 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:58.044449 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:58.044449 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:58.044449 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:58.044449 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:58.045512 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:58.045512 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:58.045512 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 03:16:58.045512 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 03:16:58.045512 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 03:16:58.045512 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 03:16:58.045512 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 03:16:58.045512 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 03:16:58.045512 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 02 03:16:58.045512 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:16:58.048188 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 282/550] 10.222.0.60 () {56 vars in 1096 bytes} [Sat Jul 2 03:16:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:16:58.057920 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba94c10-285a-4de2-9b63-8d425a3ccd2c None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:58.065324 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2714eff4-2ea1-4e6f-a750-a5e6ba01fe2a None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:58.138876 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e4f073-485b-4b03-813f-75490f54c19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:58.139709 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4f073-485b-4b03-813f-75490f54c19e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:58.139985 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4f073-485b-4b03-813f-75490f54c19e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:58.140249 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4f073-485b-4b03-813f-75490f54c19e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:58.152263 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e4f073-485b-4b03-813f-75490f54c19e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:16:58.162142 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-d7e4f073-485b-4b03-813f-75490f54c19e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 02 03:16:58.162142 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:58.162142 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:58.162142 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:58.162142 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:58.162142 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:58.162142 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:58.162142 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:58.162142 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:58.162142 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:58.162142 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:58.162142 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:58.162142 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:16:58.162142 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:16:58.162142 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:16:58.162142 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:16:58.163014 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:16:58.163014 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:16:58.163014 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:16:58.163014 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:16:58.163014 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:58.163014 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:58.163014 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:58.163014 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:58.163014 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:58.163014 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:58.163014 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:58.163014 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:58.163014 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:58.163014 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:58.163014 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:58.163014 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:58.163846 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:58.163846 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:58.163846 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:58.163846 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:58.163846 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:16:58.163846 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:16:58.163846 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:16:58.163846 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:16:58.163846 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:16:58.163846 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:16:58.163846 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 02 03:16:58.163846 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:16:58.163846 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 269/551] 10.222.0.60 () {56 vars in 1102 bytes} [Sat Jul 2 03:16:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 03:16:58.170305 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e4f073-485b-4b03-813f-75490f54c19e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:58.191594 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:58.272386 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba94c10-285a-4de2-9b63-8d425a3ccd2c None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:58.274540 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:58.315108 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e4f073-485b-4b03-813f-75490f54c19e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:58.334109 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a607e76-12d9-4c74-a210-afbaf60665fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:58.335443 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a607e76-12d9-4c74-a210-afbaf60665fc None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:58.335904 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a607e76-12d9-4c74-a210-afbaf60665fc None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:58.336354 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a607e76-12d9-4c74-a210-afbaf60665fc None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:58.337858 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a607e76-12d9-4c74-a210-afbaf60665fc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:58.338377 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a607e76-12d9-4c74-a210-afbaf60665fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:58.340559 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a607e76-12d9-4c74-a210-afbaf60665fc None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:58.352326 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e576fc-8b8c-4850-a158-7ef417fc5dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:58.353750 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e576fc-8b8c-4850-a158-7ef417fc5dd0 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:58.353750 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e576fc-8b8c-4850-a158-7ef417fc5dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:58.353750 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e576fc-8b8c-4850-a158-7ef417fc5dd0 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:58.354590 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e576fc-8b8c-4850-a158-7ef417fc5dd0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:58.355030 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e576fc-8b8c-4850-a158-7ef417fc5dd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:58.356519 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e576fc-8b8c-4850-a158-7ef417fc5dd0 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:58.365796 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 283/552] 10.222.0.60 () {56 vars in 1135 bytes} [Sat Jul 2 03:16:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:58.370355 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 270/553] 10.222.0.60 () {56 vars in 1103 bytes} [Sat Jul 2 03:16:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:16:58.371574 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a607e76-12d9-4c74-a210-afbaf60665fc None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:58.372023 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb6506-8e14-47d1-be2b-d339bd52a6d8 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:58.372334 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb6506-8e14-47d1-be2b-d339bd52a6d8 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:58.372591 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb6506-8e14-47d1-be2b-d339bd52a6d8 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:58.378363 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 271/554] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:16:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:16:58.379226 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffb6506-8e14-47d1-be2b-d339bd52a6d8 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:58.494564 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffb6506-8e14-47d1-be2b-d339bd52a6d8 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:58.497069 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a607e76-12d9-4c74-a210-afbaf60665fc None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:58.520691 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:58.531513 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:58.535110 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472759c4-ea59-4b38-8398-8355cb0c864b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:58.536464 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472759c4-ea59-4b38-8398-8355cb0c864b None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:58.536836 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472759c4-ea59-4b38-8398-8355cb0c864b None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:58.537176 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472759c4-ea59-4b38-8398-8355cb0c864b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:58.539743 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c65e6b-8061-4bad-b103-15e984bb1496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:58.541282 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c65e6b-8061-4bad-b103-15e984bb1496 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:58.542680 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c65e6b-8061-4bad-b103-15e984bb1496 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:58.543211 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c65e6b-8061-4bad-b103-15e984bb1496 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:58.556206 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c65e6b-8061-4bad-b103-15e984bb1496 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:58.558265 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c65e6b-8061-4bad-b103-15e984bb1496 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:58.582118 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-f6c65e6b-8061-4bad-b103-15e984bb1496 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:16:58.582118 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:58.582118 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:58.582118 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:58.582118 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:58.582118 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:58.582118 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:58.582118 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:58.582118 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:58.582118 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:58.582118 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:58.582118 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:58.582118 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:16:58.582118 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:16:58.582118 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:16:58.583084 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:16:58.583084 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:58.583084 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:58.583084 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:58.583084 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:58.583084 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:58.583084 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:58.583084 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:58.583084 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:58.583084 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:58.583084 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:58.583084 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:58.583084 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:58.583084 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:58.583084 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:58.583084 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:58.583084 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:58.583971 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:16:58.583971 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:16:58.583971 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:16:58.583971 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:16:58.586483 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 272/555] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:16:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:16:58.588224 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db9a60-b655-4f25-8f93-0a26559f14e3 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:58.588650 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db9a60-b655-4f25-8f93-0a26559f14e3 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:58.589109 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db9a60-b655-4f25-8f93-0a26559f14e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:58.609504 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-81db9a60-b655-4f25-8f93-0a26559f14e3 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:16:58.611236 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-81db9a60-b655-4f25-8f93-0a26559f14e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:16:58.619434 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472759c4-ea59-4b38-8398-8355cb0c864b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:58.621134 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472759c4-ea59-4b38-8398-8355cb0c864b None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:58.699708 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 273/556] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:16:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 03:16:58.700812 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81db9a60-b655-4f25-8f93-0a26559f14e3 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:58.757599 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 284/557] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Jul 2 03:16:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 03:16:58.759416 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472759c4-ea59-4b38-8398-8355cb0c864b None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:58.786814 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:58.820554 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81db9a60-b655-4f25-8f93-0a26559f14e3 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:58.837893 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:58.862512 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3eef8c-cc7f-4241-9b8e-c4c86b18d7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:58.863238 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3eef8c-cc7f-4241-9b8e-c4c86b18d7d8 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:58.863527 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3eef8c-cc7f-4241-9b8e-c4c86b18d7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:58.863800 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3eef8c-cc7f-4241-9b8e-c4c86b18d7d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:58.864531 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3eef8c-cc7f-4241-9b8e-c4c86b18d7d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:58.864832 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3eef8c-cc7f-4241-9b8e-c4c86b18d7d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:58.866223 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3eef8c-cc7f-4241-9b8e-c4c86b18d7d8 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:58.875025 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472759c4-ea59-4b38-8398-8355cb0c864b None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:58.878036 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 274/558] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:16:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:58.878545 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3eef8c-cc7f-4241-9b8e-c4c86b18d7d8 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:58.914195 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aa76e7-5c2f-4cf0-8479-73ce431c2cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:58.915475 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa76e7-5c2f-4cf0-8479-73ce431c2cf8 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:58.915760 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa76e7-5c2f-4cf0-8479-73ce431c2cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:58.916033 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa76e7-5c2f-4cf0-8479-73ce431c2cf8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:58.926421 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aa76e7-5c2f-4cf0-8479-73ce431c2cf8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:16:58.934112 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-d3aa76e7-5c2f-4cf0-8479-73ce431c2cf8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 02 03:16:58.934112 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:58.934112 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:58.934112 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:58.934112 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:58.934112 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:58.934112 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:58.934112 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:58.934112 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:58.934112 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:58.934112 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:58.934112 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:58.934112 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:16:58.934112 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:16:58.934112 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:16:58.934112 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:16:58.935553 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:16:58.935553 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:16:58.935553 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:16:58.935553 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:16:58.935553 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:58.935553 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:58.935553 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:58.935553 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:58.935553 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:58.935553 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:58.935553 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:58.935553 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:58.935553 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:58.935553 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:58.935553 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:58.935553 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:58.936384 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:58.936384 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:58.936384 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:58.936384 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:58.936384 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:16:58.936384 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:16:58.936384 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:16:58.936384 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:16:58.936384 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:16:58.936384 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:16:58.936384 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 02 03:16:58.936384 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:16:58.940502 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 285/559] 10.222.0.60 () {56 vars in 1102 bytes} [Sat Jul 2 03:16:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:16:58.941467 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b86a7-15db-4d53-aef3-4c5580b0627d None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:58.941760 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b86a7-15db-4d53-aef3-4c5580b0627d None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:58.942041 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b86a7-15db-4d53-aef3-4c5580b0627d None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:58.943660 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 286/560] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:16:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:16:58.947466 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24b86a7-15db-4d53-aef3-4c5580b0627d None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:58.988718 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3eef8c-cc7f-4241-9b8e-c4c86b18d7d8 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:59.025109 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4797c403-64e8-435d-ab4e-cfa5bb71aa9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:59.026289 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797c403-64e8-435d-ab4e-cfa5bb71aa9d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:59.026813 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797c403-64e8-435d-ab4e-cfa5bb71aa9d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:59.027269 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797c403-64e8-435d-ab4e-cfa5bb71aa9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:59.029300 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:59.039766 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4797c403-64e8-435d-ab4e-cfa5bb71aa9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:59.041835 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4797c403-64e8-435d-ab4e-cfa5bb71aa9d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:59.049298 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24b86a7-15db-4d53-aef3-4c5580b0627d None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:59.060281 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-4797c403-64e8-435d-ab4e-cfa5bb71aa9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:16:59.060281 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:59.060281 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:59.060281 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:59.060281 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:59.060281 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:59.060281 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:59.060281 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:59.060281 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:59.060281 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:59.060281 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:59.060281 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:59.060281 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:16:59.060281 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:16:59.060281 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:16:59.061277 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:16:59.061277 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:59.061277 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:59.061277 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:59.061277 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:59.061277 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:59.061277 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:59.061277 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:59.061277 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:59.061277 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:59.061277 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:59.061277 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:59.061277 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:59.061277 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:59.061277 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:59.061277 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:59.061277 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:59.062137 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:16:59.062137 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:16:59.062137 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:16:59.062137 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:16:59.062137 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 275/561] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:16:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:16:59.062410 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4797c403-64e8-435d-ab4e-cfa5bb71aa9d None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:59.092228 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:59.095444 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2d0d0e-4110-4fca-a159-b86e62eae428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:59.096573 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d0d0e-4110-4fca-a159-b86e62eae428 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:59.096996 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d0d0e-4110-4fca-a159-b86e62eae428 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:59.097272 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d0d0e-4110-4fca-a159-b86e62eae428 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:59.105161 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2d0d0e-4110-4fca-a159-b86e62eae428 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:59.106622 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2d0d0e-4110-4fca-a159-b86e62eae428 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:59.120860 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-dd2d0d0e-4110-4fca-a159-b86e62eae428 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 02 03:16:59.120860 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:59.120860 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:59.120860 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:59.120860 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:59.120860 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:59.120860 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:59.120860 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:59.120860 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:59.120860 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:59.120860 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:59.120860 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:59.120860 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 03:16:59.120860 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 03:16:59.120860 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 03:16:59.120860 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 03:16:59.121833 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:59.121833 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:59.121833 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 03:16:59.121833 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 03:16:59.121833 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 03:16:59.121833 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 03:16:59.121833 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:59.121833 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:59.121833 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:59.121833 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:59.121833 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:59.121833 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:59.121833 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:59.121833 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:59.121833 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:59.121833 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:59.121833 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:59.121833 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:59.122885 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:59.122885 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:59.122885 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 03:16:59.122885 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 03:16:59.122885 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 03:16:59.122885 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 03:16:59.122885 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 03:16:59.122885 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 03:16:59.122885 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 02 03:16:59.122885 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:16:59.122885 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 287/562] 10.222.0.60 () {56 vars in 1093 bytes} [Sat Jul 2 03:16:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:16:59.124008 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24248c0e-9bff-4741-b912-9c697d0b6872 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:59.124008 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24248c0e-9bff-4741-b912-9c697d0b6872 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:59.124236 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24248c0e-9bff-4741-b912-9c697d0b6872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:59.142409 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-24248c0e-9bff-4741-b912-9c697d0b6872 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:16:59.143639 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-24248c0e-9bff-4741-b912-9c697d0b6872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:16:59.180476 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4797c403-64e8-435d-ab4e-cfa5bb71aa9d None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:59.214802 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 288/563] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:16:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 03:16:59.215997 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24248c0e-9bff-4741-b912-9c697d0b6872 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:59.226802 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c8fdef-540d-4af0-a709-ef1d168e9cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:59.227693 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8fdef-540d-4af0-a709-ef1d168e9cf4 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:59.228159 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8fdef-540d-4af0-a709-ef1d168e9cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:59.228623 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8fdef-540d-4af0-a709-ef1d168e9cf4 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:59.229524 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c8fdef-540d-4af0-a709-ef1d168e9cf4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:59.230106 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c8fdef-540d-4af0-a709-ef1d168e9cf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:59.231671 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c8fdef-540d-4af0-a709-ef1d168e9cf4 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:59.241914 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 276/564] 10.222.0.60 () {56 vars in 1103 bytes} [Sat Jul 2 03:16:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:59.242948 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c8fdef-540d-4af0-a709-ef1d168e9cf4 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:59.301028 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:59.330452 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24248c0e-9bff-4741-b912-9c697d0b6872 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:59.336088 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:59.353857 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c8fdef-540d-4af0-a709-ef1d168e9cf4 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:59.366720 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6ad102-bddc-4377-98a4-c58acec03c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:59.367428 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ad102-bddc-4377-98a4-c58acec03c7e None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:59.370622 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ad102-bddc-4377-98a4-c58acec03c7e None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:59.370622 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ad102-bddc-4377-98a4-c58acec03c7e None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:59.370622 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6ad102-bddc-4377-98a4-c58acec03c7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:59.370622 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6ad102-bddc-4377-98a4-c58acec03c7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:59.371495 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6ad102-bddc-4377-98a4-c58acec03c7e None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:59.383887 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 289/565] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:16:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:59.388938 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6ad102-bddc-4377-98a4-c58acec03c7e None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:59.392230 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a5cdc-0252-430a-96b8-377f120937e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:59.393730 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a5cdc-0252-430a-96b8-377f120937e8 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:59.394016 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a5cdc-0252-430a-96b8-377f120937e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:59.394289 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a5cdc-0252-430a-96b8-377f120937e8 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:59.395152 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08a5cdc-0252-430a-96b8-377f120937e8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:59.395468 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08a5cdc-0252-430a-96b8-377f120937e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:59.396935 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08a5cdc-0252-430a-96b8-377f120937e8 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:59.423239 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 277/566] 10.222.0.60 () {56 vars in 1133 bytes} [Sat Jul 2 03:16:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:59.423239 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a5cdc-0252-430a-96b8-377f120937e8 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:59.496495 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6ad102-bddc-4377-98a4-c58acec03c7e None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:59.526504 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a5cdc-0252-430a-96b8-377f120937e8 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:59.530964 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:59.536295 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b461c2d3-46cb-4501-aa67-97eefab0dad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:59.537336 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461c2d3-46cb-4501-aa67-97eefab0dad0 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:59.537336 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461c2d3-46cb-4501-aa67-97eefab0dad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:59.537632 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461c2d3-46cb-4501-aa67-97eefab0dad0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:59.548540 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b461c2d3-46cb-4501-aa67-97eefab0dad0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:16:59.556327 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-b461c2d3-46cb-4501-aa67-97eefab0dad0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 02 03:16:59.556327 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:59.556327 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:59.556327 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:59.556327 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:59.556327 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:59.556327 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:59.556327 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:59.556327 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:59.556327 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:59.556327 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:59.556327 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:59.556327 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:16:59.556327 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:16:59.556327 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:16:59.556327 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:16:59.557281 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:16:59.557281 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:16:59.557281 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:16:59.557281 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:16:59.557281 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:59.557281 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:59.557281 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:59.557281 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:59.557281 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:59.557281 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:59.557281 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:59.557281 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:59.557281 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:59.557281 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:59.557281 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:59.557281 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:59.558190 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:59.558190 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:59.558190 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:59.558190 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:59.558190 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:16:59.558190 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:16:59.558190 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:16:59.558190 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:16:59.558190 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:16:59.558190 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:16:59.558190 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 02 03:16:59.558190 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:16:59.558190 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 290/567] 10.222.0.60 () {56 vars in 1102 bytes} [Sat Jul 2 03:16:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:16:59.558873 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b461c2d3-46cb-4501-aa67-97eefab0dad0 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:59.564197 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278aecc4-d698-4dd4-8afc-f151ae361ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:59.565020 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278aecc4-d698-4dd4-8afc-f151ae361ad2 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:59.565301 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278aecc4-d698-4dd4-8afc-f151ae361ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:59.565575 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278aecc4-d698-4dd4-8afc-f151ae361ad2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:59.577362 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278aecc4-d698-4dd4-8afc-f151ae361ad2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:59.578821 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278aecc4-d698-4dd4-8afc-f151ae361ad2 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:59.581215 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:59.596810 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-278aecc4-d698-4dd4-8afc-f151ae361ad2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:16:59.596810 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:59.596810 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:59.596810 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:59.596810 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:59.596810 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:59.596810 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:59.596810 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:59.596810 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:59.596810 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:59.596810 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:59.596810 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:59.596810 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:16:59.596810 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:16:59.596810 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:16:59.597823 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:16:59.597823 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:59.597823 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:59.597823 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:59.597823 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:59.597823 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:59.597823 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:59.597823 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:59.597823 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:59.597823 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:59.597823 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:59.597823 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:59.597823 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:59.597823 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:59.597823 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:59.597823 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:59.597823 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:59.598720 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:16:59.598720 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:16:59.598720 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:16:59.598720 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:16:59.598720 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 278/568] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:16:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:16:59.598985 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278aecc4-d698-4dd4-8afc-f151ae361ad2 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:59.661136 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b461c2d3-46cb-4501-aa67-97eefab0dad0 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:59.695897 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278aecc4-d698-4dd4-8afc-f151ae361ad2 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:59.696380 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ec393-4dfd-4e5f-bfda-e4ba60224400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:59.697268 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ec393-4dfd-4e5f-bfda-e4ba60224400 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:59.697669 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ec393-4dfd-4e5f-bfda-e4ba60224400 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:59.698028 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ec393-4dfd-4e5f-bfda-e4ba60224400 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:59.705208 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76ec393-4dfd-4e5f-bfda-e4ba60224400 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:59.706657 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76ec393-4dfd-4e5f-bfda-e4ba60224400 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:59.720872 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-d76ec393-4dfd-4e5f-bfda-e4ba60224400 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 03:16:59.720872 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:59.720872 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:59.720872 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:59.720872 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:59.720872 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:59.720872 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:59.720872 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:59.720872 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:59.720872 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:59.720872 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:59.720872 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:59.720872 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 03:16:59.720872 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 03:16:59.720872 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 03:16:59.721766 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 03:16:59.721766 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:59.721766 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:59.721766 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:59.721766 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:59.721766 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:59.721766 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:59.721766 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:59.721766 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:59.721766 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:59.721766 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:59.721766 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:59.721766 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:59.721766 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:59.721766 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:59.721766 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:59.721766 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:59.728529 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 03:16:59.728529 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 03:16:59.728529 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 03:16:59.728529 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 03:16:59.728529 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 03:16:59.728529 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 03:16:59.728529 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 03:16:59.728529 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:16:59.728529 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 291/569] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Jul 2 03:16:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:16:59.728529 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfdff5f-455c-4b48-9642-9a6871b1c94b None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:59.728529 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfdff5f-455c-4b48-9642-9a6871b1c94b None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:59.729137 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfdff5f-455c-4b48-9642-9a6871b1c94b None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:59.729137 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 292/570] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:16:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:16:59.729137 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfdff5f-455c-4b48-9642-9a6871b1c94b None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:59.732642 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def2104b-f61d-423e-b27e-9737ad7abf10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:59.733444 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2104b-f61d-423e-b27e-9737ad7abf10 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:59.733716 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2104b-f61d-423e-b27e-9737ad7abf10 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:59.733988 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2104b-f61d-423e-b27e-9737ad7abf10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:59.744132 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def2104b-f61d-423e-b27e-9737ad7abf10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:59.745623 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def2104b-f61d-423e-b27e-9737ad7abf10 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:59.762947 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-def2104b-f61d-423e-b27e-9737ad7abf10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:16:59.762947 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:16:59.762947 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:16:59.762947 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:16:59.762947 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:16:59.762947 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:16:59.762947 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:16:59.762947 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:16:59.762947 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:16:59.762947 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:16:59.762947 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:16:59.762947 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:16:59.762947 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:16:59.762947 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:16:59.762947 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:16:59.763898 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:16:59.763898 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:16:59.763898 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:16:59.763898 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:16:59.763898 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:16:59.763898 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:16:59.763898 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:16:59.763898 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:16:59.763898 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:16:59.763898 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:16:59.763898 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:16:59.763898 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:16:59.763898 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:16:59.763898 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:16:59.763898 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:16:59.763898 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:16:59.763898 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:16:59.764904 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:16:59.764904 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:16:59.764904 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:16:59.764904 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:16:59.764904 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 279/571] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:16:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:16:59.765177 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def2104b-f61d-423e-b27e-9737ad7abf10 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:59.787849 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:59.812828 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:16:59.837195 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfdff5f-455c-4b48-9642-9a6871b1c94b None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:59.870443 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def2104b-f61d-423e-b27e-9737ad7abf10 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:59.871899 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d420a71d-6a41-46be-91a2-9387510739c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:59.872575 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420a71d-6a41-46be-91a2-9387510739c5 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:59.872854 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420a71d-6a41-46be-91a2-9387510739c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:59.873744 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420a71d-6a41-46be-91a2-9387510739c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:59.873861 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d420a71d-6a41-46be-91a2-9387510739c5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:59.874167 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d420a71d-6a41-46be-91a2-9387510739c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:59.875572 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d420a71d-6a41-46be-91a2-9387510739c5 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:59.883976 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 293/572] 10.222.0.60 () {56 vars in 1103 bytes} [Sat Jul 2 03:16:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:59.884654 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d420a71d-6a41-46be-91a2-9387510739c5 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:16:59.909310 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c998c7-0ddb-490d-be2c-50f7ad46c72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:16:59.910007 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c998c7-0ddb-490d-be2c-50f7ad46c72c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:59.910290 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c998c7-0ddb-490d-be2c-50f7ad46c72c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:59.910573 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c998c7-0ddb-490d-be2c-50f7ad46c72c None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:59.911335 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c998c7-0ddb-490d-be2c-50f7ad46c72c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:16:59.911641 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c998c7-0ddb-490d-be2c-50f7ad46c72c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:16:59.913054 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c998c7-0ddb-490d-be2c-50f7ad46c72c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:16:59.925026 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 280/573] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:16:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:16:59.926386 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394aef1f-2aca-4e21-8f80-e0eb00e26830 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:16:59.926679 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394aef1f-2aca-4e21-8f80-e0eb00e26830 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:16:59.926928 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394aef1f-2aca-4e21-8f80-e0eb00e26830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:16:59.942968 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-394aef1f-2aca-4e21-8f80-e0eb00e26830 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:16:59.944181 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-394aef1f-2aca-4e21-8f80-e0eb00e26830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:16:59.985943 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d420a71d-6a41-46be-91a2-9387510739c5 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:16:59.999202 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:00.008753 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 281/574] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:16:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 03:17:00.009574 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394aef1f-2aca-4e21-8f80-e0eb00e26830 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:00.022059 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a1d453-cbe1-40ec-9fd5-e766ad64f701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:00.022727 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a1d453-cbe1-40ec-9fd5-e766ad64f701 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:00.023002 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a1d453-cbe1-40ec-9fd5-e766ad64f701 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:00.023309 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a1d453-cbe1-40ec-9fd5-e766ad64f701 None admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:00.024094 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a1d453-cbe1-40ec-9fd5-e766ad64f701 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:00.024399 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a1d453-cbe1-40ec-9fd5-e766ad64f701 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:00.025828 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a1d453-cbe1-40ec-9fd5-e766ad64f701 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:00.038783 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 294/575] 10.222.0.60 () {56 vars in 1148 bytes} [Sat Jul 2 03:16:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:00.039615 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a1d453-cbe1-40ec-9fd5-e766ad64f701 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:00.050269 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:00.111252 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394aef1f-2aca-4e21-8f80-e0eb00e26830 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:00.146468 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a1d453-cbe1-40ec-9fd5-e766ad64f701 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:00.146748 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa7b79-20d4-4420-bdec-5d04a8b90e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:00.147451 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa7b79-20d4-4420-bdec-5d04a8b90e01 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:00.147773 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa7b79-20d4-4420-bdec-5d04a8b90e01 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:00.148052 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa7b79-20d4-4420-bdec-5d04a8b90e01 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:00.148748 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaa7b79-20d4-4420-bdec-5d04a8b90e01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:00.149087 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaa7b79-20d4-4420-bdec-5d04a8b90e01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:00.150489 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaa7b79-20d4-4420-bdec-5d04a8b90e01 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:00.162473 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 282/576] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:17:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:00.163349 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa7b79-20d4-4420-bdec-5d04a8b90e01 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:00.185669 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c9d8f5-99ea-42ac-80a4-ef8fbbebc0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:00.186763 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c9d8f5-99ea-42ac-80a4-ef8fbbebc0fc None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:00.187038 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c9d8f5-99ea-42ac-80a4-ef8fbbebc0fc None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:00.187329 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c9d8f5-99ea-42ac-80a4-ef8fbbebc0fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:00.197724 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c9d8f5-99ea-42ac-80a4-ef8fbbebc0fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:00.199256 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c9d8f5-99ea-42ac-80a4-ef8fbbebc0fc None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:00.217077 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-43c9d8f5-99ea-42ac-80a4-ef8fbbebc0fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:00.217077 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:00.217077 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:00.217077 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:00.217077 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:00.217077 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:00.217077 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:00.217077 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:00.217077 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:00.217077 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:00.217077 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:00.217077 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:00.217077 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:17:00.217077 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:17:00.217077 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:17:00.218050 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:17:00.218050 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:00.218050 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:00.218050 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:00.218050 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:00.218050 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:00.218050 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:00.218050 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:00.218050 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:00.218050 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:00.218050 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:00.218050 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:00.218050 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:00.218050 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:00.218050 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:00.218050 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:00.218050 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:00.218941 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:17:00.218941 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:17:00.218941 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:00.218941 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:00.218941 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 295/577] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:17:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:00.219255 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c9d8f5-99ea-42ac-80a4-ef8fbbebc0fc None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:00.247888 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:00.261758 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:00.265596 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa7b79-20d4-4420-bdec-5d04a8b90e01 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:00.300208 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd01ca4d-1cda-4430-b89d-5c8745e89ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:00.301105 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd01ca4d-1cda-4430-b89d-5c8745e89ae3 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:00.301379 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd01ca4d-1cda-4430-b89d-5c8745e89ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:00.301646 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd01ca4d-1cda-4430-b89d-5c8745e89ae3 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:00.308660 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd01ca4d-1cda-4430-b89d-5c8745e89ae3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:00.310125 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd01ca4d-1cda-4430-b89d-5c8745e89ae3 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:00.320695 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c9d8f5-99ea-42ac-80a4-ef8fbbebc0fc None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:00.324529 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-dd01ca4d-1cda-4430-b89d-5c8745e89ae3 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 02 03:17:00.324529 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:00.324529 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:00.324529 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:00.324529 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:00.324529 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:00.324529 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:00.324529 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:00.324529 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:00.324529 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:00.324529 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:00.324529 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:00.324529 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 03:17:00.324529 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 03:17:00.324529 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 03:17:00.324529 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 03:17:00.325586 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:00.325586 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:00.325586 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 03:17:00.325586 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 03:17:00.325586 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 03:17:00.325586 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 03:17:00.325586 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:00.325586 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:00.325586 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:00.325586 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:00.325586 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:00.325586 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:00.325586 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:00.325586 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:00.325586 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:00.325586 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:00.325586 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:00.325586 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:00.326519 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:00.326519 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:00.326519 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 03:17:00.326519 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 03:17:00.326519 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 03:17:00.326519 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 03:17:00.326519 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 03:17:00.326519 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 03:17:00.326519 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 02 03:17:00.326519 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:00.326519 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 283/578] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Jul 2 03:17:00 2022] GET /identity/v3/users/glance => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:00.326519 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd01ca4d-1cda-4430-b89d-5c8745e89ae3 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:00.362658 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46772cae-5e1d-40ee-bac4-7eb7a2b1313e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:00.363447 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46772cae-5e1d-40ee-bac4-7eb7a2b1313e None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:00.363731 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46772cae-5e1d-40ee-bac4-7eb7a2b1313e None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:00.364000 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46772cae-5e1d-40ee-bac4-7eb7a2b1313e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:00.374406 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46772cae-5e1d-40ee-bac4-7eb7a2b1313e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:17:00.382170 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-46772cae-5e1d-40ee-bac4-7eb7a2b1313e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 02 03:17:00.382170 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:00.382170 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:00.382170 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:00.382170 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:00.382170 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:00.382170 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:00.382170 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:00.382170 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:00.382170 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:00.382170 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:00.382170 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:00.382170 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:17:00.382170 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:17:00.382170 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:17:00.382170 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:17:00.383090 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:17:00.383090 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:17:00.383090 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:17:00.383090 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:17:00.383090 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:00.383090 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:00.383090 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:00.383090 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:00.383090 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:00.383090 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:00.383090 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:00.383090 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:00.383090 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:00.383090 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:00.383090 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:00.383090 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:00.389214 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:00.389214 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:00.389214 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:00.389214 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:00.389214 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:17:00.389214 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:17:00.389214 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:17:00.389214 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:17:00.389214 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:17:00.389214 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:17:00.389214 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 02 03:17:00.389214 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:00.389214 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 296/579] 10.222.0.60 () {56 vars in 1102 bytes} [Sat Jul 2 03:17:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:00.389214 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46772cae-5e1d-40ee-bac4-7eb7a2b1313e None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:00.432981 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd01ca4d-1cda-4430-b89d-5c8745e89ae3 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:00.466060 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb8b9b-ffe5-4314-8770-d2e776f9d2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:00.466741 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb8b9b-ffe5-4314-8770-d2e776f9d2a2 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:00.467032 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb8b9b-ffe5-4314-8770-d2e776f9d2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:00.467323 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb8b9b-ffe5-4314-8770-d2e776f9d2a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:00.468155 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eb8b9b-ffe5-4314-8770-d2e776f9d2a2 None admin] RBAC: Adding query filter params (role.id=3c71d0e875cd4a00849f14227be8f7ed, scope.project.id=e09dc5d9d4904c2b89b0cabed237d55e, user.id=692ec343bf9f4339ba691440f55a6c37) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:00.468464 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eb8b9b-ffe5-4314-8770-d2e776f9d2a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:00.469884 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:00.470009 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eb8b9b-ffe5-4314-8770-d2e776f9d2a2 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:00.475267 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 284/580] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Jul 2 03:17:00 2022] GET /identity/v3/role_assignments?user.id=692ec343bf9f4339ba691440f55a6c37&scope.project.id=e09dc5d9d4904c2b89b0cabed237d55e&role.id=3c71d0e875cd4a00849f14227be8f7ed => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:00.476041 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb8b9b-ffe5-4314-8770-d2e776f9d2a2 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:00.485765 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46772cae-5e1d-40ee-bac4-7eb7a2b1313e None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:00.503668 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:00.523743 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7033d05-2349-476e-adca-b992c550a3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:00.524553 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7033d05-2349-476e-adca-b992c550a3a5 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:00.524832 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7033d05-2349-476e-adca-b992c550a3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:00.525105 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7033d05-2349-476e-adca-b992c550a3a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:00.532964 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7033d05-2349-476e-adca-b992c550a3a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:00.534486 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7033d05-2349-476e-adca-b992c550a3a5 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:00.550934 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-a7033d05-2349-476e-adca-b992c550a3a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 03:17:00.550934 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:00.550934 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:00.550934 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:00.550934 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:00.550934 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:00.550934 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:00.550934 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:00.550934 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:00.550934 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:00.550934 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:00.550934 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:00.550934 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 03:17:00.550934 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 03:17:00.550934 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 03:17:00.551955 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 03:17:00.551955 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:00.551955 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:00.551955 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:00.551955 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:00.551955 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:00.551955 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:00.551955 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:00.551955 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:00.551955 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:00.551955 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:00.551955 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:00.551955 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:00.551955 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:00.551955 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:00.551955 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:00.551955 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:00.552847 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 03:17:00.552847 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 03:17:00.552847 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 03:17:00.552847 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 03:17:00.552847 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 03:17:00.552847 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 03:17:00.552847 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 03:17:00.552847 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:00.552847 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 297/581] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Jul 2 03:17:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:00.553906 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7033d05-2349-476e-adca-b992c550a3a5 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:00.597632 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb8b9b-ffe5-4314-8770-d2e776f9d2a2 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:00.639435 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3dc9a3-39f8-4e19-98d7-99b9e9e1b891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:00.640149 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3dc9a3-39f8-4e19-98d7-99b9e9e1b891 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:00.640499 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3dc9a3-39f8-4e19-98d7-99b9e9e1b891 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:00.641195 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3dc9a3-39f8-4e19-98d7-99b9e9e1b891 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:00.641932 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3dc9a3-39f8-4e19-98d7-99b9e9e1b891 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:00.642238 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3dc9a3-39f8-4e19-98d7-99b9e9e1b891 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:00.644345 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3dc9a3-39f8-4e19-98d7-99b9e9e1b891 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:00.661159 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 285/582] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:17:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:00.661159 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3dc9a3-39f8-4e19-98d7-99b9e9e1b891 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:00.672996 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7033d05-2349-476e-adca-b992c550a3a5 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:00.710153 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50561725-43af-4888-a056-be52b6f4d1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:00.710829 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50561725-43af-4888-a056-be52b6f4d1f7 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:00.711104 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50561725-43af-4888-a056-be52b6f4d1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:00.711399 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50561725-43af-4888-a056-be52b6f4d1f7 None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:00.712660 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50561725-43af-4888-a056-be52b6f4d1f7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:00.713114 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50561725-43af-4888-a056-be52b6f4d1f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:00.714696 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50561725-43af-4888-a056-be52b6f4d1f7 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:00.736671 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 298/583] 10.222.0.60 () {56 vars in 1137 bytes} [Sat Jul 2 03:17:00 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:00.736671 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50561725-43af-4888-a056-be52b6f4d1f7 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:00.740252 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:00.745118 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:00.764677 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3dc9a3-39f8-4e19-98d7-99b9e9e1b891 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:00.802134 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9d9331-33a6-4742-810f-01bd69bb9fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:00.802805 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d9331-33a6-4742-810f-01bd69bb9fa0 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:00.803111 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d9331-33a6-4742-810f-01bd69bb9fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:00.803403 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d9331-33a6-4742-810f-01bd69bb9fa0 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:00.804124 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9d9331-33a6-4742-810f-01bd69bb9fa0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:00.804442 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9d9331-33a6-4742-810f-01bd69bb9fa0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:00.805873 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9d9331-33a6-4742-810f-01bd69bb9fa0 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:00.814510 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 286/584] 10.222.0.60 () {56 vars in 1103 bytes} [Sat Jul 2 03:17:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:00.816574 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9d9331-33a6-4742-810f-01bd69bb9fa0 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:00.839496 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50561725-43af-4888-a056-be52b6f4d1f7 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:00.879089 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7d2d96-faef-4ec7-8398-dde7f505de9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:00.879932 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d2d96-faef-4ec7-8398-dde7f505de9f None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:00.880304 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d2d96-faef-4ec7-8398-dde7f505de9f None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:00.880661 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d2d96-faef-4ec7-8398-dde7f505de9f None admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:00.881565 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7d2d96-faef-4ec7-8398-dde7f505de9f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:00.881971 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7d2d96-faef-4ec7-8398-dde7f505de9f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:00.883517 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7d2d96-faef-4ec7-8398-dde7f505de9f None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:00.900749 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 299/585] 10.222.0.60 () {56 vars in 1148 bytes} [Sat Jul 2 03:17:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:00.900749 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7d2d96-faef-4ec7-8398-dde7f505de9f None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:00.930101 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9d9331-33a6-4742-810f-01bd69bb9fa0 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:00.964742 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1766f2-c6f6-4ea2-8556-2425021b0a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:00.965535 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1766f2-c6f6-4ea2-8556-2425021b0a64 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:00.965817 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1766f2-c6f6-4ea2-8556-2425021b0a64 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:00.966098 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1766f2-c6f6-4ea2-8556-2425021b0a64 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:00.969249 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:00.974070 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1766f2-c6f6-4ea2-8556-2425021b0a64 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:00.975580 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1766f2-c6f6-4ea2-8556-2425021b0a64 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:00.994598 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-2b1766f2-c6f6-4ea2-8556-2425021b0a64 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 02 03:17:00.994598 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:00.994598 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:00.994598 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:00.994598 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:00.994598 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:00.994598 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:00.994598 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:00.994598 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:00.994598 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:00.994598 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:00.994598 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:00.994598 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 03:17:00.994598 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 03:17:00.994598 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 03:17:00.994598 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 03:17:00.995911 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:00.995911 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:00.995911 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 03:17:00.995911 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 03:17:00.995911 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 03:17:00.995911 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 03:17:00.995911 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:00.995911 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:00.995911 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:00.995911 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:00.995911 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:00.995911 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:00.995911 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:00.995911 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:00.995911 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:00.995911 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:00.995911 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:00.995911 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:00.997008 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:00.997008 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:00.997008 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 03:17:00.997008 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 03:17:00.997008 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 03:17:00.997008 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 03:17:00.997008 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 03:17:00.997008 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 03:17:00.997008 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 02 03:17:00.997008 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:00.997538 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 287/586] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Jul 2 03:17:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:00.997989 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1766f2-c6f6-4ea2-8556-2425021b0a64 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:01.002598 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:01.020791 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7d2d96-faef-4ec7-8398-dde7f505de9f None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:01.056871 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db25e031-419a-44ea-8ad3-029270645da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:01.057670 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25e031-419a-44ea-8ad3-029270645da3 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:01.057978 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25e031-419a-44ea-8ad3-029270645da3 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:01.058253 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25e031-419a-44ea-8ad3-029270645da3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:01.070391 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db25e031-419a-44ea-8ad3-029270645da3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:01.071861 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db25e031-419a-44ea-8ad3-029270645da3 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:01.090143 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-db25e031-419a-44ea-8ad3-029270645da3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:01.090143 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:01.090143 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:01.090143 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:01.090143 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:01.090143 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:01.090143 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:01.090143 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:01.090143 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:01.090143 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:01.090143 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:01.090143 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:01.090143 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:17:01.090143 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:17:01.090143 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:17:01.091249 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:17:01.091249 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:01.091249 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:01.091249 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:01.091249 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:01.091249 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:01.091249 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:01.091249 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:01.091249 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:01.091249 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:01.091249 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:01.091249 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:01.091249 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:01.091249 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:01.091249 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:01.091249 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:01.091249 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:01.092327 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:17:01.092327 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:17:01.092327 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:01.092327 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:01.096201 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 300/587] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:17:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:01.096963 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db25e031-419a-44ea-8ad3-029270645da3 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:01.114889 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1766f2-c6f6-4ea2-8556-2425021b0a64 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:01.151736 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed2bfa-581d-4ed7-baa8-accf2ae9fa88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:01.152476 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed2bfa-581d-4ed7-baa8-accf2ae9fa88 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:01.152736 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed2bfa-581d-4ed7-baa8-accf2ae9fa88 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:01.153009 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed2bfa-581d-4ed7-baa8-accf2ae9fa88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:01.164539 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ed2bfa-581d-4ed7-baa8-accf2ae9fa88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:01.166613 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ed2bfa-581d-4ed7-baa8-accf2ae9fa88 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:01.185312 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-e8ed2bfa-581d-4ed7-baa8-accf2ae9fa88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:01.185312 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:01.185312 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:01.185312 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:01.185312 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:01.185312 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:01.185312 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:01.185312 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:01.185312 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:01.185312 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:01.185312 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:01.185312 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:01.185312 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:17:01.185312 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:17:01.185312 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:17:01.186209 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:17:01.186209 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:01.186209 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:01.186209 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:01.186209 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:01.186209 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:01.186209 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:01.186209 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:01.186209 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:01.186209 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:01.186209 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:01.186209 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:01.186209 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:01.186209 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:01.186209 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:01.186209 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:01.186209 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:01.187088 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:17:01.187088 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:17:01.187088 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:01.187088 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:01.187088 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 288/588] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:17:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:01.187419 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed2bfa-581d-4ed7-baa8-accf2ae9fa88 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:01.200213 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db25e031-419a-44ea-8ad3-029270645da3 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:01.217117 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:01.240165 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52923e60-15a3-4920-9c40-ef111f9b481d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:01.241068 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52923e60-15a3-4920-9c40-ef111f9b481d None admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:01.241352 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52923e60-15a3-4920-9c40-ef111f9b481d None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:01.241641 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52923e60-15a3-4920-9c40-ef111f9b481d None admin] PATH_INFO: `/v3/projects/e09dc5d9d4904c2b89b0cabed237d55e/users/13530240e2d446b6bf26a431d001362a/roles/3c71d0e875cd4a00849f14227be8f7ed` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:01.252762 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:01.259210 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52923e60-15a3-4920-9c40-ef111f9b481d None admin] RBAC: Authorizing `identity:create_grant(project_id=e09dc5d9d4904c2b89b0cabed237d55e, user_id=13530240e2d446b6bf26a431d001362a, role_id=3c71d0e875cd4a00849f14227be8f7ed)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:01.260680 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52923e60-15a3-4920-9c40-ef111f9b481d None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:01.275272 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 301/589] 10.222.0.60 () {58 vars in 1439 bytes} [Sat Jul 2 03:17:01 2022] PUT /identity/v3/projects/e09dc5d9d4904c2b89b0cabed237d55e/users/13530240e2d446b6bf26a431d001362a/roles/3c71d0e875cd4a00849f14227be8f7ed => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:17:01.276883 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52923e60-15a3-4920-9c40-ef111f9b481d None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:01.308898 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed2bfa-581d-4ed7-baa8-accf2ae9fa88 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:01.359489 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615a5ff5-be89-4771-81ce-f1203c879f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:01.360465 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a5ff5-be89-4771-81ce-f1203c879f5c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:01.360768 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a5ff5-be89-4771-81ce-f1203c879f5c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:01.361519 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a5ff5-be89-4771-81ce-f1203c879f5c None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:01.362682 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615a5ff5-be89-4771-81ce-f1203c879f5c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:01.362998 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615a5ff5-be89-4771-81ce-f1203c879f5c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:01.365297 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615a5ff5-be89-4771-81ce-f1203c879f5c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:01.395364 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 289/590] 10.222.0.60 () {56 vars in 1137 bytes} [Sat Jul 2 03:17:01 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:01.396622 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615a5ff5-be89-4771-81ce-f1203c879f5c None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:01.426854 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52923e60-15a3-4920-9c40-ef111f9b481d None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:01.472972 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c2e9d-5e87-4926-b9fa-62c38713bfc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:01.473859 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c2e9d-5e87-4926-b9fa-62c38713bfc8 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:01.473979 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c2e9d-5e87-4926-b9fa-62c38713bfc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:01.474168 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c2e9d-5e87-4926-b9fa-62c38713bfc8 None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:01.476848 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72c2e9d-5e87-4926-b9fa-62c38713bfc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:01.476848 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72c2e9d-5e87-4926-b9fa-62c38713bfc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:01.476848 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72c2e9d-5e87-4926-b9fa-62c38713bfc8 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:01.489120 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 302/591] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:17:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:01.489838 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c2e9d-5e87-4926-b9fa-62c38713bfc8 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:01.518988 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:01.536062 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615a5ff5-be89-4771-81ce-f1203c879f5c None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:01.559543 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:01.583868 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097ad7ef-0ee0-48ba-96f2-43895dd56eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:01.584863 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ad7ef-0ee0-48ba-96f2-43895dd56eea None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:01.585641 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ad7ef-0ee0-48ba-96f2-43895dd56eea None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:01.585998 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ad7ef-0ee0-48ba-96f2-43895dd56eea None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:01.587076 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097ad7ef-0ee0-48ba-96f2-43895dd56eea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:01.587495 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097ad7ef-0ee0-48ba-96f2-43895dd56eea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:01.589513 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097ad7ef-0ee0-48ba-96f2-43895dd56eea None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:01.603949 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c2e9d-5e87-4926-b9fa-62c38713bfc8 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:01.605143 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 290/592] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:17:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:01.606231 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097ad7ef-0ee0-48ba-96f2-43895dd56eea None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:01.639752 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f35430c-b8fc-4358-9845-272395f23e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:01.640648 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35430c-b8fc-4358-9845-272395f23e57 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:01.641043 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35430c-b8fc-4358-9845-272395f23e57 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:01.641415 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35430c-b8fc-4358-9845-272395f23e57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:01.653299 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f35430c-b8fc-4358-9845-272395f23e57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:01.654916 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f35430c-b8fc-4358-9845-272395f23e57 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:01.672780 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-2f35430c-b8fc-4358-9845-272395f23e57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:01.672780 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:01.672780 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:01.672780 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:01.672780 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:01.672780 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:01.672780 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:01.672780 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:01.672780 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:01.672780 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:01.672780 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:01.672780 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:01.672780 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:17:01.672780 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:17:01.672780 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:17:01.673892 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:17:01.673892 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:01.673892 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:01.673892 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:01.673892 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:01.673892 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:01.673892 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:01.673892 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:01.673892 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:01.673892 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:01.673892 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:01.673892 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:01.673892 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:01.673892 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:01.673892 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:01.673892 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:01.673892 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:01.675003 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:17:01.675003 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:17:01.675003 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:01.675003 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:01.679203 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 303/593] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:17:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:01.679203 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f35430c-b8fc-4358-9845-272395f23e57 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:01.735157 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097ad7ef-0ee0-48ba-96f2-43895dd56eea None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:01.772210 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072178d0-a2e9-473a-91ad-6cbdb2691540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:01.772720 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:01.774352 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072178d0-a2e9-473a-91ad-6cbdb2691540 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:01.774851 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072178d0-a2e9-473a-91ad-6cbdb2691540 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:01.775411 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072178d0-a2e9-473a-91ad-6cbdb2691540 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:01.783328 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072178d0-a2e9-473a-91ad-6cbdb2691540 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:01.785972 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072178d0-a2e9-473a-91ad-6cbdb2691540 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:01.797408 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f35430c-b8fc-4358-9845-272395f23e57 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:01.803894 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-072178d0-a2e9-473a-91ad-6cbdb2691540 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 03:17:01.803894 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:01.803894 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:01.803894 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:01.803894 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:01.803894 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:01.803894 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:01.803894 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:01.803894 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:01.803894 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:01.803894 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:01.803894 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:01.803894 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 03:17:01.803894 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 03:17:01.803894 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 03:17:01.804729 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 03:17:01.804729 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:01.804729 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:01.804729 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:01.804729 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:01.804729 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:01.804729 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:01.804729 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:01.804729 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:01.804729 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:01.804729 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:01.804729 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:01.804729 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:01.804729 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:01.804729 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:01.804729 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:01.804729 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:01.805594 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 03:17:01.805594 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 03:17:01.805594 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 03:17:01.805594 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 03:17:01.805594 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 03:17:01.805594 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 03:17:01.805594 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 03:17:01.805594 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:01.808272 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 291/594] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Jul 2 03:17:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:01.809324 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072178d0-a2e9-473a-91ad-6cbdb2691540 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:01.833401 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431e2fd4-66a0-48ae-987b-125a2a78b5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:01.834188 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e2fd4-66a0-48ae-987b-125a2a78b5d5 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:01.834509 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e2fd4-66a0-48ae-987b-125a2a78b5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:01.834786 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e2fd4-66a0-48ae-987b-125a2a78b5d5 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:01.843495 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431e2fd4-66a0-48ae-987b-125a2a78b5d5 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:01.845143 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431e2fd4-66a0-48ae-987b-125a2a78b5d5 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:01.847744 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:01.863005 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-431e2fd4-66a0-48ae-987b-125a2a78b5d5 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 02 03:17:01.863005 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:01.863005 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:01.863005 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:01.863005 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:01.863005 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:01.863005 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:01.863005 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:01.863005 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:01.863005 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:01.863005 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:01.863005 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:01.863005 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 03:17:01.863005 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 03:17:01.863005 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 03:17:01.863005 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 03:17:01.864008 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:01.864008 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:01.864008 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 03:17:01.864008 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 03:17:01.864008 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 03:17:01.864008 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 03:17:01.864008 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:01.864008 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:01.864008 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:01.864008 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:01.864008 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:01.864008 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:01.864008 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:01.864008 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:01.864008 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:01.864008 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:01.864008 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:01.864008 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:01.864919 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:01.864919 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:01.864919 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 03:17:01.864919 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 03:17:01.864919 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 03:17:01.864919 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 03:17:01.864919 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 03:17:01.864919 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 03:17:01.864919 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 02 03:17:01.864919 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:01.864919 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 304/595] 10.222.0.60 () {56 vars in 1102 bytes} [Sat Jul 2 03:17:01 2022] GET /identity/v3/users/neutron => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:01.864919 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431e2fd4-66a0-48ae-987b-125a2a78b5d5 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:01.921241 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072178d0-a2e9-473a-91ad-6cbdb2691540 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:01.957557 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa95d59-83d8-4be3-8df2-595662990519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:01.958556 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa95d59-83d8-4be3-8df2-595662990519 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:01.959069 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa95d59-83d8-4be3-8df2-595662990519 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:01.959508 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa95d59-83d8-4be3-8df2-595662990519 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:01.960374 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa95d59-83d8-4be3-8df2-595662990519 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:01.960820 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa95d59-83d8-4be3-8df2-595662990519 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:01.962446 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa95d59-83d8-4be3-8df2-595662990519 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:01.975184 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 292/596] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:17:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:01.975503 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431e2fd4-66a0-48ae-987b-125a2a78b5d5 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:01.976459 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa95d59-83d8-4be3-8df2-595662990519 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:02.017588 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2488506e-3a57-49eb-86cd-a6b5e15866e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:02.018373 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488506e-3a57-49eb-86cd-a6b5e15866e0 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:02.018659 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488506e-3a57-49eb-86cd-a6b5e15866e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:02.018936 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488506e-3a57-49eb-86cd-a6b5e15866e0 None admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:02.019762 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2488506e-3a57-49eb-86cd-a6b5e15866e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:02.020130 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2488506e-3a57-49eb-86cd-a6b5e15866e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:02.021731 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2488506e-3a57-49eb-86cd-a6b5e15866e0 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:02.030193 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:02.036495 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 305/597] 10.222.0.60 () {56 vars in 1148 bytes} [Sat Jul 2 03:17:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:02.037769 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2488506e-3a57-49eb-86cd-a6b5e15866e0 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:02.081027 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:02.089723 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa95d59-83d8-4be3-8df2-595662990519 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:02.126967 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2c3ea0-325c-4fb3-a3bc-5562fd631357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:02.128692 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c3ea0-325c-4fb3-a3bc-5562fd631357 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:02.129188 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c3ea0-325c-4fb3-a3bc-5562fd631357 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:02.129669 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c3ea0-325c-4fb3-a3bc-5562fd631357 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:02.131309 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2c3ea0-325c-4fb3-a3bc-5562fd631357 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:02.132094 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2c3ea0-325c-4fb3-a3bc-5562fd631357 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:02.133817 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2c3ea0-325c-4fb3-a3bc-5562fd631357 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:02.150396 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2488506e-3a57-49eb-86cd-a6b5e15866e0 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:02.153460 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 293/598] 10.222.0.60 () {56 vars in 1139 bytes} [Sat Jul 2 03:17:01 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:02.154462 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2c3ea0-325c-4fb3-a3bc-5562fd631357 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:02.194077 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a486fac-a077-47d6-95ff-ed5b19d83a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:02.194878 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a486fac-a077-47d6-95ff-ed5b19d83a5e None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:02.195197 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a486fac-a077-47d6-95ff-ed5b19d83a5e None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:02.195473 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a486fac-a077-47d6-95ff-ed5b19d83a5e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:02.203066 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a486fac-a077-47d6-95ff-ed5b19d83a5e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:02.204632 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a486fac-a077-47d6-95ff-ed5b19d83a5e None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:02.219784 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-0a486fac-a077-47d6-95ff-ed5b19d83a5e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 03:17:02.219784 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:02.219784 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:02.219784 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:02.219784 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:02.219784 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:02.219784 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:02.219784 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:02.219784 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:02.219784 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:02.219784 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:02.219784 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:02.219784 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 03:17:02.219784 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 03:17:02.219784 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 03:17:02.221148 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 03:17:02.221148 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:02.221148 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:02.221148 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:02.221148 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:02.221148 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:02.221148 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:02.221148 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:02.221148 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:02.221148 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:02.221148 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:02.221148 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:02.221148 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:02.221148 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:02.221148 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:02.221148 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:02.221148 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:02.222025 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 03:17:02.222025 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 03:17:02.222025 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 03:17:02.222025 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 03:17:02.222025 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 03:17:02.222025 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 03:17:02.222025 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 03:17:02.222025 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:02.226157 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 306/599] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Jul 2 03:17:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:02.227161 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a486fac-a077-47d6-95ff-ed5b19d83a5e None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:02.269291 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2c3ea0-325c-4fb3-a3bc-5562fd631357 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:02.290737 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:02.310518 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9829a877-9bae-481d-92b6-e053171ea498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:02.311877 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829a877-9bae-481d-92b6-e053171ea498 None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:02.312353 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829a877-9bae-481d-92b6-e053171ea498 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:02.312814 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829a877-9bae-481d-92b6-e053171ea498 None admin] PATH_INFO: `/v3/projects/e09dc5d9d4904c2b89b0cabed237d55e/users/6470ccbf858f47bf9bb884476bf4235e/roles/3c71d0e875cd4a00849f14227be8f7ed` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:02.328933 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9829a877-9bae-481d-92b6-e053171ea498 None admin] RBAC: Authorizing `identity:create_grant(project_id=e09dc5d9d4904c2b89b0cabed237d55e, user_id=6470ccbf858f47bf9bb884476bf4235e, role_id=3c71d0e875cd4a00849f14227be8f7ed)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:02.330946 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9829a877-9bae-481d-92b6-e053171ea498 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:02.333569 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a486fac-a077-47d6-95ff-ed5b19d83a5e None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:02.346269 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 294/600] 10.222.0.60 () {58 vars in 1439 bytes} [Sat Jul 2 03:17:02 2022] PUT /identity/v3/projects/e09dc5d9d4904c2b89b0cabed237d55e/users/6470ccbf858f47bf9bb884476bf4235e/roles/3c71d0e875cd4a00849f14227be8f7ed => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:17:02.347427 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9829a877-9bae-481d-92b6-e053171ea498 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:02.350630 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:02.374765 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc6000b-96ae-48b1-985e-060bec1f6870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:02.375749 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6000b-96ae-48b1-985e-060bec1f6870 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:02.376274 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6000b-96ae-48b1-985e-060bec1f6870 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:02.376527 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6000b-96ae-48b1-985e-060bec1f6870 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:02.391935 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc6000b-96ae-48b1-985e-060bec1f6870 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:02.393565 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc6000b-96ae-48b1-985e-060bec1f6870 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:02.433006 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-cfc6000b-96ae-48b1-985e-060bec1f6870 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:02.433006 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:02.433006 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:02.433006 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:02.433006 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:02.433006 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:02.433006 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:02.433006 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:02.433006 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:02.433006 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:02.433006 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:02.433006 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:02.433006 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:17:02.433006 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:17:02.433006 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:17:02.434386 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:17:02.434386 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:02.434386 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:02.434386 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:02.434386 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:02.434386 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:02.434386 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:02.434386 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:02.434386 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:02.434386 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:02.434386 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:02.434386 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:02.434386 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:02.434386 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:02.434386 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:02.434386 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:02.434386 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:02.435632 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:17:02.435632 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:17:02.435632 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:02.435632 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:02.435632 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 307/601] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:17:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:02.440170 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc6000b-96ae-48b1-985e-060bec1f6870 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:02.485927 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9829a877-9bae-481d-92b6-e053171ea498 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:02.525194 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb5d2e-9d22-415d-8ca1-e928baaf98c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:02.526308 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb5d2e-9d22-415d-8ca1-e928baaf98c8 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:02.526807 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb5d2e-9d22-415d-8ca1-e928baaf98c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:02.527302 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb5d2e-9d22-415d-8ca1-e928baaf98c8 None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:02.528347 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbb5d2e-9d22-415d-8ca1-e928baaf98c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:02.528846 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbb5d2e-9d22-415d-8ca1-e928baaf98c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:02.530512 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbb5d2e-9d22-415d-8ca1-e928baaf98c8 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:02.554276 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 295/602] 10.222.0.60 () {56 vars in 1148 bytes} [Sat Jul 2 03:17:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:02.554276 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3fa81a-fcba-45c1-90d1-d7863bb904b0 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:02.554276 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3fa81a-fcba-45c1-90d1-d7863bb904b0 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:02.554276 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3fa81a-fcba-45c1-90d1-d7863bb904b0 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:02.554276 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 296/603] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:17:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:17:02.556079 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3fa81a-fcba-45c1-90d1-d7863bb904b0 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:02.579420 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc6000b-96ae-48b1-985e-060bec1f6870 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:02.593560 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:02.630698 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf25028-51ad-47f7-8f79-4b79edbf4fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:02.631800 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf25028-51ad-47f7-8f79-4b79edbf4fdc None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:02.632343 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf25028-51ad-47f7-8f79-4b79edbf4fdc None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:02.632624 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf25028-51ad-47f7-8f79-4b79edbf4fdc None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:02.633725 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:02.634364 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf25028-51ad-47f7-8f79-4b79edbf4fdc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:02.634527 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf25028-51ad-47f7-8f79-4b79edbf4fdc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:02.636625 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf25028-51ad-47f7-8f79-4b79edbf4fdc None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:02.653702 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 308/604] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:17:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:17:02.655014 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0e35e-e40e-48e5-bd09-17719d73a449 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:02.655343 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0e35e-e40e-48e5-bd09-17719d73a449 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:02.655621 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0e35e-e40e-48e5-bd09-17719d73a449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:02.677147 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-09f0e35e-e40e-48e5-bd09-17719d73a449 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:17:02.678973 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-09f0e35e-e40e-48e5-bd09-17719d73a449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:17:02.682132 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3fa81a-fcba-45c1-90d1-d7863bb904b0 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:02.718105 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b9438c-3f90-4d0b-8ed5-d62778dc6c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:02.719151 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9438c-3f90-4d0b-8ed5-d62778dc6c55 None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:02.719595 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9438c-3f90-4d0b-8ed5-d62778dc6c55 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:02.719965 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9438c-3f90-4d0b-8ed5-d62778dc6c55 None admin] PATH_INFO: `/v3/projects/e09dc5d9d4904c2b89b0cabed237d55e/users/c7c2bef2013546cd882013cdcb4cd929/roles/3c71d0e875cd4a00849f14227be8f7ed` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:02.739182 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b9438c-3f90-4d0b-8ed5-d62778dc6c55 None admin] RBAC: Authorizing `identity:create_grant(project_id=e09dc5d9d4904c2b89b0cabed237d55e, user_id=c7c2bef2013546cd882013cdcb4cd929, role_id=3c71d0e875cd4a00849f14227be8f7ed)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:02.740772 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b9438c-3f90-4d0b-8ed5-d62778dc6c55 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:02.760670 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 297/605] 10.222.0.60 () {58 vars in 1439 bytes} [Sat Jul 2 03:17:02 2022] PUT /identity/v3/projects/e09dc5d9d4904c2b89b0cabed237d55e/users/c7c2bef2013546cd882013cdcb4cd929/roles/3c71d0e875cd4a00849f14227be8f7ed => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:17:02.761848 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b9438c-3f90-4d0b-8ed5-d62778dc6c55 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:02.762831 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 309/606] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:17:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 03:17:02.788793 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f0e35e-e40e-48e5-bd09-17719d73a449 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:02.915629 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:02.919406 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f0e35e-e40e-48e5-bd09-17719d73a449 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:02.963938 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f747c6-2373-4604-bfb6-abdb406d6148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:02.964695 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b9438c-3f90-4d0b-8ed5-d62778dc6c55 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:02.965524 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f747c6-2373-4604-bfb6-abdb406d6148 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:02.966006 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f747c6-2373-4604-bfb6-abdb406d6148 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:02.966593 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f747c6-2373-4604-bfb6-abdb406d6148 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:02.980088 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:02.980567 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f747c6-2373-4604-bfb6-abdb406d6148 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:17:02.992380 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-e1f747c6-2373-4604-bfb6-abdb406d6148 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 02 03:17:02.992380 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:02.992380 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:02.992380 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:02.992380 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:02.992380 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:02.992380 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:02.992380 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:02.992380 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:02.992380 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:02.992380 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:02.992380 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:02.992380 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:17:02.992380 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:17:02.992380 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:17:02.992380 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:17:02.993349 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:17:02.993349 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:17:02.993349 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:17:02.993349 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:17:02.993349 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:02.993349 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:02.993349 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:02.993349 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:02.993349 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:02.993349 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:02.993349 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:02.993349 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:02.993349 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:02.993349 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:02.993349 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:02.993349 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:02.994176 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:02.994176 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:02.994176 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:02.994176 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:02.994176 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:17:02.994176 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:17:02.994176 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:17:02.994176 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:17:02.994176 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:17:02.994176 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:17:02.994176 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 02 03:17:02.994176 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:02.995728 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 310/607] 10.222.0.60 () {56 vars in 1102 bytes} [Sat Jul 2 03:17:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 03:17:03.003423 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f747c6-2373-4604-bfb6-abdb406d6148 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:03.028327 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d882fa-87c2-4017-a274-a5918ff1fef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:03.029175 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d882fa-87c2-4017-a274-a5918ff1fef7 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:03.029451 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d882fa-87c2-4017-a274-a5918ff1fef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:03.029719 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d882fa-87c2-4017-a274-a5918ff1fef7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:03.041182 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d882fa-87c2-4017-a274-a5918ff1fef7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:03.042893 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d882fa-87c2-4017-a274-a5918ff1fef7 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:03.066593 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-22d882fa-87c2-4017-a274-a5918ff1fef7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 03:17:03.066593 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:03.066593 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:03.066593 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:03.066593 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:03.066593 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:03.066593 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:03.066593 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:03.066593 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:03.066593 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:03.066593 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:03.066593 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:03.066593 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 03:17:03.066593 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 03:17:03.066593 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 03:17:03.067539 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 03:17:03.067539 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:03.067539 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:03.067539 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:03.067539 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:03.067539 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:03.067539 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:03.067539 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:03.067539 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:03.067539 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:03.067539 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:03.067539 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:03.067539 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:03.067539 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:03.067539 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:03.067539 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:03.067539 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:03.068413 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 03:17:03.068413 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 03:17:03.068413 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 03:17:03.068413 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 03:17:03.068413 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 03:17:03.068413 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 03:17:03.068413 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 03:17:03.068413 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:03.068413 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 298/608] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Jul 2 03:17:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:03.076921 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d882fa-87c2-4017-a274-a5918ff1fef7 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:03.176261 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f747c6-2373-4604-bfb6-abdb406d6148 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:03.218913 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab27d91-0b6e-4906-88ad-6f04d76226b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:03.219808 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab27d91-0b6e-4906-88ad-6f04d76226b3 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:03.220087 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab27d91-0b6e-4906-88ad-6f04d76226b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:03.220351 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab27d91-0b6e-4906-88ad-6f04d76226b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:03.221104 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab27d91-0b6e-4906-88ad-6f04d76226b3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:03.221404 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab27d91-0b6e-4906-88ad-6f04d76226b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:03.222774 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab27d91-0b6e-4906-88ad-6f04d76226b3 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:03.244430 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 311/609] 10.222.0.60 () {56 vars in 1103 bytes} [Sat Jul 2 03:17:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:03.250824 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab27d91-0b6e-4906-88ad-6f04d76226b3 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:03.292576 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:03.293250 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d882fa-87c2-4017-a274-a5918ff1fef7 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:03.357205 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88db64eb-1078-4adc-8e24-6370bc1534bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:03.358540 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db64eb-1078-4adc-8e24-6370bc1534bf None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:03.359069 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db64eb-1078-4adc-8e24-6370bc1534bf None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:03.359382 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db64eb-1078-4adc-8e24-6370bc1534bf None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:03.360179 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88db64eb-1078-4adc-8e24-6370bc1534bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:03.360485 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88db64eb-1078-4adc-8e24-6370bc1534bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:03.361935 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88db64eb-1078-4adc-8e24-6370bc1534bf None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:03.393531 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 299/610] 10.222.0.60 () {56 vars in 1148 bytes} [Sat Jul 2 03:17:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:03.400120 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88db64eb-1078-4adc-8e24-6370bc1534bf None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:03.435513 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:03.451716 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab27d91-0b6e-4906-88ad-6f04d76226b3 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:03.514670 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fafb9a-170b-4f53-b24f-9a434fca6384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:03.515817 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fafb9a-170b-4f53-b24f-9a434fca6384 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:03.516279 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fafb9a-170b-4f53-b24f-9a434fca6384 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:03.516723 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fafb9a-170b-4f53-b24f-9a434fca6384 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:03.528781 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fafb9a-170b-4f53-b24f-9a434fca6384 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:03.530678 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fafb9a-170b-4f53-b24f-9a434fca6384 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:03.549950 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-63fafb9a-170b-4f53-b24f-9a434fca6384 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:03.549950 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:03.549950 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:03.549950 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:03.549950 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:03.549950 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:03.549950 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:03.549950 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:03.549950 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:03.549950 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:03.549950 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:03.549950 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:03.549950 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:17:03.549950 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:17:03.549950 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:17:03.550903 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:17:03.550903 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:03.550903 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:03.550903 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:03.550903 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:03.550903 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:03.550903 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:03.550903 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:03.550903 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:03.550903 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:03.550903 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:03.550903 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:03.550903 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:03.550903 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:03.550903 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:03.550903 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:03.550903 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:03.551840 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:17:03.551840 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:17:03.551840 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:03.551840 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:03.553961 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 312/611] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:17:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:03.560905 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fafb9a-170b-4f53-b24f-9a434fca6384 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:03.563570 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88db64eb-1078-4adc-8e24-6370bc1534bf None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:03.645089 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c3d33-87ae-48c7-a140-44b3712b20f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:03.646050 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c3d33-87ae-48c7-a140-44b3712b20f5 None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:03.646306 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c3d33-87ae-48c7-a140-44b3712b20f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:03.646586 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c3d33-87ae-48c7-a140-44b3712b20f5 None admin] PATH_INFO: `/v3/projects/e09dc5d9d4904c2b89b0cabed237d55e/users/b0e8a3ba6f84477bb9b4780918f357c0/roles/3c71d0e875cd4a00849f14227be8f7ed` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:03.663965 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356c3d33-87ae-48c7-a140-44b3712b20f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=e09dc5d9d4904c2b89b0cabed237d55e, user_id=b0e8a3ba6f84477bb9b4780918f357c0, role_id=3c71d0e875cd4a00849f14227be8f7ed)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:03.665807 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356c3d33-87ae-48c7-a140-44b3712b20f5 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:03.679022 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:03.695146 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 300/612] 10.222.0.60 () {58 vars in 1439 bytes} [Sat Jul 2 03:17:03 2022] PUT /identity/v3/projects/e09dc5d9d4904c2b89b0cabed237d55e/users/b0e8a3ba6f84477bb9b4780918f357c0/roles/3c71d0e875cd4a00849f14227be8f7ed => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:17:03.695146 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bbbcfd-a6e1-4c6b-85cf-b64f0bec5629 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:03.695146 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bbbcfd-a6e1-4c6b-85cf-b64f0bec5629 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:03.695146 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bbbcfd-a6e1-4c6b-85cf-b64f0bec5629 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:03.695146 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 301/613] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:17:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:17:03.699555 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef7e73-d715-4116-a45e-c82da26ce5b6 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:03.700088 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef7e73-d715-4116-a45e-c82da26ce5b6 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:03.700088 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef7e73-d715-4116-a45e-c82da26ce5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:03.735599 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-b5ef7e73-d715-4116-a45e-c82da26ce5b6 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:17:03.736816 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b5ef7e73-d715-4116-a45e-c82da26ce5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:17:03.740927 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fafb9a-170b-4f53-b24f-9a434fca6384 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:03.816113 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62befeba-171c-4629-8dd8-7dd732801e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:03.816760 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62befeba-171c-4629-8dd8-7dd732801e68 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:03.817039 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62befeba-171c-4629-8dd8-7dd732801e68 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:03.817313 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62befeba-171c-4629-8dd8-7dd732801e68 None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:03.818061 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62befeba-171c-4629-8dd8-7dd732801e68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:03.818369 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62befeba-171c-4629-8dd8-7dd732801e68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:03.819798 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62befeba-171c-4629-8dd8-7dd732801e68 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:03.840338 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 313/614] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:17:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:03.847330 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62befeba-171c-4629-8dd8-7dd732801e68 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:03.866888 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 302/615] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:17:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 02 03:17:03.900569 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef7e73-d715-4116-a45e-c82da26ce5b6 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:03.921577 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:03.966872 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62befeba-171c-4629-8dd8-7dd732801e68 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:04.012137 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a90618-6bc2-42c5-8d6d-f0d3e48d9416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:04.012939 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a90618-6bc2-42c5-8d6d-f0d3e48d9416 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:04.013214 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a90618-6bc2-42c5-8d6d-f0d3e48d9416 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:04.013483 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a90618-6bc2-42c5-8d6d-f0d3e48d9416 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:04.017430 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:04.036022 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a90618-6bc2-42c5-8d6d-f0d3e48d9416 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:04.037491 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a90618-6bc2-42c5-8d6d-f0d3e48d9416 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:04.049088 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef7e73-d715-4116-a45e-c82da26ce5b6 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:04.070267 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-23a90618-6bc2-42c5-8d6d-f0d3e48d9416 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 02 03:17:04.070267 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:04.070267 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:04.070267 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:04.070267 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:04.070267 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:04.070267 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:04.070267 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:04.070267 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:04.070267 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:04.070267 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:04.070267 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:04.070267 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 03:17:04.070267 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 03:17:04.070267 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 03:17:04.070267 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 03:17:04.071289 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:04.071289 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:04.071289 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 03:17:04.071289 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 03:17:04.071289 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 03:17:04.071289 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 03:17:04.071289 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:04.071289 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:04.071289 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:04.071289 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:04.071289 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:04.071289 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:04.071289 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:04.071289 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:04.071289 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:04.071289 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:04.071289 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:04.071289 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:04.072249 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:04.072249 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:04.072249 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 03:17:04.072249 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 03:17:04.072249 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 03:17:04.072249 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 03:17:04.072249 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 03:17:04.072249 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 03:17:04.072249 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 02 03:17:04.072249 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:04.072249 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 314/616] 10.222.0.60 () {56 vars in 1096 bytes} [Sat Jul 2 03:17:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:04.080396 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a90618-6bc2-42c5-8d6d-f0d3e48d9416 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:04.089109 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f703074-a7fe-4445-b98f-f2ac7e8e576d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:04.089917 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f703074-a7fe-4445-b98f-f2ac7e8e576d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:04.090193 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f703074-a7fe-4445-b98f-f2ac7e8e576d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:04.090458 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f703074-a7fe-4445-b98f-f2ac7e8e576d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:04.108909 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f703074-a7fe-4445-b98f-f2ac7e8e576d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:17:04.119086 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-4f703074-a7fe-4445-b98f-f2ac7e8e576d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 02 03:17:04.119086 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:04.119086 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:04.119086 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:04.119086 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:04.119086 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:04.119086 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:04.119086 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:04.119086 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:04.119086 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:04.119086 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:04.119086 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:04.119086 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:17:04.119086 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:17:04.119086 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:17:04.119086 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:17:04.120044 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:17:04.120044 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:17:04.120044 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:17:04.120044 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:17:04.120044 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:04.120044 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:04.120044 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:04.120044 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:04.120044 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:04.120044 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:04.120044 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:04.120044 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:04.120044 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:04.120044 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:04.120044 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:04.120044 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:04.120896 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:04.120896 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:04.120896 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:04.120896 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:04.120896 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:17:04.120896 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:17:04.120896 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:17:04.120896 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:17:04.120896 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:17:04.120896 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:17:04.120896 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 02 03:17:04.120896 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:04.120896 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 303/617] 10.222.0.60 () {56 vars in 1102 bytes} [Sat Jul 2 03:17:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 03:17:04.129262 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f703074-a7fe-4445-b98f-f2ac7e8e576d None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:04.221301 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:04.252514 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f703074-a7fe-4445-b98f-f2ac7e8e576d None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:04.294434 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123af04c-44b3-4126-9a60-d842d89f4ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:04.295101 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123af04c-44b3-4126-9a60-d842d89f4ec2 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:04.295416 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123af04c-44b3-4126-9a60-d842d89f4ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:04.295691 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123af04c-44b3-4126-9a60-d842d89f4ec2 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:04.296430 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123af04c-44b3-4126-9a60-d842d89f4ec2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:04.296729 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123af04c-44b3-4126-9a60-d842d89f4ec2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:04.298114 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123af04c-44b3-4126-9a60-d842d89f4ec2 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:04.306981 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 304/618] 10.222.0.60 () {56 vars in 1103 bytes} [Sat Jul 2 03:17:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:04.312483 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123af04c-44b3-4126-9a60-d842d89f4ec2 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:04.327157 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a90618-6bc2-42c5-8d6d-f0d3e48d9416 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:04.417602 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01177293-1e78-4247-9b69-9c0317b54f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:04.419887 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01177293-1e78-4247-9b69-9c0317b54f6a None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:04.420575 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01177293-1e78-4247-9b69-9c0317b54f6a None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:04.421719 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01177293-1e78-4247-9b69-9c0317b54f6a None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:04.422986 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01177293-1e78-4247-9b69-9c0317b54f6a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:04.424414 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01177293-1e78-4247-9b69-9c0317b54f6a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:04.427316 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01177293-1e78-4247-9b69-9c0317b54f6a None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:04.459736 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123af04c-44b3-4126-9a60-d842d89f4ec2 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:04.464865 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 315/619] 10.222.0.60 () {56 vars in 1135 bytes} [Sat Jul 2 03:17:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:04.470746 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01177293-1e78-4247-9b69-9c0317b54f6a None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:04.527323 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba4eba-6394-4930-991f-6652bae03b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:04.528767 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba4eba-6394-4930-991f-6652bae03b1b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:04.530803 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba4eba-6394-4930-991f-6652bae03b1b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:04.531308 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba4eba-6394-4930-991f-6652bae03b1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:04.535807 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:04.550567 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ba4eba-6394-4930-991f-6652bae03b1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:04.552451 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ba4eba-6394-4930-991f-6652bae03b1b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:04.572619 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:04.573576 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-d1ba4eba-6394-4930-991f-6652bae03b1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:04.573576 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:04.573576 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:04.573576 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:04.573576 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:04.573576 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:04.573576 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:04.573576 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:04.573576 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:04.573576 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:04.573576 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:04.573576 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:04.573576 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:17:04.573576 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:17:04.573576 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:17:04.574932 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:17:04.574932 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:04.574932 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:04.574932 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:04.574932 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:04.574932 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:04.574932 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:04.574932 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:04.574932 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:04.574932 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:04.574932 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:04.574932 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:04.574932 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:04.574932 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:04.574932 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:04.574932 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:04.574932 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:04.582211 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:17:04.582211 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:17:04.582211 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:04.582211 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:04.582211 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 305/620] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:17:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:04.583729 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba4eba-6394-4930-991f-6652bae03b1b None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:04.659432 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01177293-1e78-4247-9b69-9c0317b54f6a None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:04.704729 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8bb2f8-012c-412e-8e78-8c68ce57b1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:04.706490 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8bb2f8-012c-412e-8e78-8c68ce57b1cc None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:04.707002 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8bb2f8-012c-412e-8e78-8c68ce57b1cc None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:04.707521 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8bb2f8-012c-412e-8e78-8c68ce57b1cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:04.721771 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8bb2f8-012c-412e-8e78-8c68ce57b1cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:04.724198 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8bb2f8-012c-412e-8e78-8c68ce57b1cc None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:04.725212 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba4eba-6394-4930-991f-6652bae03b1b None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:04.747541 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-de8bb2f8-012c-412e-8e78-8c68ce57b1cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:04.747541 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:04.747541 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:04.747541 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:04.747541 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:04.747541 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:04.747541 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:04.747541 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:04.747541 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:04.747541 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:04.747541 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:04.747541 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:04.747541 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:17:04.747541 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:17:04.747541 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:17:04.748484 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:17:04.748484 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:04.748484 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:04.748484 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:04.748484 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:04.748484 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:04.748484 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:04.748484 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:04.748484 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:04.748484 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:04.748484 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:04.748484 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:04.748484 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:04.748484 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:04.748484 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:04.748484 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:04.748484 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:04.749372 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:17:04.749372 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:17:04.749372 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:04.749372 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:04.752542 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 316/621] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:17:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:04.754599 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173edcb5-2205-4cc5-90ed-780500db09d6 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:04.755161 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173edcb5-2205-4cc5-90ed-780500db09d6 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:04.756026 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173edcb5-2205-4cc5-90ed-780500db09d6 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:04.758230 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 317/622] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:17:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:17:04.759476 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173edcb5-2205-4cc5-90ed-780500db09d6 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:04.768090 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a96b88-8d09-4c67-8489-767b38c9df3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:04.768787 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a96b88-8d09-4c67-8489-767b38c9df3d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:04.769065 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a96b88-8d09-4c67-8489-767b38c9df3d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:04.769331 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a96b88-8d09-4c67-8489-767b38c9df3d None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:04.770056 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a96b88-8d09-4c67-8489-767b38c9df3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:04.770361 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a96b88-8d09-4c67-8489-767b38c9df3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:04.772320 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a96b88-8d09-4c67-8489-767b38c9df3d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:04.792397 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 306/623] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:17:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:04.792397 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82198fdb-4b2a-466b-ba9b-abc77ce95c0a None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:04.792397 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82198fdb-4b2a-466b-ba9b-abc77ce95c0a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:04.792397 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82198fdb-4b2a-466b-ba9b-abc77ce95c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:04.811252 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-82198fdb-4b2a-466b-ba9b-abc77ce95c0a None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:17:04.812436 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-82198fdb-4b2a-466b-ba9b-abc77ce95c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:17:04.866723 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:04.885750 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173edcb5-2205-4cc5-90ed-780500db09d6 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:04.888730 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:04.903241 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 307/624] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:17:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 03:17:04.904313 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82198fdb-4b2a-466b-ba9b-abc77ce95c0a None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:04.931363 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615e05a5-0450-456d-86a9-e16c774ea63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:04.932045 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e05a5-0450-456d-86a9-e16c774ea63f None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:04.932330 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e05a5-0450-456d-86a9-e16c774ea63f None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:04.932592 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e05a5-0450-456d-86a9-e16c774ea63f None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:04.933384 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615e05a5-0450-456d-86a9-e16c774ea63f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:04.933689 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615e05a5-0450-456d-86a9-e16c774ea63f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:04.935093 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615e05a5-0450-456d-86a9-e16c774ea63f None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:04.951353 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 318/625] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:17:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:04.952746 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615e05a5-0450-456d-86a9-e16c774ea63f None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:05.039105 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82198fdb-4b2a-466b-ba9b-abc77ce95c0a None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:05.076354 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86660f8-8b03-4036-9101-264f1700878a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:05.076565 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615e05a5-0450-456d-86a9-e16c774ea63f None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:05.077646 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86660f8-8b03-4036-9101-264f1700878a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:05.078167 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86660f8-8b03-4036-9101-264f1700878a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:05.080773 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86660f8-8b03-4036-9101-264f1700878a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:05.086913 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86660f8-8b03-4036-9101-264f1700878a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:05.088762 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86660f8-8b03-4036-9101-264f1700878a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:05.105158 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-a86660f8-8b03-4036-9101-264f1700878a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 02 03:17:05.105158 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:05.105158 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:05.105158 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:05.105158 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:05.105158 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:05.105158 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:05.105158 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:05.105158 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:05.105158 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:05.105158 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:05.105158 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:05.105158 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 03:17:05.105158 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 03:17:05.105158 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 03:17:05.105158 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 03:17:05.106131 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:05.106131 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:05.106131 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 03:17:05.106131 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 03:17:05.106131 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 03:17:05.106131 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 03:17:05.106131 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:05.106131 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:05.106131 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:05.106131 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:05.106131 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:05.106131 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:05.106131 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:05.106131 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:05.106131 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:05.106131 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:05.106131 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:05.106131 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:05.107087 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:05.107087 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:05.107087 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 03:17:05.107087 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 03:17:05.107087 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 03:17:05.107087 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 03:17:05.107087 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 03:17:05.107087 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 03:17:05.107087 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 02 03:17:05.107087 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:05.109902 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 308/626] 10.222.0.60 () {56 vars in 1093 bytes} [Sat Jul 2 03:17:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:05.110987 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86660f8-8b03-4036-9101-264f1700878a None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:05.113190 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f2d05-68d5-478c-a101-30168da4b713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:05.114312 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f2d05-68d5-478c-a101-30168da4b713 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:05.114638 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f2d05-68d5-478c-a101-30168da4b713 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:05.114973 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f2d05-68d5-478c-a101-30168da4b713 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:05.129288 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182f2d05-68d5-478c-a101-30168da4b713 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:17:05.139365 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-182f2d05-68d5-478c-a101-30168da4b713 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 02 03:17:05.139365 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:05.139365 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:05.139365 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:05.139365 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:05.139365 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:05.139365 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:05.139365 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:05.139365 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:05.139365 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:05.139365 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:05.139365 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:05.139365 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:17:05.139365 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:17:05.139365 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:17:05.139365 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:17:05.140516 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:17:05.140516 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:17:05.140516 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:17:05.140516 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:17:05.140516 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:05.140516 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:05.140516 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:05.140516 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:05.140516 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:05.140516 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:05.140516 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:05.140516 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:05.140516 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:05.140516 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:05.140516 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:05.140516 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:05.141519 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:05.141519 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:05.141519 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:05.141519 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:05.141519 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:17:05.141519 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:17:05.141519 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:17:05.141519 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:17:05.141519 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:17:05.141519 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:17:05.141519 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 02 03:17:05.141519 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:05.147056 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 319/627] 10.222.0.60 () {56 vars in 1102 bytes} [Sat Jul 2 03:17:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:05.147056 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f2d05-68d5-478c-a101-30168da4b713 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:05.161096 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:05.176679 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:05.243459 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86660f8-8b03-4036-9101-264f1700878a None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:05.264002 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f2d05-68d5-478c-a101-30168da4b713 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:05.292899 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54144ea5-66a8-45c2-a4ad-2160fe9f12b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:05.293883 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54144ea5-66a8-45c2-a4ad-2160fe9f12b2 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:05.294230 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54144ea5-66a8-45c2-a4ad-2160fe9f12b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:05.294571 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54144ea5-66a8-45c2-a4ad-2160fe9f12b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:05.301907 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54144ea5-66a8-45c2-a4ad-2160fe9f12b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:05.303452 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54144ea5-66a8-45c2-a4ad-2160fe9f12b2 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:05.309356 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f98420-9cf4-481b-b2f9-037917e7a99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:05.310032 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f98420-9cf4-481b-b2f9-037917e7a99f None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:05.310311 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f98420-9cf4-481b-b2f9-037917e7a99f None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:05.310584 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f98420-9cf4-481b-b2f9-037917e7a99f None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:05.311466 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f98420-9cf4-481b-b2f9-037917e7a99f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:05.311774 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f98420-9cf4-481b-b2f9-037917e7a99f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:05.313200 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f98420-9cf4-481b-b2f9-037917e7a99f None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:05.318033 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-54144ea5-66a8-45c2-a4ad-2160fe9f12b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 03:17:05.318033 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:05.318033 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:05.318033 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:05.318033 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:05.318033 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:05.318033 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:05.318033 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:05.318033 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:05.318033 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:05.318033 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:05.318033 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:05.318033 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 03:17:05.318033 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 03:17:05.318033 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 03:17:05.318911 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 03:17:05.318911 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:05.318911 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:05.318911 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:05.318911 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:05.318911 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:05.318911 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:05.318911 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:05.318911 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:05.318911 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:05.318911 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:05.318911 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:05.318911 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:05.318911 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:05.318911 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:05.318911 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:05.318911 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:05.320177 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 03:17:05.320177 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 03:17:05.320177 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 03:17:05.320177 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 03:17:05.320177 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 03:17:05.320177 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 03:17:05.320177 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 03:17:05.320177 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:05.320177 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 309/628] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Jul 2 03:17:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:05.320818 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54144ea5-66a8-45c2-a4ad-2160fe9f12b2 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:05.339310 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 320/629] 10.222.0.60 () {56 vars in 1133 bytes} [Sat Jul 2 03:17:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:05.339310 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eedcba-abbb-435f-bc6a-6d32105fb1c0 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:05.339310 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eedcba-abbb-435f-bc6a-6d32105fb1c0 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:05.339310 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eedcba-abbb-435f-bc6a-6d32105fb1c0 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:05.343853 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 321/630] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:17:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:17:05.344553 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eedcba-abbb-435f-bc6a-6d32105fb1c0 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:05.429347 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:05.434128 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:05.437220 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54144ea5-66a8-45c2-a4ad-2160fe9f12b2 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:05.453862 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eedcba-abbb-435f-bc6a-6d32105fb1c0 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:05.472157 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc29d4e-6bf6-4f2a-81bb-0cf49c322a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:05.472757 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc29d4e-6bf6-4f2a-81bb-0cf49c322a5e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:05.473036 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc29d4e-6bf6-4f2a-81bb-0cf49c322a5e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:05.473308 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc29d4e-6bf6-4f2a-81bb-0cf49c322a5e None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:05.474055 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc29d4e-6bf6-4f2a-81bb-0cf49c322a5e None admin] RBAC: Adding query filter params (name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:05.474357 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc29d4e-6bf6-4f2a-81bb-0cf49c322a5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:05.475764 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc29d4e-6bf6-4f2a-81bb-0cf49c322a5e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:05.484157 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 310/631] 10.222.0.60 () {56 vars in 1103 bytes} [Sat Jul 2 03:17:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:05.484787 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc29d4e-6bf6-4f2a-81bb-0cf49c322a5e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:05.493753 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe6d43e-3d0c-457a-a368-0afbe064f267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:05.494426 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe6d43e-3d0c-457a-a368-0afbe064f267 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:05.494700 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe6d43e-3d0c-457a-a368-0afbe064f267 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:05.494973 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe6d43e-3d0c-457a-a368-0afbe064f267 None admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:05.495861 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe6d43e-3d0c-457a-a368-0afbe064f267 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:05.496166 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe6d43e-3d0c-457a-a368-0afbe064f267 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:05.497588 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe6d43e-3d0c-457a-a368-0afbe064f267 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:05.510256 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 322/632] 10.222.0.60 () {56 vars in 1148 bytes} [Sat Jul 2 03:17:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:05.516207 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e9ce1-e2f1-473c-9206-819432b6eb46 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:05.516494 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e9ce1-e2f1-473c-9206-819432b6eb46 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:05.516768 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e9ce1-e2f1-473c-9206-819432b6eb46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:05.533028 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-cf5e9ce1-e2f1-473c-9206-819432b6eb46 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:17:05.534206 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-cf5e9ce1-e2f1-473c-9206-819432b6eb46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:17:05.588617 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc29d4e-6bf6-4f2a-81bb-0cf49c322a5e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:05.615158 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 323/633] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:17:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 03:17:05.615158 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e9ce1-e2f1-473c-9206-819432b6eb46 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:05.632585 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e011cba5-b0dc-4475-b267-73804cba7a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:05.633243 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011cba5-b0dc-4475-b267-73804cba7a8a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:05.633524 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011cba5-b0dc-4475-b267-73804cba7a8a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:05.633799 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011cba5-b0dc-4475-b267-73804cba7a8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:05.666634 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:05.688600 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:05.711789 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e011cba5-b0dc-4475-b267-73804cba7a8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:05.713359 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e011cba5-b0dc-4475-b267-73804cba7a8a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:05.720222 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e9ce1-e2f1-473c-9206-819432b6eb46 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:05.754196 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0980d49-0271-49d2-a3c1-211fdf86aa67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:05.755213 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0980d49-0271-49d2-a3c1-211fdf86aa67 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:05.755497 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0980d49-0271-49d2-a3c1-211fdf86aa67 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:05.755780 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0980d49-0271-49d2-a3c1-211fdf86aa67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:05.765981 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0980d49-0271-49d2-a3c1-211fdf86aa67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:05.767457 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0980d49-0271-49d2-a3c1-211fdf86aa67 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:05.786629 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-e0980d49-0271-49d2-a3c1-211fdf86aa67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:05.786629 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:05.786629 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:05.786629 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:05.786629 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:05.786629 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:05.786629 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:05.786629 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:05.786629 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:05.786629 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:05.786629 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:05.786629 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:05.786629 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:17:05.786629 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:17:05.786629 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:17:05.787816 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:17:05.787816 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:05.787816 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:05.787816 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:05.787816 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:05.787816 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:05.787816 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:05.787816 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:05.787816 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:05.787816 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:05.787816 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:05.787816 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:05.787816 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:05.787816 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:05.787816 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:05.787816 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:05.787816 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:05.788721 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:17:05.788721 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:17:05.788721 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:05.788721 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:05.791468 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 324/634] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:17:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:05.792645 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0980d49-0271-49d2-a3c1-211fdf86aa67 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:05.816755 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 311/635] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Jul 2 03:17:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 03:17:05.817854 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e011cba5-b0dc-4475-b267-73804cba7a8a None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:05.874095 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:05.904610 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0980d49-0271-49d2-a3c1-211fdf86aa67 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:05.914472 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e011cba5-b0dc-4475-b267-73804cba7a8a None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:05.928233 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:05.940034 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7029de-3f71-48f8-ae71-414600e37210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:05.940861 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7029de-3f71-48f8-ae71-414600e37210 None admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:05.941141 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7029de-3f71-48f8-ae71-414600e37210 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:05.941411 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7029de-3f71-48f8-ae71-414600e37210 None admin] PATH_INFO: `/v3/projects/e09dc5d9d4904c2b89b0cabed237d55e/users/692ec343bf9f4339ba691440f55a6c37/roles/3c71d0e875cd4a00849f14227be8f7ed` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:05.947941 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5a6a12-4016-49d1-82ad-544b54fe9d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:05.948759 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a6a12-4016-49d1-82ad-544b54fe9d59 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:05.949040 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a6a12-4016-49d1-82ad-544b54fe9d59 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:05.949314 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a6a12-4016-49d1-82ad-544b54fe9d59 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:05.955654 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7029de-3f71-48f8-ae71-414600e37210 None admin] RBAC: Authorizing `identity:create_grant(project_id=e09dc5d9d4904c2b89b0cabed237d55e, user_id=692ec343bf9f4339ba691440f55a6c37, role_id=3c71d0e875cd4a00849f14227be8f7ed)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:05.957123 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7029de-3f71-48f8-ae71-414600e37210 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:05.959278 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5a6a12-4016-49d1-82ad-544b54fe9d59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:17:05.967623 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-ae5a6a12-4016-49d1-82ad-544b54fe9d59 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 02 03:17:05.967623 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:05.967623 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:05.967623 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:05.967623 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:05.967623 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:05.967623 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:05.967623 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:05.967623 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:05.967623 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:05.967623 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:05.967623 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:05.967623 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:17:05.967623 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:17:05.967623 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:17:05.967623 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:17:05.968626 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:17:05.968626 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:17:05.968626 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:17:05.968626 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:17:05.968626 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:05.968626 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:05.968626 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:05.968626 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:05.968626 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:05.968626 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:05.968626 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:05.968626 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:05.968626 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:05.968626 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:05.968626 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:05.968626 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:05.969463 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:05.969463 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:05.969463 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:05.969463 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:05.969463 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:17:05.969463 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:17:05.969463 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:17:05.969463 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:17:05.969463 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:17:05.969463 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:17:05.969463 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 02 03:17:05.969463 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:05.969463 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 312/636] 10.222.0.60 () {56 vars in 1102 bytes} [Sat Jul 2 03:17:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:05.976345 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5a6a12-4016-49d1-82ad-544b54fe9d59 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:05.976451 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 325/637] 10.222.0.60 () {58 vars in 1439 bytes} [Sat Jul 2 03:17:05 2022] PUT /identity/v3/projects/e09dc5d9d4904c2b89b0cabed237d55e/users/692ec343bf9f4339ba691440f55a6c37/roles/3c71d0e875cd4a00849f14227be8f7ed => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:17:05.976451 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7029de-3f71-48f8-ae71-414600e37210 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:06.091036 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7029de-3f71-48f8-ae71-414600e37210 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:06.097311 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5a6a12-4016-49d1-82ad-544b54fe9d59 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:06.117220 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:06.136194 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ee6b72-2292-4a55-9fc8-e7d650b41878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:06.137007 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee6b72-2292-4a55-9fc8-e7d650b41878 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:06.137292 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee6b72-2292-4a55-9fc8-e7d650b41878 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:06.137563 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee6b72-2292-4a55-9fc8-e7d650b41878 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:06.142509 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ed8c6-6801-460c-a9f7-989033cca20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:06.143210 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ed8c6-6801-460c-a9f7-989033cca20a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:06.143491 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ed8c6-6801-460c-a9f7-989033cca20a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:06.143761 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ed8c6-6801-460c-a9f7-989033cca20a None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:06.144494 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0ed8c6-6801-460c-a9f7-989033cca20a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:06.144802 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0ed8c6-6801-460c-a9f7-989033cca20a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:06.146184 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0ed8c6-6801-460c-a9f7-989033cca20a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:06.148858 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ee6b72-2292-4a55-9fc8-e7d650b41878 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:06.150303 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ee6b72-2292-4a55-9fc8-e7d650b41878 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:06.160198 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 313/638] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:17:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:06.161423 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59509c3-94cc-4f5e-9de6-f63dff27f834 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:06.161715 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59509c3-94cc-4f5e-9de6-f63dff27f834 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:06.161987 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59509c3-94cc-4f5e-9de6-f63dff27f834 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:06.163513 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 314/639] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:17:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:17:06.164204 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59509c3-94cc-4f5e-9de6-f63dff27f834 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:06.173565 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-54ee6b72-2292-4a55-9fc8-e7d650b41878 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:06.173565 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:06.173565 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:06.173565 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:06.173565 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:06.173565 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:06.173565 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:06.173565 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:06.173565 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:06.173565 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:06.173565 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:06.173565 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:06.173565 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:17:06.173565 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:17:06.173565 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:17:06.174452 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:17:06.174452 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:06.174452 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:06.174452 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:06.174452 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:06.174452 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:06.174452 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:06.174452 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:06.174452 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:06.174452 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:06.174452 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:06.174452 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:06.174452 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:06.174452 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:06.174452 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:06.174452 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:06.174452 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:06.175400 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:17:06.175400 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:17:06.175400 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:06.175400 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:06.179284 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 326/640] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:17:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:06.180203 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ee6b72-2292-4a55-9fc8-e7d650b41878 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:06.209128 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:06.277992 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59509c3-94cc-4f5e-9de6-f63dff27f834 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:06.286535 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ee6b72-2292-4a55-9fc8-e7d650b41878 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:06.314609 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17972e86-d579-45b7-8105-d36bb25e5682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:06.315308 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17972e86-d579-45b7-8105-d36bb25e5682 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:06.315589 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17972e86-d579-45b7-8105-d36bb25e5682 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:06.315866 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17972e86-d579-45b7-8105-d36bb25e5682 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:06.316627 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17972e86-d579-45b7-8105-d36bb25e5682 None admin] RBAC: Adding query filter params (name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:06.316934 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17972e86-d579-45b7-8105-d36bb25e5682 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:06.318319 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17972e86-d579-45b7-8105-d36bb25e5682 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:06.322388 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a76a01-cc2c-4201-b428-be70b852037f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:06.323280 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a76a01-cc2c-4201-b428-be70b852037f None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:06.323557 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a76a01-cc2c-4201-b428-be70b852037f None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:06.323831 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a76a01-cc2c-4201-b428-be70b852037f None admin] PATH_INFO: `/v3/users/glance` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:06.327058 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 315/641] 10.222.0.60 () {56 vars in 1103 bytes} [Sat Jul 2 03:17:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:06.328429 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f4f71-8443-4be0-98c4-e3f92e293458 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:06.328718 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f4f71-8443-4be0-98c4-e3f92e293458 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:06.329004 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f4f71-8443-4be0-98c4-e3f92e293458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:06.336150 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a76a01-cc2c-4201-b428-be70b852037f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:06.337599 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a76a01-cc2c-4201-b428-be70b852037f None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:06.346661 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-685f4f71-8443-4be0-98c4-e3f92e293458 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:17:06.347922 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-685f4f71-8443-4be0-98c4-e3f92e293458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:17:06.352376 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-77a76a01-cc2c-4201-b428-be70b852037f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 02 03:17:06.352376 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:06.352376 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:06.352376 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:06.352376 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:06.352376 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:06.352376 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:06.352376 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:06.352376 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:06.352376 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:06.352376 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:06.352376 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:06.352376 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 03:17:06.352376 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 03:17:06.352376 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 03:17:06.352376 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 03:17:06.353374 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:06.353374 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:06.353374 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 03:17:06.353374 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 03:17:06.353374 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 03:17:06.353374 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 03:17:06.353374 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:06.353374 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:06.353374 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:06.353374 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:06.353374 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:06.353374 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:06.353374 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:06.353374 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:06.353374 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:06.353374 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:06.353374 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:06.353374 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:06.354315 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:06.354315 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:06.354315 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 03:17:06.354315 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 03:17:06.354315 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 03:17:06.354315 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 03:17:06.354315 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 03:17:06.354315 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 03:17:06.354315 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 02 03:17:06.354315 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:06.354315 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 327/642] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Jul 2 03:17:06 2022] GET /identity/v3/users/glance => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:06.355088 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a76a01-cc2c-4201-b428-be70b852037f None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:06.388867 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:06.431366 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 316/643] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:17:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 03:17:06.431366 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f4f71-8443-4be0-98c4-e3f92e293458 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:06.458074 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:06.475906 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a76a01-cc2c-4201-b428-be70b852037f None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:06.511576 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba361c4d-bdee-479f-8f2f-0cb414622d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:06.512240 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba361c4d-bdee-479f-8f2f-0cb414622d4f None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:06.512513 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba361c4d-bdee-479f-8f2f-0cb414622d4f None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:06.512762 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba361c4d-bdee-479f-8f2f-0cb414622d4f None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:06.513483 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba361c4d-bdee-479f-8f2f-0cb414622d4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:06.513781 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba361c4d-bdee-479f-8f2f-0cb414622d4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:06.515164 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba361c4d-bdee-479f-8f2f-0cb414622d4f None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:06.526979 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 328/644] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:17:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:06.528060 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba361c4d-bdee-479f-8f2f-0cb414622d4f None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:06.548488 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f4f71-8443-4be0-98c4-e3f92e293458 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:06.584424 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7723ee46-29ec-4c32-91b8-3565c7ad4de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:06.585203 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723ee46-29ec-4c32-91b8-3565c7ad4de8 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:06.585484 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723ee46-29ec-4c32-91b8-3565c7ad4de8 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:06.585759 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723ee46-29ec-4c32-91b8-3565c7ad4de8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:06.596221 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7723ee46-29ec-4c32-91b8-3565c7ad4de8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:06.597692 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7723ee46-29ec-4c32-91b8-3565c7ad4de8 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:06.615542 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-7723ee46-29ec-4c32-91b8-3565c7ad4de8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:06.615542 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:06.615542 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:06.615542 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:06.615542 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:06.615542 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:06.615542 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:06.615542 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:06.615542 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:06.615542 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:06.615542 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:06.615542 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:06.615542 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:17:06.615542 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:17:06.615542 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:17:06.616440 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:17:06.616440 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:06.616440 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:06.616440 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:06.616440 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:06.616440 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:06.616440 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:06.616440 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:06.616440 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:06.616440 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:06.616440 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:06.616440 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:06.616440 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:06.616440 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:06.616440 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:06.616440 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:06.616440 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:06.617490 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:17:06.617490 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:17:06.617490 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:06.617490 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:06.617490 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 317/645] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:17:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:06.617768 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7723ee46-29ec-4c32-91b8-3565c7ad4de8 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:06.637040 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba361c4d-bdee-479f-8f2f-0cb414622d4f None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:06.646476 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:06.676084 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7322c044-c317-4442-9987-cd3a6bbee733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:06.676757 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322c044-c317-4442-9987-cd3a6bbee733 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:06.677036 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322c044-c317-4442-9987-cd3a6bbee733 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:06.677311 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322c044-c317-4442-9987-cd3a6bbee733 None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:06.678148 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7322c044-c317-4442-9987-cd3a6bbee733 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:06.678463 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7322c044-c317-4442-9987-cd3a6bbee733 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:06.679923 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7322c044-c317-4442-9987-cd3a6bbee733 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:06.697876 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 329/646] 10.222.0.60 () {56 vars in 1137 bytes} [Sat Jul 2 03:17:06 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:06.698985 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7322c044-c317-4442-9987-cd3a6bbee733 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:06.703566 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:06.729799 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7723ee46-29ec-4c32-91b8-3565c7ad4de8 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:06.767869 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19a97b2-502e-48c7-8085-1e81352222d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:06.768656 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a97b2-502e-48c7-8085-1e81352222d5 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:06.768936 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a97b2-502e-48c7-8085-1e81352222d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:06.769211 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a97b2-502e-48c7-8085-1e81352222d5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:06.779967 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19a97b2-502e-48c7-8085-1e81352222d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:17:06.787762 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-a19a97b2-502e-48c7-8085-1e81352222d5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 02 03:17:06.787762 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:06.787762 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:06.787762 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:06.787762 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:06.787762 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:06.787762 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:06.787762 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:06.787762 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:06.787762 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:06.787762 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:06.787762 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:06.787762 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:17:06.787762 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:17:06.787762 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:17:06.787762 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:17:06.788858 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:17:06.788858 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:17:06.788858 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:17:06.788858 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:17:06.788858 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:06.788858 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:06.788858 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:06.788858 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:06.788858 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:06.788858 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:06.788858 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:06.788858 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:06.788858 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:06.788858 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:06.788858 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:06.788858 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:06.790146 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:06.790146 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:06.790146 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:06.790146 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:06.790146 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:17:06.790146 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:17:06.790146 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:17:06.790146 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:17:06.790146 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:17:06.790146 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:17:06.790146 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 02 03:17:06.790146 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:06.790146 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 318/647] 10.222.0.60 () {56 vars in 1102 bytes} [Sat Jul 2 03:17:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:06.790850 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19a97b2-502e-48c7-8085-1e81352222d5 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:06.820837 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7322c044-c317-4442-9987-cd3a6bbee733 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:06.856243 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138dd5b8-8fd6-4e59-bc68-928ae9f7918e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:06.857266 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138dd5b8-8fd6-4e59-bc68-928ae9f7918e None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:06.857685 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138dd5b8-8fd6-4e59-bc68-928ae9f7918e None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:06.858119 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138dd5b8-8fd6-4e59-bc68-928ae9f7918e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:06.865349 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138dd5b8-8fd6-4e59-bc68-928ae9f7918e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:06.866960 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138dd5b8-8fd6-4e59-bc68-928ae9f7918e None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:06.874850 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:06.882488 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-138dd5b8-8fd6-4e59-bc68-928ae9f7918e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 03:17:06.882488 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:06.882488 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:06.882488 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:06.882488 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:06.882488 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:06.882488 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:06.882488 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:06.882488 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:06.882488 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:06.882488 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:06.882488 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:06.882488 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 03:17:06.882488 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 03:17:06.882488 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 03:17:06.883574 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 03:17:06.883574 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:06.883574 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:06.883574 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:06.883574 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:06.883574 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:06.883574 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:06.883574 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:06.883574 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:06.883574 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:06.883574 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:06.883574 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:06.883574 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:06.883574 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:06.883574 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:06.883574 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:06.883574 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:06.884645 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 03:17:06.884645 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 03:17:06.884645 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 03:17:06.884645 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 03:17:06.884645 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 03:17:06.884645 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 03:17:06.884645 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 03:17:06.884645 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:06.886741 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 330/648] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Jul 2 03:17:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:06.887726 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138dd5b8-8fd6-4e59-bc68-928ae9f7918e None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:06.898185 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19a97b2-502e-48c7-8085-1e81352222d5 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:06.933698 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34bd781-a96e-4c4b-bdb7-613c8038da7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:06.934363 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34bd781-a96e-4c4b-bdb7-613c8038da7a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:06.934650 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34bd781-a96e-4c4b-bdb7-613c8038da7a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:06.934927 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34bd781-a96e-4c4b-bdb7-613c8038da7a None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:06.935700 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34bd781-a96e-4c4b-bdb7-613c8038da7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:06.936033 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34bd781-a96e-4c4b-bdb7-613c8038da7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:06.937391 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34bd781-a96e-4c4b-bdb7-613c8038da7a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:06.949146 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 319/649] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:17:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:06.949943 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34bd781-a96e-4c4b-bdb7-613c8038da7a None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:06.957201 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:06.999738 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138dd5b8-8fd6-4e59-bc68-928ae9f7918e None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:07.034705 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39bd298-3fea-45a4-8b16-f7058db6aa9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:07.035653 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39bd298-3fea-45a4-8b16-f7058db6aa9b None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:07.036082 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39bd298-3fea-45a4-8b16-f7058db6aa9b None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:07.036503 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39bd298-3fea-45a4-8b16-f7058db6aa9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:07.070199 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34bd781-a96e-4c4b-bdb7-613c8038da7a None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:07.117189 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af29d374-02af-4554-9d89-3086f743d751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:07.117958 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29d374-02af-4554-9d89-3086f743d751 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:07.118472 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29d374-02af-4554-9d89-3086f743d751 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:07.118836 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29d374-02af-4554-9d89-3086f743d751 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:07.120209 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af29d374-02af-4554-9d89-3086f743d751 None admin] RBAC: Adding query filter params (name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:07.120599 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af29d374-02af-4554-9d89-3086f743d751 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:07.121692 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39bd298-3fea-45a4-8b16-f7058db6aa9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:07.122119 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af29d374-02af-4554-9d89-3086f743d751 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:07.123170 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39bd298-3fea-45a4-8b16-f7058db6aa9b None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:07.131081 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 320/650] 10.222.0.60 () {56 vars in 1103 bytes} [Sat Jul 2 03:17:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:07.131993 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af29d374-02af-4554-9d89-3086f743d751 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:07.136406 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:07.193428 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:07.237497 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af29d374-02af-4554-9d89-3086f743d751 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:07.238868 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 331/651] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Jul 2 03:17:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 03:17:07.240040 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39bd298-3fea-45a4-8b16-f7058db6aa9b None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:07.275184 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac10b7d-a50c-49bf-8feb-d813d77c46fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:07.275754 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac10b7d-a50c-49bf-8feb-d813d77c46fd None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:07.276047 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac10b7d-a50c-49bf-8feb-d813d77c46fd None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:07.276348 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac10b7d-a50c-49bf-8feb-d813d77c46fd None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:07.277126 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac10b7d-a50c-49bf-8feb-d813d77c46fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:07.277432 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac10b7d-a50c-49bf-8feb-d813d77c46fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:07.279081 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac10b7d-a50c-49bf-8feb-d813d77c46fd None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:07.296841 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 321/652] 10.222.0.60 () {56 vars in 1148 bytes} [Sat Jul 2 03:17:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:07.297794 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac10b7d-a50c-49bf-8feb-d813d77c46fd None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:07.344361 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39bd298-3fea-45a4-8b16-f7058db6aa9b None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:07.360516 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:07.381104 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae208dcd-bf09-4ec4-809d-258728112867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:07.382014 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae208dcd-bf09-4ec4-809d-258728112867 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:07.382285 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae208dcd-bf09-4ec4-809d-258728112867 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:07.382552 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae208dcd-bf09-4ec4-809d-258728112867 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:07.393187 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae208dcd-bf09-4ec4-809d-258728112867 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:07.394624 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae208dcd-bf09-4ec4-809d-258728112867 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:07.409154 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-ae208dcd-bf09-4ec4-809d-258728112867 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 02 03:17:07.409154 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:07.409154 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:07.409154 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:07.409154 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:07.409154 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:07.409154 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:07.409154 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:07.409154 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:07.409154 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:07.409154 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:07.409154 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:07.409154 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 03:17:07.409154 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 03:17:07.409154 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 03:17:07.409154 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 03:17:07.410087 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:07.410087 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:07.410087 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 03:17:07.410087 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 03:17:07.410087 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 03:17:07.410087 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 03:17:07.410087 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:07.410087 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:07.410087 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:07.410087 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:07.410087 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:07.410087 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:07.410087 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:07.410087 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:07.410087 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:07.410087 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:07.410087 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:07.410087 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:07.411017 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:07.411017 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:07.411017 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 03:17:07.411017 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 03:17:07.411017 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 03:17:07.411017 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 03:17:07.411017 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 03:17:07.411017 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 03:17:07.411017 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 02 03:17:07.411017 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:07.411017 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 332/653] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Jul 2 03:17:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:07.412002 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae208dcd-bf09-4ec4-809d-258728112867 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:07.413750 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac10b7d-a50c-49bf-8feb-d813d77c46fd None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:07.438385 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:07.452834 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b062e6f-f768-4dee-9b5e-33a81592660c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:07.453977 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b062e6f-f768-4dee-9b5e-33a81592660c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:07.454702 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b062e6f-f768-4dee-9b5e-33a81592660c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:07.454947 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b062e6f-f768-4dee-9b5e-33a81592660c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:07.466548 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b062e6f-f768-4dee-9b5e-33a81592660c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:07.468226 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b062e6f-f768-4dee-9b5e-33a81592660c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:07.487725 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-3b062e6f-f768-4dee-9b5e-33a81592660c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:07.487725 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:07.487725 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:07.487725 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:07.487725 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:07.487725 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:07.487725 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:07.487725 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:07.487725 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:07.487725 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:07.487725 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:07.487725 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:07.487725 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:17:07.487725 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:17:07.487725 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:17:07.488646 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:17:07.488646 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:07.488646 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:07.488646 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:07.488646 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:07.488646 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:07.488646 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:07.488646 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:07.488646 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:07.488646 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:07.488646 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:07.488646 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:07.488646 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:07.488646 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:07.488646 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:07.488646 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:07.488646 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:07.489545 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:17:07.489545 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:17:07.489545 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:07.489545 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:07.489545 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 322/654] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:17:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:07.489831 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b062e6f-f768-4dee-9b5e-33a81592660c None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:07.520255 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae208dcd-bf09-4ec4-809d-258728112867 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:07.555222 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a137a3-8d76-44e8-9282-d3a3e3e6bb86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:07.556202 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a137a3-8d76-44e8-9282-d3a3e3e6bb86 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:07.556483 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a137a3-8d76-44e8-9282-d3a3e3e6bb86 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:07.556761 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a137a3-8d76-44e8-9282-d3a3e3e6bb86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:07.567648 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a137a3-8d76-44e8-9282-d3a3e3e6bb86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:07.569117 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a137a3-8d76-44e8-9282-d3a3e3e6bb86 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:07.587233 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-24a137a3-8d76-44e8-9282-d3a3e3e6bb86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:07.587233 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:07.587233 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:07.587233 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:07.587233 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:07.587233 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:07.587233 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:07.587233 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:07.587233 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:07.587233 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:07.587233 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:07.587233 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:07.587233 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:17:07.587233 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:17:07.587233 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:17:07.588157 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:17:07.588157 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:07.588157 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:07.588157 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:07.588157 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:07.588157 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:07.588157 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:07.588157 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:07.588157 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:07.588157 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:07.588157 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:07.588157 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:07.588157 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:07.588157 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:07.588157 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:07.588157 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:07.588157 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:07.589162 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:17:07.589162 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:17:07.589162 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:07.589162 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:07.589162 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 333/655] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:17:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:07.589440 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a137a3-8d76-44e8-9282-d3a3e3e6bb86 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:07.606711 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b062e6f-f768-4dee-9b5e-33a81592660c None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:07.627265 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:07.646081 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce7954f-b1e1-4e7a-949e-bd16f58c1386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:07.646742 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7954f-b1e1-4e7a-949e-bd16f58c1386 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:07.647075 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7954f-b1e1-4e7a-949e-bd16f58c1386 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:07.647325 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7954f-b1e1-4e7a-949e-bd16f58c1386 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:07.648158 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce7954f-b1e1-4e7a-949e-bd16f58c1386 None admin] RBAC: Adding query filter params (role.id=3c71d0e875cd4a00849f14227be8f7ed, scope.project.id=e09dc5d9d4904c2b89b0cabed237d55e, user.id=13530240e2d446b6bf26a431d001362a) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:07.648471 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce7954f-b1e1-4e7a-949e-bd16f58c1386 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:07.649940 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce7954f-b1e1-4e7a-949e-bd16f58c1386 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:07.656504 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 323/656] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Jul 2 03:17:07 2022] GET /identity/v3/role_assignments?user.id=13530240e2d446b6bf26a431d001362a&scope.project.id=e09dc5d9d4904c2b89b0cabed237d55e&role.id=3c71d0e875cd4a00849f14227be8f7ed => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:07.657105 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce7954f-b1e1-4e7a-949e-bd16f58c1386 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:07.678673 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:07.714965 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a137a3-8d76-44e8-9282-d3a3e3e6bb86 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:07.765353 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532e4571-bf8c-4135-98ea-054f1e64af6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:07.767004 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e4571-bf8c-4135-98ea-054f1e64af6e None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:07.767499 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e4571-bf8c-4135-98ea-054f1e64af6e None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:07.768190 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e4571-bf8c-4135-98ea-054f1e64af6e None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:07.769478 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532e4571-bf8c-4135-98ea-054f1e64af6e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:07.769972 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532e4571-bf8c-4135-98ea-054f1e64af6e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:07.772307 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532e4571-bf8c-4135-98ea-054f1e64af6e None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:07.773344 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce7954f-b1e1-4e7a-949e-bd16f58c1386 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:07.798079 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 334/657] 10.222.0.60 () {56 vars in 1137 bytes} [Sat Jul 2 03:17:07 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:07.799373 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532e4571-bf8c-4135-98ea-054f1e64af6e None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:07.824441 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cfd81d-a34c-42a6-a450-3f612f18aec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:07.825423 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cfd81d-a34c-42a6-a450-3f612f18aec6 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:07.825876 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cfd81d-a34c-42a6-a450-3f612f18aec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:07.826318 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cfd81d-a34c-42a6-a450-3f612f18aec6 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:07.827245 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cfd81d-a34c-42a6-a450-3f612f18aec6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:07.827736 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cfd81d-a34c-42a6-a450-3f612f18aec6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:07.829296 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cfd81d-a34c-42a6-a450-3f612f18aec6 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:07.843343 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 324/658] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:17:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:07.844272 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cfd81d-a34c-42a6-a450-3f612f18aec6 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:07.895553 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:07.930458 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532e4571-bf8c-4135-98ea-054f1e64af6e None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:07.969252 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3bf603-1077-4f1e-aa17-dc8675659d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:07.970799 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bf603-1077-4f1e-aa17-dc8675659d21 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:07.971277 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bf603-1077-4f1e-aa17-dc8675659d21 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:07.971703 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bf603-1077-4f1e-aa17-dc8675659d21 None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:07.972735 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3bf603-1077-4f1e-aa17-dc8675659d21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:07.973495 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3bf603-1077-4f1e-aa17-dc8675659d21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:07.975449 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3bf603-1077-4f1e-aa17-dc8675659d21 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:07.977749 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:07.980237 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cfd81d-a34c-42a6-a450-3f612f18aec6 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:07.990842 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 335/659] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:17:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:07.992011 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3bf603-1077-4f1e-aa17-dc8675659d21 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:08.024044 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78e5d39-b0d7-4b87-b24d-14335e4bc8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:08.024703 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e5d39-b0d7-4b87-b24d-14335e4bc8d5 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:08.025245 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e5d39-b0d7-4b87-b24d-14335e4bc8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:08.025245 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e5d39-b0d7-4b87-b24d-14335e4bc8d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:08.101611 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78e5d39-b0d7-4b87-b24d-14335e4bc8d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:08.102995 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78e5d39-b0d7-4b87-b24d-14335e4bc8d5 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:08.104040 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3bf603-1077-4f1e-aa17-dc8675659d21 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:08.144757 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf844a-bcc5-4f70-813b-03476e60c3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:08.146205 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf844a-bcc5-4f70-813b-03476e60c3cf None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:08.146342 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:08.146492 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf844a-bcc5-4f70-813b-03476e60c3cf None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:08.146767 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf844a-bcc5-4f70-813b-03476e60c3cf None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:08.155159 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaf844a-bcc5-4f70-813b-03476e60c3cf None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:08.156599 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaf844a-bcc5-4f70-813b-03476e60c3cf None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:08.172827 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-7aaf844a-bcc5-4f70-813b-03476e60c3cf None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 02 03:17:08.172827 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:08.172827 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:08.172827 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:08.172827 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:08.172827 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:08.172827 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:08.172827 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:08.172827 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:08.172827 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:08.172827 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:08.172827 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:08.172827 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 03:17:08.172827 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 03:17:08.172827 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 03:17:08.172827 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 03:17:08.174524 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:08.174524 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:08.174524 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 03:17:08.174524 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 03:17:08.174524 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 03:17:08.174524 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 03:17:08.174524 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:08.174524 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:08.174524 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:08.174524 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:08.174524 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:08.174524 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:08.174524 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:08.174524 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:08.174524 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:08.174524 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:08.174524 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:08.174524 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:08.176074 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:08.176074 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:08.176074 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 03:17:08.176074 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 03:17:08.176074 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 03:17:08.176074 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 03:17:08.176074 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 03:17:08.176074 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 03:17:08.176074 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 02 03:17:08.176074 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:08.176074 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 336/660] 10.222.0.60 () {56 vars in 1102 bytes} [Sat Jul 2 03:17:07 2022] GET /identity/v3/users/neutron => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:08.176074 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf844a-bcc5-4f70-813b-03476e60c3cf None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:08.213973 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 325/661] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Jul 2 03:17:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 03:17:08.215691 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59cc0e8-893e-43bc-9993-c06da362f66d None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:08.216170 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59cc0e8-893e-43bc-9993-c06da362f66d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:08.216652 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59cc0e8-893e-43bc-9993-c06da362f66d None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:08.218553 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 326/662] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:17:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:17:08.219481 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59cc0e8-893e-43bc-9993-c06da362f66d None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:08.240507 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:08.290087 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf844a-bcc5-4f70-813b-03476e60c3cf None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:08.320437 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59cc0e8-893e-43bc-9993-c06da362f66d None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:08.324035 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b99f78-a44d-420d-8c7c-1047525a6569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:08.324837 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b99f78-a44d-420d-8c7c-1047525a6569 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:08.325110 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b99f78-a44d-420d-8c7c-1047525a6569 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:08.325378 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b99f78-a44d-420d-8c7c-1047525a6569 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:08.332535 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b99f78-a44d-420d-8c7c-1047525a6569 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:08.333966 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b99f78-a44d-420d-8c7c-1047525a6569 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:08.349074 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-45b99f78-a44d-420d-8c7c-1047525a6569 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 03:17:08.349074 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:08.349074 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:08.349074 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:08.349074 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:08.349074 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:08.349074 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:08.349074 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:08.349074 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:08.349074 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:08.349074 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:08.349074 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:08.349074 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 03:17:08.349074 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 03:17:08.349074 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 03:17:08.350160 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 03:17:08.350160 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:08.350160 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:08.350160 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:08.350160 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:08.350160 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:08.350160 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:08.350160 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:08.350160 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:08.350160 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:08.350160 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:08.350160 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:08.350160 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:08.350160 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:08.350160 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:08.350160 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:08.350160 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:08.351706 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 03:17:08.351706 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 03:17:08.351706 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 03:17:08.351706 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 03:17:08.351706 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 03:17:08.351706 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 03:17:08.351706 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 03:17:08.351706 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:08.351706 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 337/663] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Jul 2 03:17:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:08.351706 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b99f78-a44d-420d-8c7c-1047525a6569 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:08.362049 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d884f42-61ff-4144-af7f-0a26a842e639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:08.362710 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d884f42-61ff-4144-af7f-0a26a842e639 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:08.363017 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d884f42-61ff-4144-af7f-0a26a842e639 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:08.363304 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d884f42-61ff-4144-af7f-0a26a842e639 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:08.364135 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d884f42-61ff-4144-af7f-0a26a842e639 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:08.364442 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d884f42-61ff-4144-af7f-0a26a842e639 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:08.365889 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d884f42-61ff-4144-af7f-0a26a842e639 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:08.378513 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:08.392990 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 327/664] 10.222.0.60 () {56 vars in 1139 bytes} [Sat Jul 2 03:17:08 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:08.394265 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f7582-5438-48eb-8a0a-423259c7eadc None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:08.394547 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f7582-5438-48eb-8a0a-423259c7eadc None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:08.394822 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f7582-5438-48eb-8a0a-423259c7eadc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:08.411187 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-831f7582-5438-48eb-8a0a-423259c7eadc None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:17:08.412462 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-831f7582-5438-48eb-8a0a-423259c7eadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:17:08.481897 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b99f78-a44d-420d-8c7c-1047525a6569 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:08.483605 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 328/665] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:17:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 03:17:08.484461 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f7582-5438-48eb-8a0a-423259c7eadc None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:08.500492 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:08.520822 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d202b6-ccfc-4dee-b830-bbc85754e034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:08.522472 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d202b6-ccfc-4dee-b830-bbc85754e034 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:08.522724 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d202b6-ccfc-4dee-b830-bbc85754e034 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:08.522994 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d202b6-ccfc-4dee-b830-bbc85754e034 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:08.533916 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d202b6-ccfc-4dee-b830-bbc85754e034 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:08.535487 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d202b6-ccfc-4dee-b830-bbc85754e034 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:08.555017 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-f0d202b6-ccfc-4dee-b830-bbc85754e034 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:08.555017 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:08.555017 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:08.555017 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:08.555017 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:08.555017 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:08.555017 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:08.555017 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:08.555017 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:08.555017 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:08.555017 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:08.555017 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:08.555017 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:17:08.555017 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:17:08.555017 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:17:08.555925 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:17:08.555925 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:08.555925 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:08.555925 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:08.555925 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:08.555925 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:08.555925 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:08.555925 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:08.555925 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:08.555925 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:08.555925 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:08.555925 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:08.555925 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:08.555925 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:08.555925 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:08.555925 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:08.555925 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:08.556820 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:17:08.556820 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:17:08.556820 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:08.556820 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:08.556820 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 338/666] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:17:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:08.557104 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d202b6-ccfc-4dee-b830-bbc85754e034 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:08.613556 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f7582-5438-48eb-8a0a-423259c7eadc None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:08.642070 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:08.652264 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8756f8aa-fe6b-4ac1-87cc-fbd2e9a56c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:08.653262 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756f8aa-fe6b-4ac1-87cc-fbd2e9a56c39 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:08.653767 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756f8aa-fe6b-4ac1-87cc-fbd2e9a56c39 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:08.654220 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756f8aa-fe6b-4ac1-87cc-fbd2e9a56c39 None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:08.655386 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8756f8aa-fe6b-4ac1-87cc-fbd2e9a56c39 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:08.655888 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8756f8aa-fe6b-4ac1-87cc-fbd2e9a56c39 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:08.657330 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8756f8aa-fe6b-4ac1-87cc-fbd2e9a56c39 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:08.658570 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d202b6-ccfc-4dee-b830-bbc85754e034 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:08.670373 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 329/667] 10.222.0.60 () {56 vars in 1148 bytes} [Sat Jul 2 03:17:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:08.670373 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8756f8aa-fe6b-4ac1-87cc-fbd2e9a56c39 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:08.697680 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a30c045-96d8-4501-b173-e2eef1830ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:08.698416 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30c045-96d8-4501-b173-e2eef1830ddf None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:08.698693 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30c045-96d8-4501-b173-e2eef1830ddf None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:08.698956 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30c045-96d8-4501-b173-e2eef1830ddf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:08.731281 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:08.767285 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a30c045-96d8-4501-b173-e2eef1830ddf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:08.768946 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a30c045-96d8-4501-b173-e2eef1830ddf None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:08.776684 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8756f8aa-fe6b-4ac1-87cc-fbd2e9a56c39 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:08.810374 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e73a52-44e4-471c-8e3b-8bfa8e45231d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:08.811206 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e73a52-44e4-471c-8e3b-8bfa8e45231d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:08.811490 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e73a52-44e4-471c-8e3b-8bfa8e45231d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:08.811763 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e73a52-44e4-471c-8e3b-8bfa8e45231d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:08.822121 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e73a52-44e4-471c-8e3b-8bfa8e45231d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:17:08.829929 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-d4e73a52-44e4-471c-8e3b-8bfa8e45231d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 02 03:17:08.829929 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:08.829929 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:08.829929 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:08.829929 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:08.829929 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:08.829929 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:08.829929 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:08.829929 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:08.829929 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:08.829929 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:08.829929 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:08.829929 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:17:08.829929 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:17:08.829929 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:17:08.829929 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:17:08.830868 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:17:08.830868 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:17:08.830868 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:17:08.830868 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:17:08.830868 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:08.830868 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:08.830868 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:08.830868 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:08.830868 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:08.830868 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:08.830868 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:08.830868 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:08.830868 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:08.830868 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:08.830868 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:08.830868 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:08.831770 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:08.831770 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:08.831770 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:08.831770 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:08.831770 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:17:08.831770 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:17:08.831770 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:17:08.831770 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:17:08.831770 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:17:08.831770 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:17:08.831770 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 02 03:17:08.831770 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:08.831770 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 330/668] 10.222.0.60 () {56 vars in 1102 bytes} [Sat Jul 2 03:17:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:08.832460 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e73a52-44e4-471c-8e3b-8bfa8e45231d None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:08.881636 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 339/669] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Jul 2 03:17:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 03:17:08.882405 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a30c045-96d8-4501-b173-e2eef1830ddf None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:08.890038 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:08.943596 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e73a52-44e4-471c-8e3b-8bfa8e45231d None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:08.954930 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:08.980502 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b0d6f-a31d-44c3-80a4-b340f2327f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:08.981167 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b0d6f-a31d-44c3-80a4-b340f2327f93 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:08.981440 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b0d6f-a31d-44c3-80a4-b340f2327f93 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:08.981710 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b0d6f-a31d-44c3-80a4-b340f2327f93 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:08.982429 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10b0d6f-a31d-44c3-80a4-b340f2327f93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:08.982730 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10b0d6f-a31d-44c3-80a4-b340f2327f93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:08.984129 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10b0d6f-a31d-44c3-80a4-b340f2327f93 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:08.994508 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a30c045-96d8-4501-b173-e2eef1830ddf None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:08.995892 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 331/670] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:17:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:08.996668 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b0d6f-a31d-44c3-80a4-b340f2327f93 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:09.034120 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8888fd08-4d6f-44c9-a44b-a23c249d6d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:09.034770 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888fd08-4d6f-44c9-a44b-a23c249d6d83 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:09.035042 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888fd08-4d6f-44c9-a44b-a23c249d6d83 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:09.035335 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888fd08-4d6f-44c9-a44b-a23c249d6d83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:09.036153 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8888fd08-4d6f-44c9-a44b-a23c249d6d83 None admin] RBAC: Adding query filter params (role.id=3c71d0e875cd4a00849f14227be8f7ed, scope.project.id=e09dc5d9d4904c2b89b0cabed237d55e, user.id=6470ccbf858f47bf9bb884476bf4235e) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:09.036459 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8888fd08-4d6f-44c9-a44b-a23c249d6d83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:09.038276 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8888fd08-4d6f-44c9-a44b-a23c249d6d83 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:09.051178 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 340/671] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Jul 2 03:17:08 2022] GET /identity/v3/role_assignments?user.id=6470ccbf858f47bf9bb884476bf4235e&scope.project.id=e09dc5d9d4904c2b89b0cabed237d55e&role.id=3c71d0e875cd4a00849f14227be8f7ed => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:09.051178 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8888fd08-4d6f-44c9-a44b-a23c249d6d83 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:09.114502 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b0d6f-a31d-44c3-80a4-b340f2327f93 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:09.127036 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:09.156866 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3def712f-be6d-4020-87fb-95139a9d4c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:09.157558 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def712f-be6d-4020-87fb-95139a9d4c5c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:09.157906 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def712f-be6d-4020-87fb-95139a9d4c5c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:09.158249 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def712f-be6d-4020-87fb-95139a9d4c5c None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:09.159080 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3def712f-be6d-4020-87fb-95139a9d4c5c None admin] RBAC: Adding query filter params (name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:09.162994 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3def712f-be6d-4020-87fb-95139a9d4c5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:09.164545 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3def712f-be6d-4020-87fb-95139a9d4c5c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:09.181705 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 332/672] 10.222.0.60 () {56 vars in 1103 bytes} [Sat Jul 2 03:17:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:09.181705 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3def712f-be6d-4020-87fb-95139a9d4c5c None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:09.188588 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8888fd08-4d6f-44c9-a44b-a23c249d6d83 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:09.224770 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:09.232468 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281bcf16-2a3d-4ecb-8172-5ebecc4baae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:09.233280 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281bcf16-2a3d-4ecb-8172-5ebecc4baae3 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:09.233552 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281bcf16-2a3d-4ecb-8172-5ebecc4baae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:09.233818 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281bcf16-2a3d-4ecb-8172-5ebecc4baae3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:09.247982 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281bcf16-2a3d-4ecb-8172-5ebecc4baae3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:09.250348 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281bcf16-2a3d-4ecb-8172-5ebecc4baae3 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:09.270957 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-281bcf16-2a3d-4ecb-8172-5ebecc4baae3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:09.270957 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:09.270957 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:09.270957 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:09.270957 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:09.270957 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:09.270957 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:09.270957 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:09.270957 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:09.270957 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:09.270957 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:09.270957 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:09.270957 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:17:09.270957 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:17:09.270957 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:17:09.272014 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:17:09.272014 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:09.272014 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:09.272014 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:09.272014 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:09.272014 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:09.272014 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:09.272014 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:09.272014 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:09.272014 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:09.272014 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:09.272014 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:09.272014 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:09.272014 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:09.272014 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:09.272014 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:09.272014 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:09.273037 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:17:09.273037 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:17:09.273037 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:09.273037 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:09.273284 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 341/673] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:17:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:09.274237 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281bcf16-2a3d-4ecb-8172-5ebecc4baae3 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:09.313017 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3def712f-be6d-4020-87fb-95139a9d4c5c None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:09.349362 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e531b24b-e74e-4ad7-93ae-56a7aae482e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:09.350162 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531b24b-e74e-4ad7-93ae-56a7aae482e6 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:09.350440 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531b24b-e74e-4ad7-93ae-56a7aae482e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:09.350715 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531b24b-e74e-4ad7-93ae-56a7aae482e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:09.360706 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e531b24b-e74e-4ad7-93ae-56a7aae482e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:09.362321 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e531b24b-e74e-4ad7-93ae-56a7aae482e6 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:09.380465 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-e531b24b-e74e-4ad7-93ae-56a7aae482e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 03:17:09.380465 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:09.380465 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:09.380465 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:09.380465 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:09.380465 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:09.380465 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:09.380465 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:09.380465 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:09.380465 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:09.380465 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:09.380465 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:09.380465 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 03:17:09.380465 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 03:17:09.380465 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 03:17:09.381364 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 03:17:09.381364 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:09.381364 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:09.381364 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:09.381364 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:09.381364 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:09.381364 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:09.381364 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:09.381364 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:09.381364 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:09.381364 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:09.381364 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:09.381364 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:09.381364 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:09.381364 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:09.381364 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:09.381364 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:09.382276 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 03:17:09.382276 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 03:17:09.382276 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 03:17:09.382276 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 03:17:09.382276 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 03:17:09.382276 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 03:17:09.382276 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 03:17:09.382276 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:09.382276 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 333/674] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Jul 2 03:17:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:09.383363 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e531b24b-e74e-4ad7-93ae-56a7aae482e6 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:09.415285 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281bcf16-2a3d-4ecb-8172-5ebecc4baae3 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:09.422254 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:09.459135 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a110f98-2567-40d4-ad21-159791f66fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:09.460855 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a110f98-2567-40d4-ad21-159791f66fcd None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:09.461339 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a110f98-2567-40d4-ad21-159791f66fcd None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:09.461955 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a110f98-2567-40d4-ad21-159791f66fcd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:09.475874 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a110f98-2567-40d4-ad21-159791f66fcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:09.478050 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a110f98-2567-40d4-ad21-159791f66fcd None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:09.500609 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-6a110f98-2567-40d4-ad21-159791f66fcd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:09.500609 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:09.500609 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:09.500609 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:09.500609 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:09.500609 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:09.500609 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:09.500609 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:09.500609 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:09.500609 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:09.500609 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:09.500609 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:09.500609 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:17:09.500609 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:17:09.500609 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:17:09.501589 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:17:09.501589 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:09.501589 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:09.501589 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:09.501589 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:09.501589 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:09.501589 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:09.501589 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:09.501589 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:09.501589 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:09.501589 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:09.501589 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:09.501589 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:09.501589 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:09.501589 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:09.501589 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:09.501589 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:09.502492 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:17:09.502492 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:17:09.502492 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:09.502492 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:09.505063 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 342/675] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:17:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:09.506069 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a110f98-2567-40d4-ad21-159791f66fcd None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:09.512719 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e531b24b-e74e-4ad7-93ae-56a7aae482e6 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:09.553189 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:09.558508 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69af5fb-7b3e-4319-a191-d271d522ca66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:09.559607 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69af5fb-7b3e-4319-a191-d271d522ca66 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:09.560149 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69af5fb-7b3e-4319-a191-d271d522ca66 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:09.561663 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69af5fb-7b3e-4319-a191-d271d522ca66 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:09.562634 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69af5fb-7b3e-4319-a191-d271d522ca66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:09.563804 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69af5fb-7b3e-4319-a191-d271d522ca66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:09.566119 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69af5fb-7b3e-4319-a191-d271d522ca66 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:09.586028 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 334/676] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:17:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:09.586028 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69af5fb-7b3e-4319-a191-d271d522ca66 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:09.646721 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a110f98-2567-40d4-ad21-159791f66fcd None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:09.683816 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:09.696707 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69af5fb-7b3e-4319-a191-d271d522ca66 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:09.697333 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f0343a-d2d9-41c0-8f7f-e6e215fa5722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:09.698080 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0343a-d2d9-41c0-8f7f-e6e215fa5722 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:09.698374 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0343a-d2d9-41c0-8f7f-e6e215fa5722 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:09.698650 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0343a-d2d9-41c0-8f7f-e6e215fa5722 None admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:09.699738 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f0343a-d2d9-41c0-8f7f-e6e215fa5722 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:09.700050 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f0343a-d2d9-41c0-8f7f-e6e215fa5722 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:09.702402 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f0343a-d2d9-41c0-8f7f-e6e215fa5722 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:09.718522 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 343/677] 10.222.0.60 () {56 vars in 1148 bytes} [Sat Jul 2 03:17:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:09.724445 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f0343a-d2d9-41c0-8f7f-e6e215fa5722 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:09.737878 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd74c96-ca37-458f-b7f7-f7de68410f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:09.738941 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd74c96-ca37-458f-b7f7-f7de68410f42 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:09.739452 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd74c96-ca37-458f-b7f7-f7de68410f42 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:09.739931 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd74c96-ca37-458f-b7f7-f7de68410f42 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:09.740907 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd74c96-ca37-458f-b7f7-f7de68410f42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:09.741500 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd74c96-ca37-458f-b7f7-f7de68410f42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:09.743183 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd74c96-ca37-458f-b7f7-f7de68410f42 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:09.760609 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 335/678] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:17:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:09.761748 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd74c96-ca37-458f-b7f7-f7de68410f42 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:09.834128 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:09.842016 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f0343a-d2d9-41c0-8f7f-e6e215fa5722 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:09.867799 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd74c96-ca37-458f-b7f7-f7de68410f42 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:09.878760 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60af307-351a-4715-b565-98847fd2ab77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:09.879594 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60af307-351a-4715-b565-98847fd2ab77 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:09.879850 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60af307-351a-4715-b565-98847fd2ab77 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:09.880135 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60af307-351a-4715-b565-98847fd2ab77 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:09.887400 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60af307-351a-4715-b565-98847fd2ab77 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:09.888956 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60af307-351a-4715-b565-98847fd2ab77 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:09.901776 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f63c35-f9a3-4e41-992d-a02f3feaaa29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:09.902433 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f63c35-f9a3-4e41-992d-a02f3feaaa29 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:09.902722 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f63c35-f9a3-4e41-992d-a02f3feaaa29 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:09.902985 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f63c35-f9a3-4e41-992d-a02f3feaaa29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:09.903196 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-b60af307-351a-4715-b565-98847fd2ab77 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 03:17:09.903196 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:09.903196 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:09.903196 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:09.903196 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:09.903196 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:09.903196 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:09.903196 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:09.903196 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:09.903196 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:09.903196 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:09.903196 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:09.903196 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 03:17:09.903196 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 03:17:09.903196 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 03:17:09.904055 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 03:17:09.904055 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:09.904055 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:09.904055 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:09.904055 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:09.904055 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:09.904055 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:09.904055 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:09.904055 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:09.904055 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:09.904055 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:09.904055 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:09.904055 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:09.904055 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:09.904055 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:09.904055 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:09.904055 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:09.904976 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 03:17:09.904976 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 03:17:09.904976 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 03:17:09.904976 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 03:17:09.904976 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 03:17:09.904976 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 03:17:09.904976 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 03:17:09.904976 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:09.905915 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f63c35-f9a3-4e41-992d-a02f3feaaa29 None admin] RBAC: Adding query filter params (role.id=3c71d0e875cd4a00849f14227be8f7ed, scope.project.id=e09dc5d9d4904c2b89b0cabed237d55e, user.id=c7c2bef2013546cd882013cdcb4cd929) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:09.905915 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f63c35-f9a3-4e41-992d-a02f3feaaa29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:09.905915 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f63c35-f9a3-4e41-992d-a02f3feaaa29 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:09.909090 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 344/679] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Jul 2 03:17:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:09.909915 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60af307-351a-4715-b565-98847fd2ab77 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:09.912258 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 336/680] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Jul 2 03:17:09 2022] GET /identity/v3/role_assignments?user.id=c7c2bef2013546cd882013cdcb4cd929&scope.project.id=e09dc5d9d4904c2b89b0cabed237d55e&role.id=3c71d0e875cd4a00849f14227be8f7ed => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:09.920860 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0aac0-9929-4477-bbd4-01ecb6be61a2 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:09.921247 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0aac0-9929-4477-bbd4-01ecb6be61a2 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:09.921424 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0aac0-9929-4477-bbd4-01ecb6be61a2 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:09.923033 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 337/681] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:17:09 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:17:09.928440 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f0aac0-9929-4477-bbd4-01ecb6be61a2 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:09.947450 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:10.047037 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f0aac0-9929-4477-bbd4-01ecb6be61a2 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:10.056359 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60af307-351a-4715-b565-98847fd2ab77 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:10.090338 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd6dda-05c9-4f8d-a62a-ecd87d4735b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:10.091014 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd6dda-05c9-4f8d-a62a-ecd87d4735b2 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:10.091333 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd6dda-05c9-4f8d-a62a-ecd87d4735b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:10.091610 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd6dda-05c9-4f8d-a62a-ecd87d4735b2 None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:10.092400 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbd6dda-05c9-4f8d-a62a-ecd87d4735b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:10.092711 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbd6dda-05c9-4f8d-a62a-ecd87d4735b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:10.095280 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbd6dda-05c9-4f8d-a62a-ecd87d4735b2 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:10.097629 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfbb0f1-af0c-455d-97be-e0e3f5b8e26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:10.098498 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfbb0f1-af0c-455d-97be-e0e3f5b8e26a None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:10.098820 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfbb0f1-af0c-455d-97be-e0e3f5b8e26a None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:10.099092 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfbb0f1-af0c-455d-97be-e0e3f5b8e26a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:10.109628 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 338/682] 10.222.0.60 () {56 vars in 1148 bytes} [Sat Jul 2 03:17:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:10.110900 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf0d2f-54df-4431-ba7d-21be5f28797c None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:10.111205 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf0d2f-54df-4431-ba7d-21be5f28797c None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:10.111479 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf0d2f-54df-4431-ba7d-21be5f28797c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:10.112332 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfbb0f1-af0c-455d-97be-e0e3f5b8e26a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:10.114264 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfbb0f1-af0c-455d-97be-e0e3f5b8e26a None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:10.130069 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-ccfbb0f1-af0c-455d-97be-e0e3f5b8e26a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 02 03:17:10.130069 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:10.130069 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:10.130069 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:10.130069 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:10.130069 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:10.130069 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:10.130069 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:10.130069 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:10.130069 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:10.130069 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:10.130069 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:10.130069 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 03:17:10.130069 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 03:17:10.130069 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 03:17:10.130069 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 03:17:10.131800 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:10.131800 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:10.131800 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 03:17:10.131800 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 03:17:10.131800 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 03:17:10.131800 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 03:17:10.131800 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:10.131800 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:10.131800 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:10.131800 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:10.131800 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:10.131800 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:10.131800 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:10.131800 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:10.131800 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:10.131800 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:10.131800 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:10.131800 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:10.133055 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:10.133055 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:10.133055 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 03:17:10.133055 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 03:17:10.133055 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 03:17:10.133055 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 03:17:10.133055 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 03:17:10.133055 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 03:17:10.133055 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 02 03:17:10.133055 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:10.133618 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-4dbf0d2f-54df-4431-ba7d-21be5f28797c None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:17:10.134459 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 345/683] 10.222.0.60 () {56 vars in 1096 bytes} [Sat Jul 2 03:17:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:10.134614 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4dbf0d2f-54df-4431-ba7d-21be5f28797c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:17:10.134962 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfbb0f1-af0c-455d-97be-e0e3f5b8e26a None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:10.159208 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:10.215889 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 339/684] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:17:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 03:17:10.216837 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf0d2f-54df-4431-ba7d-21be5f28797c None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:10.229958 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:10.283931 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfbb0f1-af0c-455d-97be-e0e3f5b8e26a None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:10.329653 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f4f09-365e-442a-be61-3a4a9cc3120f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:10.330318 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f4f09-365e-442a-be61-3a4a9cc3120f None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:10.330602 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f4f09-365e-442a-be61-3a4a9cc3120f None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:10.330982 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f4f09-365e-442a-be61-3a4a9cc3120f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:10.331954 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28f4f09-365e-442a-be61-3a4a9cc3120f None admin] RBAC: Adding query filter params (role.id=3c71d0e875cd4a00849f14227be8f7ed, scope.project.id=e09dc5d9d4904c2b89b0cabed237d55e, user.id=b0e8a3ba6f84477bb9b4780918f357c0) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:10.332270 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28f4f09-365e-442a-be61-3a4a9cc3120f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:10.333798 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28f4f09-365e-442a-be61-3a4a9cc3120f None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:10.338000 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf0d2f-54df-4431-ba7d-21be5f28797c None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:10.340731 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 346/685] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Jul 2 03:17:10 2022] GET /identity/v3/role_assignments?user.id=b0e8a3ba6f84477bb9b4780918f357c0&scope.project.id=e09dc5d9d4904c2b89b0cabed237d55e&role.id=3c71d0e875cd4a00849f14227be8f7ed => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:10.341555 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f4f09-365e-442a-be61-3a4a9cc3120f None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:10.384887 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50152b6-7cab-43a3-b2dd-d98d29d040b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:10.384887 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50152b6-7cab-43a3-b2dd-d98d29d040b4 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:10.384887 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50152b6-7cab-43a3-b2dd-d98d29d040b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:10.387250 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50152b6-7cab-43a3-b2dd-d98d29d040b4 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:10.388226 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50152b6-7cab-43a3-b2dd-d98d29d040b4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:10.388554 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50152b6-7cab-43a3-b2dd-d98d29d040b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:10.390132 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50152b6-7cab-43a3-b2dd-d98d29d040b4 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:10.411003 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 340/686] 10.222.0.60 () {56 vars in 1135 bytes} [Sat Jul 2 03:17:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:10.419097 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50152b6-7cab-43a3-b2dd-d98d29d040b4 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:10.437661 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:10.457484 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f4f09-365e-442a-be61-3a4a9cc3120f None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:10.495529 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7df578b-f876-4323-b50c-031e0efd2d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:10.496348 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df578b-f876-4323-b50c-031e0efd2d08 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:10.496624 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df578b-f876-4323-b50c-031e0efd2d08 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:10.496887 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df578b-f876-4323-b50c-031e0efd2d08 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:10.509234 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7df578b-f876-4323-b50c-031e0efd2d08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:17:10.517064 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-f7df578b-f876-4323-b50c-031e0efd2d08 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 03:17:10.517064 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:10.517064 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:10.517064 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:10.517064 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:10.517064 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:10.517064 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:10.517064 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:10.517064 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:10.517064 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:10.517064 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:10.517064 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:10.517064 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:17:10.517064 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:17:10.517064 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:17:10.517064 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:17:10.518083 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:17:10.518083 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:17:10.518083 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:17:10.518083 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:17:10.518083 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:10.518083 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:10.518083 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:10.518083 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:10.518083 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:10.518083 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:10.518083 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:10.518083 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:10.518083 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:10.518083 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:10.518083 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:10.518083 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:10.519434 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:10.519434 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:10.519434 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:10.519434 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:10.519434 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:17:10.519434 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:17:10.519434 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:17:10.519434 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:17:10.519434 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:17:10.519434 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:17:10.519434 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 03:17:10.519434 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:10.519434 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 347/687] 10.222.0.60 () {56 vars in 1096 bytes} [Sat Jul 2 03:17:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:10.525410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7df578b-f876-4323-b50c-031e0efd2d08 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:10.547156 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:10.601163 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50152b6-7cab-43a3-b2dd-d98d29d040b4 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:10.639945 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7df578b-f876-4323-b50c-031e0efd2d08 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:10.641261 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5e03a8-2e3c-42ba-80e4-ea71a15e06c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:10.642430 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e03a8-2e3c-42ba-80e4-ea71a15e06c2 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:10.642954 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e03a8-2e3c-42ba-80e4-ea71a15e06c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:10.643451 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e03a8-2e3c-42ba-80e4-ea71a15e06c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:10.676863 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28759c6f-7782-4e0a-b292-c81787402c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:10.677558 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28759c6f-7782-4e0a-b292-c81787402c1a None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:10.677832 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28759c6f-7782-4e0a-b292-c81787402c1a None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:10.678098 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28759c6f-7782-4e0a-b292-c81787402c1a None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:10.678846 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28759c6f-7782-4e0a-b292-c81787402c1a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:10.679156 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28759c6f-7782-4e0a-b292-c81787402c1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:10.680728 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28759c6f-7782-4e0a-b292-c81787402c1a None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:10.686248 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:10.690579 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 348/688] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Jul 2 03:17:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:10.695959 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28759c6f-7782-4e0a-b292-c81787402c1a None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:10.723483 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5e03a8-2e3c-42ba-80e4-ea71a15e06c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:10.725722 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5e03a8-2e3c-42ba-80e4-ea71a15e06c2 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:10.807961 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:10.823735 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28759c6f-7782-4e0a-b292-c81787402c1a None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:10.853880 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 341/689] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Jul 2 03:17:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 03:17:10.860346 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5e03a8-2e3c-42ba-80e4-ea71a15e06c2 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:10.870736 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827c2149-b9c8-41a0-9730-5d040ccd9a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:10.872052 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c2149-b9c8-41a0-9730-5d040ccd9a89 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:10.872332 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c2149-b9c8-41a0-9730-5d040ccd9a89 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:10.872602 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c2149-b9c8-41a0-9730-5d040ccd9a89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:10.886134 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827c2149-b9c8-41a0-9730-5d040ccd9a89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:10.887925 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827c2149-b9c8-41a0-9730-5d040ccd9a89 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:10.923068 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-827c2149-b9c8-41a0-9730-5d040ccd9a89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:10.923068 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:10.923068 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:10.923068 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:10.923068 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:10.923068 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:10.923068 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:10.923068 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:10.923068 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:10.923068 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:10.923068 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:10.923068 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:10.923068 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:17:10.923068 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:17:10.923068 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:17:10.924049 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:17:10.924049 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:10.924049 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:10.924049 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:10.924049 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:10.924049 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:10.924049 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:10.924049 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:10.924049 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:10.924049 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:10.924049 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:10.924049 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:10.924049 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:10.924049 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:10.924049 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:10.924049 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:10.924049 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:10.924938 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:17:10.924938 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:17:10.924938 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:10.924938 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:10.926431 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 349/690] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:17:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 03:17:10.932323 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827c2149-b9c8-41a0-9730-5d040ccd9a89 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:11.042516 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:11.068250 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5e03a8-2e3c-42ba-80e4-ea71a15e06c2 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:11.143821 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27575b4-2ce8-4d45-971a-c3e2b9d84ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:11.145032 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27575b4-2ce8-4d45-971a-c3e2b9d84ee8 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:11.146404 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827c2149-b9c8-41a0-9730-5d040ccd9a89 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:11.146893 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27575b4-2ce8-4d45-971a-c3e2b9d84ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:11.147414 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27575b4-2ce8-4d45-971a-c3e2b9d84ee8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:11.166507 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27575b4-2ce8-4d45-971a-c3e2b9d84ee8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:11.171661 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27575b4-2ce8-4d45-971a-c3e2b9d84ee8 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:11.213909 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-d27575b4-2ce8-4d45-971a-c3e2b9d84ee8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:11.213909 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:11.213909 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:11.213909 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:11.213909 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:11.213909 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:11.213909 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:11.213909 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:11.213909 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:11.213909 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:11.213909 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:11.213909 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:11.213909 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:17:11.213909 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:17:11.213909 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:17:11.214881 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:17:11.214881 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:11.214881 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:11.214881 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:11.214881 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:11.214881 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:11.214881 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:11.214881 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:11.214881 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:11.214881 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:11.214881 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:11.214881 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:11.214881 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:11.214881 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:11.214881 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:11.214881 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:11.214881 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:11.215783 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:17:11.215783 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:17:11.215783 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:11.215783 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:11.222220 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 342/691] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:17:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:11.223667 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef991883-f3a6-4891-9eb6-c544a2921783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:11.224662 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef991883-f3a6-4891-9eb6-c544a2921783 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:11.225715 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27575b4-2ce8-4d45-971a-c3e2b9d84ee8 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:11.227111 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef991883-f3a6-4891-9eb6-c544a2921783 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:11.229683 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef991883-f3a6-4891-9eb6-c544a2921783 None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:11.230650 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef991883-f3a6-4891-9eb6-c544a2921783 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:11.231207 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef991883-f3a6-4891-9eb6-c544a2921783 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:11.232817 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef991883-f3a6-4891-9eb6-c544a2921783 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:11.260710 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:11.260917 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 350/692] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:17:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:11.271146 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef991883-f3a6-4891-9eb6-c544a2921783 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:11.411783 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef991883-f3a6-4891-9eb6-c544a2921783 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:11.441520 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:11.456380 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27575b4-2ce8-4d45-971a-c3e2b9d84ee8 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:11.495902 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d95e88a-3c63-49bf-9282-8d6c02ab742c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:11.497452 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95e88a-3c63-49bf-9282-8d6c02ab742c None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:11.498831 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c05d121-8e0c-40c4-86d5-207b9f632d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:11.499381 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95e88a-3c63-49bf-9282-8d6c02ab742c None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:11.499923 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95e88a-3c63-49bf-9282-8d6c02ab742c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:11.500797 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05d121-8e0c-40c4-86d5-207b9f632d4f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:11.501846 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05d121-8e0c-40c4-86d5-207b9f632d4f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:11.502521 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05d121-8e0c-40c4-86d5-207b9f632d4f None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:11.504544 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c05d121-8e0c-40c4-86d5-207b9f632d4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:11.505097 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c05d121-8e0c-40c4-86d5-207b9f632d4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:11.507693 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c05d121-8e0c-40c4-86d5-207b9f632d4f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:11.521537 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d95e88a-3c63-49bf-9282-8d6c02ab742c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:11.523484 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d95e88a-3c63-49bf-9282-8d6c02ab742c None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:11.537236 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 343/693] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:17:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:11.538906 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02b014-12d2-4995-9c35-16c5f5c55ebc None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:11.543738 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02b014-12d2-4995-9c35-16c5f5c55ebc None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:11.544284 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02b014-12d2-4995-9c35-16c5f5c55ebc None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:11.549938 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 344/694] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:17:11 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:17:11.551026 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d02b014-12d2-4995-9c35-16c5f5c55ebc None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:11.556814 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-9d95e88a-3c63-49bf-9282-8d6c02ab742c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 02 03:17:11.556814 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:11.556814 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:11.556814 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:11.556814 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:11.556814 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:11.556814 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:11.556814 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:11.556814 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:11.556814 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:11.556814 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:11.556814 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:11.556814 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 03:17:11.556814 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 03:17:11.556814 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 03:17:11.556814 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 03:17:11.557796 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:11.557796 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:11.557796 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 03:17:11.557796 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 03:17:11.557796 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 03:17:11.557796 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 03:17:11.557796 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:11.557796 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:11.557796 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:11.557796 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:11.557796 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:11.557796 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:11.557796 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:11.557796 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:11.557796 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:11.557796 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:11.557796 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:11.557796 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:11.558726 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:11.558726 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:11.558726 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 03:17:11.558726 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 03:17:11.558726 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 03:17:11.558726 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 03:17:11.558726 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 03:17:11.558726 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 03:17:11.558726 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 02 03:17:11.558726 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:11.558726 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 351/695] 10.222.0.60 () {56 vars in 1093 bytes} [Sat Jul 2 03:17:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:11.559821 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a911de-110e-4917-bc8f-a5e19caef909 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:11.559994 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a911de-110e-4917-bc8f-a5e19caef909 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:11.560248 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a911de-110e-4917-bc8f-a5e19caef909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:11.587798 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-c1a911de-110e-4917-bc8f-a5e19caef909 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:17:11.589044 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-c1a911de-110e-4917-bc8f-a5e19caef909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:17:11.652592 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:11.671748 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 352/696] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:17:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 03:17:11.672260 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a911de-110e-4917-bc8f-a5e19caef909 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:11.694895 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d02b014-12d2-4995-9c35-16c5f5c55ebc None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:11.732173 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aec0ad-bb64-458e-9ddb-3c431e844fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:11.732971 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aec0ad-bb64-458e-9ddb-3c431e844fc3 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:11.733310 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aec0ad-bb64-458e-9ddb-3c431e844fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:11.733594 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aec0ad-bb64-458e-9ddb-3c431e844fc3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:11.742325 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aec0ad-bb64-458e-9ddb-3c431e844fc3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:11.744066 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aec0ad-bb64-458e-9ddb-3c431e844fc3 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:11.759661 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-92aec0ad-bb64-458e-9ddb-3c431e844fc3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 03:17:11.759661 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:11.759661 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:11.759661 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:11.759661 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:11.759661 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:11.759661 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:11.759661 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:11.759661 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:11.759661 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:11.759661 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:11.759661 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:11.759661 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 03:17:11.759661 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 03:17:11.759661 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 03:17:11.760705 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 03:17:11.760705 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:11.760705 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:11.760705 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:11.760705 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:11.760705 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:11.760705 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:11.760705 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:11.760705 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:11.760705 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:11.760705 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:11.760705 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:11.760705 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:11.760705 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:11.760705 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:11.760705 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:11.760705 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:11.761624 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 03:17:11.761624 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 03:17:11.761624 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 03:17:11.761624 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 03:17:11.761624 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 03:17:11.761624 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 03:17:11.761624 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 03:17:11.761624 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:11.761624 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 345/697] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Jul 2 03:17:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:11.762571 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aec0ad-bb64-458e-9ddb-3c431e844fc3 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:11.807330 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a911de-110e-4917-bc8f-a5e19caef909 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:11.809015 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:11.847077 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a043014-ce9e-4ff5-900f-4cbc1579b67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:11.847835 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a043014-ce9e-4ff5-900f-4cbc1579b67b None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:11.848113 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a043014-ce9e-4ff5-900f-4cbc1579b67b None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:11.848456 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a043014-ce9e-4ff5-900f-4cbc1579b67b None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:11.849304 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a043014-ce9e-4ff5-900f-4cbc1579b67b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:11.849667 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a043014-ce9e-4ff5-900f-4cbc1579b67b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:11.851132 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a043014-ce9e-4ff5-900f-4cbc1579b67b None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:11.878263 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 353/698] 10.222.0.60 () {56 vars in 1133 bytes} [Sat Jul 2 03:17:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:11.878263 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a043014-ce9e-4ff5-900f-4cbc1579b67b None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:11.906841 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aec0ad-bb64-458e-9ddb-3c431e844fc3 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:11.945696 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d58cb-d454-44b9-a394-640054c15b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:11.946539 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d58cb-d454-44b9-a394-640054c15b28 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:11.947000 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d58cb-d454-44b9-a394-640054c15b28 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:11.947273 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d58cb-d454-44b9-a394-640054c15b28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:11.949566 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:11.960618 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9d58cb-d454-44b9-a394-640054c15b28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:11.962217 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9d58cb-d454-44b9-a394-640054c15b28 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:11.980482 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-bf9d58cb-d454-44b9-a394-640054c15b28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:11.980482 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:11.980482 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:11.980482 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:11.980482 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:11.980482 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:11.980482 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:11.980482 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:11.980482 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:11.980482 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:11.980482 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:11.980482 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:11.980482 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:17:11.980482 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:17:11.980482 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:17:11.981652 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:17:11.981652 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:11.981652 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:11.981652 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:11.981652 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:11.981652 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:11.981652 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:11.981652 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:11.981652 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:11.981652 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:11.981652 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:11.981652 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:11.981652 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:11.981652 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:11.981652 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:11.981652 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:11.981652 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:11.982748 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:17:11.982748 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:17:11.982748 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:11.982748 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:11.982748 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 346/699] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:17:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:11.982748 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d58cb-d454-44b9-a394-640054c15b28 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:12.003086 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a043014-ce9e-4ff5-900f-4cbc1579b67b None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:12.038147 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17480a60-ea3b-4d9d-a0b9-98295521763c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:12.038814 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17480a60-ea3b-4d9d-a0b9-98295521763c None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:12.039091 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17480a60-ea3b-4d9d-a0b9-98295521763c None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:12.039391 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17480a60-ea3b-4d9d-a0b9-98295521763c None admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:12.040547 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17480a60-ea3b-4d9d-a0b9-98295521763c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:12.040854 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17480a60-ea3b-4d9d-a0b9-98295521763c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:12.042334 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17480a60-ea3b-4d9d-a0b9-98295521763c None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:12.054555 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 354/700] 10.222.0.60 () {56 vars in 1148 bytes} [Sat Jul 2 03:17:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:12.055515 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17480a60-ea3b-4d9d-a0b9-98295521763c None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:12.079221 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:12.108553 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d58cb-d454-44b9-a394-640054c15b28 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:12.152185 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e6ebd2-815c-47be-b877-9d52a1a8108c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:12.153325 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e6ebd2-815c-47be-b877-9d52a1a8108c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:12.153760 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e6ebd2-815c-47be-b877-9d52a1a8108c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:12.154492 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e6ebd2-815c-47be-b877-9d52a1a8108c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:12.159913 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17480a60-ea3b-4d9d-a0b9-98295521763c None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:12.197155 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f1cf3b-b0b3-4bdd-8e8c-3a44a83d4236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:12.197821 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1cf3b-b0b3-4bdd-8e8c-3a44a83d4236 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:12.198126 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1cf3b-b0b3-4bdd-8e8c-3a44a83d4236 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:12.198397 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1cf3b-b0b3-4bdd-8e8c-3a44a83d4236 None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:12.199151 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f1cf3b-b0b3-4bdd-8e8c-3a44a83d4236 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:12.199488 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f1cf3b-b0b3-4bdd-8e8c-3a44a83d4236 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:12.200823 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f1cf3b-b0b3-4bdd-8e8c-3a44a83d4236 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:12.213440 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 355/701] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:17:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:12.214594 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f1cf3b-b0b3-4bdd-8e8c-3a44a83d4236 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:12.232081 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:12.250106 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e6ebd2-815c-47be-b877-9d52a1a8108c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:12.252893 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e6ebd2-815c-47be-b877-9d52a1a8108c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:12.298367 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:12.318176 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f1cf3b-b0b3-4bdd-8e8c-3a44a83d4236 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:12.356315 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5475b48e-046b-4ca7-9a39-4c284b2c9651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:12.356976 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475b48e-046b-4ca7-9a39-4c284b2c9651 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:12.357255 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475b48e-046b-4ca7-9a39-4c284b2c9651 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:12.357527 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475b48e-046b-4ca7-9a39-4c284b2c9651 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:12.358354 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5475b48e-046b-4ca7-9a39-4c284b2c9651 None admin] RBAC: Adding query filter params (role.id=3c71d0e875cd4a00849f14227be8f7ed, scope.project.id=e09dc5d9d4904c2b89b0cabed237d55e, user.id=692ec343bf9f4339ba691440f55a6c37) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:12.358669 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5475b48e-046b-4ca7-9a39-4c284b2c9651 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:12.360133 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5475b48e-046b-4ca7-9a39-4c284b2c9651 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:12.366453 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 356/702] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Jul 2 03:17:12 2022] GET /identity/v3/role_assignments?user.id=692ec343bf9f4339ba691440f55a6c37&scope.project.id=e09dc5d9d4904c2b89b0cabed237d55e&role.id=3c71d0e875cd4a00849f14227be8f7ed => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:12.367242 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5475b48e-046b-4ca7-9a39-4c284b2c9651 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:12.383208 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 347/703] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Jul 2 03:17:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 03:17:12.383208 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30804d7c-6450-4b46-b732-155fb2bee8c9 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:12.383208 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30804d7c-6450-4b46-b732-155fb2bee8c9 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:12.383208 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30804d7c-6450-4b46-b732-155fb2bee8c9 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:12.383208 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 348/704] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:17:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:17:12.388833 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30804d7c-6450-4b46-b732-155fb2bee8c9 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:12.501901 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:12.503621 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5475b48e-046b-4ca7-9a39-4c284b2c9651 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:12.525324 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30804d7c-6450-4b46-b732-155fb2bee8c9 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:12.544617 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a8eba8-52a4-4beb-86e9-d743a0fbabae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:12.545367 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a8eba8-52a4-4beb-86e9-d743a0fbabae None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:12.545648 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a8eba8-52a4-4beb-86e9-d743a0fbabae None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:12.545914 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a8eba8-52a4-4beb-86e9-d743a0fbabae None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:12.546678 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a8eba8-52a4-4beb-86e9-d743a0fbabae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:12.548345 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a8eba8-52a4-4beb-86e9-d743a0fbabae None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:12.569014 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:12.570114 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097dc2f-81e7-4e11-976b-db3498d266be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:12.571230 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097dc2f-81e7-4e11-976b-db3498d266be None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:12.571535 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097dc2f-81e7-4e11-976b-db3498d266be None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:12.571918 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097dc2f-81e7-4e11-976b-db3498d266be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:12.575708 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 357/705] 10.222.0.60 () {60 vars in 1132 bytes} [Sat Jul 2 03:17:12 2022] POST /identity/v3/users => generated 254 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:17:12.577423 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1b899-43a6-4129-8e16-00ee366e1e26 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:12.577939 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1b899-43a6-4129-8e16-00ee366e1e26 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:12.578543 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1b899-43a6-4129-8e16-00ee366e1e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:12.585826 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a097dc2f-81e7-4e11-976b-db3498d266be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:12.588227 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a097dc2f-81e7-4e11-976b-db3498d266be None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:12.603522 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-69f1b899-43a6-4129-8e16-00ee366e1e26 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:17:12.605389 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-69f1b899-43a6-4129-8e16-00ee366e1e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:17:12.615103 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-a097dc2f-81e7-4e11-976b-db3498d266be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:12.615103 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:12.615103 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:12.615103 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:12.615103 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:12.615103 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:12.615103 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:12.615103 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:12.615103 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:12.615103 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:12.615103 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:12.615103 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:12.615103 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:17:12.615103 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:17:12.615103 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:17:12.616086 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:17:12.616086 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:12.616086 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:12.616086 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:12.616086 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:12.616086 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:12.616086 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:12.616086 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:12.616086 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:12.616086 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:12.616086 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:12.616086 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:12.616086 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:12.616086 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:12.616086 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:12.616086 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:12.616086 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:12.616965 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:17:12.616965 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:17:12.616965 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:12.616965 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:12.616965 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 349/706] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:17:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:12.622825 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097dc2f-81e7-4e11-976b-db3498d266be None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:12.692529 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 358/707] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:17:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 03:17:12.716803 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f1b899-43a6-4129-8e16-00ee366e1e26 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:12.770275 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097dc2f-81e7-4e11-976b-db3498d266be None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:12.817726 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b33186a-c247-4a5f-ae2d-055ba54cc0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:12.818787 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33186a-c247-4a5f-ae2d-055ba54cc0ff None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:12.819416 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33186a-c247-4a5f-ae2d-055ba54cc0ff None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:12.819892 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33186a-c247-4a5f-ae2d-055ba54cc0ff None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:12.820871 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b33186a-c247-4a5f-ae2d-055ba54cc0ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:12.821530 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b33186a-c247-4a5f-ae2d-055ba54cc0ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:12.827243 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b33186a-c247-4a5f-ae2d-055ba54cc0ff None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:12.835672 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:12.847087 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 350/708] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:17:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:17:12.849073 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b33186a-c247-4a5f-ae2d-055ba54cc0ff None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:12.859951 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f1b899-43a6-4129-8e16-00ee366e1e26 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:12.900161 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:12.907858 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd522ffc-dfac-401a-b45a-209aeed45c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:12.909769 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd522ffc-dfac-401a-b45a-209aeed45c1b None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:12.910051 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd522ffc-dfac-401a-b45a-209aeed45c1b None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:12.910461 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd522ffc-dfac-401a-b45a-209aeed45c1b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:12.911242 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd522ffc-dfac-401a-b45a-209aeed45c1b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:12.913565 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd522ffc-dfac-401a-b45a-209aeed45c1b None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:12.929873 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-fd522ffc-dfac-401a-b45a-209aeed45c1b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 02 03:17:12.929873 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:12.929873 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 02 03:17:12.929873 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 02 03:17:12.929873 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 02 03:17:12.929873 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 02 03:17:12.929873 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 02 03:17:12.929873 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 03:17:12.929873 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 02 03:17:12.929873 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:12.929873 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 03:17:12.929873 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:12.929873 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:12.929873 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:12.929873 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:12.929873 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:12.930890 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:12.930890 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:12.930890 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:12.930890 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:12.930890 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:12.930890 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:12.930890 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:12.930890 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 02 03:17:12.930890 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 02 03:17:12.930890 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 02 03:17:12.930890 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 02 03:17:12.930890 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:12.930890 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:12.930890 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:12.930890 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:12.930890 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:12.931737 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:12.931737 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:12.931737 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:12.931737 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:12.931737 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:12.931737 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:12.931737 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:12.931737 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:12.931737 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:12.931737 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:12.931737 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:12.931737 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 02 03:17:12.931737 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 03:17:12.931737 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 02 03:17:12.931737 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:12.934310 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 359/709] 10.222.0.60 () {56 vars in 1129 bytes} [Sat Jul 2 03:17:12 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 03:17:12.935767 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53938a-11f5-49f3-85a5-b53ac2b5fa5b None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:12.936204 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53938a-11f5-49f3-85a5-b53ac2b5fa5b None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:12.936622 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53938a-11f5-49f3-85a5-b53ac2b5fa5b None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:12.938262 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 360/710] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:17:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:17:12.943040 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac53938a-11f5-49f3-85a5-b53ac2b5fa5b None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:12.990514 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b33186a-c247-4a5f-ae2d-055ba54cc0ff None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:13.033196 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea72daa-e64b-4c5b-8842-459253fe8318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:13.033917 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea72daa-e64b-4c5b-8842-459253fe8318 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:13.034202 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea72daa-e64b-4c5b-8842-459253fe8318 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:13.034477 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea72daa-e64b-4c5b-8842-459253fe8318 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:13.043992 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea72daa-e64b-4c5b-8842-459253fe8318 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:13.045834 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea72daa-e64b-4c5b-8842-459253fe8318 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:13.064143 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac53938a-11f5-49f3-85a5-b53ac2b5fa5b None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:13.064920 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-7ea72daa-e64b-4c5b-8842-459253fe8318 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 03:17:13.064920 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:13.064920 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:13.064920 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:13.064920 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:13.064920 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:13.064920 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:13.064920 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:13.064920 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:13.064920 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:13.064920 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:13.064920 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:13.064920 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 03:17:13.064920 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 03:17:13.064920 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 03:17:13.065925 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 03:17:13.065925 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:13.065925 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:13.065925 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:13.065925 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:13.065925 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:13.065925 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:13.065925 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:13.065925 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:13.065925 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:13.065925 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:13.065925 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:13.065925 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:13.065925 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:13.065925 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:13.065925 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:13.065925 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:13.066954 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 03:17:13.066954 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 03:17:13.066954 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 03:17:13.066954 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 03:17:13.066954 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 03:17:13.066954 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 03:17:13.066954 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 03:17:13.066954 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:13.066954 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 351/711] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Jul 2 03:17:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:13.071150 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a28ba0-72ec-4eee-9106-d017dfef53fa None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:13.071150 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a28ba0-72ec-4eee-9106-d017dfef53fa None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:13.071150 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a28ba0-72ec-4eee-9106-d017dfef53fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:13.093630 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-21a28ba0-72ec-4eee-9106-d017dfef53fa None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:17:13.095291 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-21a28ba0-72ec-4eee-9106-d017dfef53fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:17:13.116795 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3991a68-ca40-4b25-8740-5a28ef6d608a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:13.117578 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3991a68-ca40-4b25-8740-5a28ef6d608a None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:13.117860 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3991a68-ca40-4b25-8740-5a28ef6d608a None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:13.118133 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3991a68-ca40-4b25-8740-5a28ef6d608a None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:13.118912 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3991a68-ca40-4b25-8740-5a28ef6d608a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:13.119243 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3991a68-ca40-4b25-8740-5a28ef6d608a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:13.120792 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3991a68-ca40-4b25-8740-5a28ef6d608a None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:13.127208 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 361/712] 10.222.0.60 () {56 vars in 1124 bytes} [Sat Jul 2 03:17:12 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:17:13.128871 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3991a68-ca40-4b25-8740-5a28ef6d608a None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:13.169187 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 352/713] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:17:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 03:17:13.170475 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a28ba0-72ec-4eee-9106-d017dfef53fa None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:13.209261 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:13.231578 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:13.268705 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3991a68-ca40-4b25-8740-5a28ef6d608a None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:13.279299 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a28ba0-72ec-4eee-9106-d017dfef53fa None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:13.315144 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a960e28-3980-42cb-9b28-86a4ac0e1493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:13.315735 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a960e28-3980-42cb-9b28-86a4ac0e1493 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:13.316014 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a960e28-3980-42cb-9b28-86a4ac0e1493 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:13.316287 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a960e28-3980-42cb-9b28-86a4ac0e1493 None admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:13.317598 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a960e28-3980-42cb-9b28-86a4ac0e1493 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:13.317913 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a960e28-3980-42cb-9b28-86a4ac0e1493 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:13.319369 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a960e28-3980-42cb-9b28-86a4ac0e1493 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:13.322987 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe82bf72-b0f6-4ad4-8dd8-4cbbc6ab1015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:13.323913 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82bf72-b0f6-4ad4-8dd8-4cbbc6ab1015 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:13.324402 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82bf72-b0f6-4ad4-8dd8-4cbbc6ab1015 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:13.324861 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82bf72-b0f6-4ad4-8dd8-4cbbc6ab1015 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:13.325757 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe82bf72-b0f6-4ad4-8dd8-4cbbc6ab1015 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:13.326256 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe82bf72-b0f6-4ad4-8dd8-4cbbc6ab1015 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:13.327964 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe82bf72-b0f6-4ad4-8dd8-4cbbc6ab1015 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:13.336772 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 362/714] 10.222.0.60 () {56 vars in 1148 bytes} [Sat Jul 2 03:17:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:13.336772 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a960e28-3980-42cb-9b28-86a4ac0e1493 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:13.339757 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 353/715] 10.222.0.60 () {56 vars in 1124 bytes} [Sat Jul 2 03:17:13 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:13.340895 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe82bf72-b0f6-4ad4-8dd8-4cbbc6ab1015 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:13.455678 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:13.507794 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a960e28-3980-42cb-9b28-86a4ac0e1493 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:13.524126 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe82bf72-b0f6-4ad4-8dd8-4cbbc6ab1015 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:13.553977 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:13.563147 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e95e2-ec25-4599-8817-78096394a401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:13.563147 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e95e2-ec25-4599-8817-78096394a401 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:13.563147 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e95e2-ec25-4599-8817-78096394a401 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:13.563147 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e95e2-ec25-4599-8817-78096394a401 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:13.563588 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99e95e2-ec25-4599-8817-78096394a401 None admin] RBAC: Adding query filter params (role.id=5dcd130cda6c490595e862dc2348e83d, scope.project.id=e09dc5d9d4904c2b89b0cabed237d55e, user.id=13530240e2d446b6bf26a431d001362a) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:13.563588 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99e95e2-ec25-4599-8817-78096394a401 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:13.564538 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99e95e2-ec25-4599-8817-78096394a401 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:13.571211 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 354/716] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Jul 2 03:17:13 2022] GET /identity/v3/role_assignments?user.id=13530240e2d446b6bf26a431d001362a&scope.project.id=e09dc5d9d4904c2b89b0cabed237d55e&role.id=5dcd130cda6c490595e862dc2348e83d => generated 259 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:13.588238 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be25dd7-b256-4204-a8ba-f38dd0b041de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:13.589159 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be25dd7-b256-4204-a8ba-f38dd0b041de None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:13.589433 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be25dd7-b256-4204-a8ba-f38dd0b041de None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:13.589701 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be25dd7-b256-4204-a8ba-f38dd0b041de None admin] PATH_INFO: `/v3/services/network` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:13.590369 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be25dd7-b256-4204-a8ba-f38dd0b041de None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:13.592472 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be25dd7-b256-4204-a8ba-f38dd0b041de None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:13.605374 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-1be25dd7-b256-4204-a8ba-f38dd0b041de None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 02 03:17:13.605374 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:13.605374 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 02 03:17:13.605374 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 02 03:17:13.605374 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 02 03:17:13.605374 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 02 03:17:13.605374 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 02 03:17:13.605374 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 03:17:13.605374 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 02 03:17:13.605374 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:13.605374 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 03:17:13.605374 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:13.605374 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:13.605374 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:13.605374 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:13.605374 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:13.605374 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:13.606425 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:13.606425 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:13.606425 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:13.606425 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:13.606425 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:13.606425 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:13.606425 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 02 03:17:13.606425 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 02 03:17:13.606425 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 02 03:17:13.606425 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 02 03:17:13.606425 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:13.606425 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:13.606425 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:13.606425 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:13.606425 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:13.606425 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:13.607249 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:13.607249 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:13.607249 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:13.607249 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:13.607249 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:13.607249 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:13.607249 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:13.607249 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:13.607249 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:13.607249 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:13.607249 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 02 03:17:13.607249 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 03:17:13.607249 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 02 03:17:13.607249 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:13.607973 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 363/717] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Jul 2 03:17:13 2022] GET /identity/v3/services/network => generated 88 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:13.613545 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e95e2-ec25-4599-8817-78096394a401 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:13.724980 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e95e2-ec25-4599-8817-78096394a401 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:13.743005 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:13.762923 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceaea06-e331-450d-bd9a-06dd0df42c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:13.763634 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceaea06-e331-450d-bd9a-06dd0df42c41 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:13.763916 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceaea06-e331-450d-bd9a-06dd0df42c41 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:13.764188 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceaea06-e331-450d-bd9a-06dd0df42c41 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:13.764909 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceaea06-e331-450d-bd9a-06dd0df42c41 None admin] RBAC: Adding query filter params (name=network) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:13.765214 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceaea06-e331-450d-bd9a-06dd0df42c41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:13.766601 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceaea06-e331-450d-bd9a-06dd0df42c41 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:13.771877 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 355/718] 10.222.0.60 () {56 vars in 1112 bytes} [Sat Jul 2 03:17:13 2022] GET /identity/v3/services?name=network => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:13.778605 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be25dd7-b256-4204-a8ba-f38dd0b041de None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:13.890987 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be25dd7-b256-4204-a8ba-f38dd0b041de None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:13.941124 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f821b535-ed29-4edb-b6df-2eac139f2bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:13.941796 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f821b535-ed29-4edb-b6df-2eac139f2bb8 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:13.942075 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f821b535-ed29-4edb-b6df-2eac139f2bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:13.942343 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f821b535-ed29-4edb-b6df-2eac139f2bb8 None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:13.943059 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f821b535-ed29-4edb-b6df-2eac139f2bb8 None admin] RBAC: Adding query filter params (type=network) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:13.943383 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f821b535-ed29-4edb-b6df-2eac139f2bb8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:13.944821 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f821b535-ed29-4edb-b6df-2eac139f2bb8 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:13.951984 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 364/719] 10.222.0.60 () {56 vars in 1112 bytes} [Sat Jul 2 03:17:13 2022] GET /identity/v3/services?type=network => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:17:14.960112 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4af572-b428-487f-8d8f-c86498a64bec None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:14.960649 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4af572-b428-487f-8d8f-c86498a64bec None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:14.960756 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4af572-b428-487f-8d8f-c86498a64bec None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:14.962394 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 356/720] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:17:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:17:14.967890 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7795162-9e24-4472-bde9-87ece7c9aab0 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:14.968288 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7795162-9e24-4472-bde9-87ece7c9aab0 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:14.968450 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7795162-9e24-4472-bde9-87ece7c9aab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:14.985348 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-f7795162-9e24-4472-bde9-87ece7c9aab0 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:17:14.986556 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-f7795162-9e24-4472-bde9-87ece7c9aab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:17:15.029187 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:15.059692 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 365/721] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:17:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 03:17:15.099993 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4af572-b428-487f-8d8f-c86498a64bec None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:15.177905 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63be90-de63-4d4e-ae88-49f5f1d79e4a None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:15.178504 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63be90-de63-4d4e-ae88-49f5f1d79e4a None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:15.178789 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63be90-de63-4d4e-ae88-49f5f1d79e4a None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:15.180881 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 366/722] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:17:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:17:15.185727 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17cd9c0-86f2-40e9-98aa-cacc39186593 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:15.186010 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17cd9c0-86f2-40e9-98aa-cacc39186593 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:15.186284 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17cd9c0-86f2-40e9-98aa-cacc39186593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:15.215610 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-b17cd9c0-86f2-40e9-98aa-cacc39186593 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:17:15.218349 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-b17cd9c0-86f2-40e9-98aa-cacc39186593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:17:15.244508 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4af572-b428-487f-8d8f-c86498a64bec None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:15.305357 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa106f-e68e-4667-88d7-1f9b68bd486f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:15.307344 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa106f-e68e-4667-88d7-1f9b68bd486f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:15.307818 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa106f-e68e-4667-88d7-1f9b68bd486f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:15.308278 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa106f-e68e-4667-88d7-1f9b68bd486f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:15.329727 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 367/723] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:17:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 03:17:15.346114 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa106f-e68e-4667-88d7-1f9b68bd486f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:17:15.353867 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17cd9c0-86f2-40e9-98aa-cacc39186593 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:15.354216 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-94fa106f-e68e-4667-88d7-1f9b68bd486f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 03:17:15.354216 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:15.354216 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:15.354216 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:15.354216 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:15.354216 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:15.354216 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:15.354216 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:15.354216 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:15.354216 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:15.354216 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:15.354216 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:15.354216 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:17:15.354216 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:17:15.354216 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:17:15.354216 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:17:15.355114 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:17:15.355114 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:17:15.355114 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:17:15.355114 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:17:15.355114 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:15.355114 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:15.355114 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:15.355114 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:15.355114 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:15.355114 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:15.355114 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:15.355114 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:15.355114 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:15.355114 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:15.355114 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:15.355114 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:15.355990 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:15.355990 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:15.355990 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:15.355990 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:15.355990 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:17:15.355990 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:17:15.355990 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:17:15.355990 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:17:15.355990 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:17:15.355990 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:17:15.355990 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 03:17:15.355990 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:15.363594 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 357/724] 10.222.0.60 () {56 vars in 1096 bytes} [Sat Jul 2 03:17:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:15.377319 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa106f-e68e-4667-88d7-1f9b68bd486f None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:15.456616 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:15.564796 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17cd9c0-86f2-40e9-98aa-cacc39186593 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:15.571509 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa106f-e68e-4667-88d7-1f9b68bd486f None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:15.582705 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:15.626889 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e861b8c-2363-4e9a-8651-0d63408063e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:15.628299 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e861b8c-2363-4e9a-8651-0d63408063e2 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:15.628683 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e861b8c-2363-4e9a-8651-0d63408063e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:15.629063 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e861b8c-2363-4e9a-8651-0d63408063e2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:15.641052 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e861b8c-2363-4e9a-8651-0d63408063e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:17:15.649426 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-9e861b8c-2363-4e9a-8651-0d63408063e2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 02 03:17:15.649426 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:15.649426 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:15.649426 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:15.649426 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:15.649426 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:15.649426 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:15.649426 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:15.649426 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:15.649426 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:15.649426 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:15.649426 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:15.649426 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:17:15.649426 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:17:15.649426 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:17:15.649426 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:17:15.651687 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:17:15.651687 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:17:15.651687 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:17:15.651687 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:17:15.651687 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:15.651687 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:15.651687 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:15.651687 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:15.651687 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:15.651687 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:15.651687 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:15.651687 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:15.651687 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:15.651687 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:15.651687 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:15.651687 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:15.653728 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:15.653728 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:15.653728 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:15.653728 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:15.653728 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:17:15.653728 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:17:15.653728 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:17:15.653728 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:17:15.653728 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:17:15.653728 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:17:15.653728 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 02 03:17:15.653728 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:15.653728 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 368/725] 10.222.0.60 () {56 vars in 1102 bytes} [Sat Jul 2 03:17:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 03:17:15.661452 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e861b8c-2363-4e9a-8651-0d63408063e2 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:15.677162 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d6effc-567b-4695-9593-3630fdd4fe44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:15.677842 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d6effc-567b-4695-9593-3630fdd4fe44 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:15.678119 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d6effc-567b-4695-9593-3630fdd4fe44 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:15.678388 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d6effc-567b-4695-9593-3630fdd4fe44 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:15.679164 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d6effc-567b-4695-9593-3630fdd4fe44 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:15.679469 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d6effc-567b-4695-9593-3630fdd4fe44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:15.680909 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d6effc-567b-4695-9593-3630fdd4fe44 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:15.702626 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 358/726] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Jul 2 03:17:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:17:15.716706 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d6effc-567b-4695-9593-3630fdd4fe44 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:15.778663 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e861b8c-2363-4e9a-8651-0d63408063e2 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:15.818532 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2bc4ba-727e-42a8-b0c4-63d10e3bcb7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:15.819662 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2bc4ba-727e-42a8-b0c4-63d10e3bcb7b None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:15.820003 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2bc4ba-727e-42a8-b0c4-63d10e3bcb7b None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:15.820282 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2bc4ba-727e-42a8-b0c4-63d10e3bcb7b None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:15.821049 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2bc4ba-727e-42a8-b0c4-63d10e3bcb7b None admin] RBAC: Adding query filter params (name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:15.821353 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2bc4ba-727e-42a8-b0c4-63d10e3bcb7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:15.822790 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2bc4ba-727e-42a8-b0c4-63d10e3bcb7b None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:15.833201 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 369/727] 10.222.0.60 () {56 vars in 1103 bytes} [Sat Jul 2 03:17:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:17:15.838818 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2bc4ba-727e-42a8-b0c4-63d10e3bcb7b None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:15.873832 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:15.957226 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d6effc-567b-4695-9593-3630fdd4fe44 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:15.959026 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:15.959781 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2bc4ba-727e-42a8-b0c4-63d10e3bcb7b None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:15.996483 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89db84a-023e-4846-80da-2618efec62a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:15.997286 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89db84a-023e-4846-80da-2618efec62a5 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:15.997572 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89db84a-023e-4846-80da-2618efec62a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:15.997843 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89db84a-023e-4846-80da-2618efec62a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:16.004744 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df37bb-cdda-4e8f-9be3-1550ecb8d058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:16.006051 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df37bb-cdda-4e8f-9be3-1550ecb8d058 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:16.006329 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df37bb-cdda-4e8f-9be3-1550ecb8d058 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:16.006599 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df37bb-cdda-4e8f-9be3-1550ecb8d058 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:16.009621 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89db84a-023e-4846-80da-2618efec62a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:16.011380 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89db84a-023e-4846-80da-2618efec62a5 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:16.019259 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0df37bb-cdda-4e8f-9be3-1550ecb8d058 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:16.021465 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0df37bb-cdda-4e8f-9be3-1550ecb8d058 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:16.029771 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-c89db84a-023e-4846-80da-2618efec62a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:16.029771 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:16.029771 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:16.029771 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:16.029771 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:16.029771 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:16.029771 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:16.029771 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:16.029771 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:16.029771 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:16.029771 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:16.029771 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:16.029771 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:17:16.029771 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:17:16.029771 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:17:16.031791 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:17:16.031791 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:16.031791 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:16.031791 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:16.031791 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:16.031791 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:16.031791 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:16.031791 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:16.031791 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:16.031791 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:16.031791 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:16.031791 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:16.031791 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:16.031791 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:16.031791 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:16.031791 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:16.031791 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:16.033871 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:17:16.033871 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:17:16.033871 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:16.033871 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:16.033871 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 359/728] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:17:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 03:17:16.033871 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6c170-41fd-4615-bcad-871e5ac1a23b None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:16.033871 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6c170-41fd-4615-bcad-871e5ac1a23b None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:16.033871 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6c170-41fd-4615-bcad-871e5ac1a23b None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:16.038593 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 360/729] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:17:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:17:16.040963 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecdec4a-2fa4-4bbc-83b0-32f327b1b66e None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:16.041250 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecdec4a-2fa4-4bbc-83b0-32f327b1b66e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:16.041652 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecdec4a-2fa4-4bbc-83b0-32f327b1b66e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:16.044355 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-f0df37bb-cdda-4e8f-9be3-1550ecb8d058 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:16.044355 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:16.044355 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:16.044355 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:16.044355 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:16.044355 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:16.044355 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:16.044355 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:16.044355 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:16.044355 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:16.044355 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:16.044355 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:16.044355 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:17:16.044355 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:17:16.044355 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:17:16.046309 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:17:16.046309 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:16.046309 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:16.046309 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:16.046309 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:16.046309 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:16.046309 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:16.046309 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:16.046309 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:16.046309 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:16.046309 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:16.046309 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:16.046309 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:16.046309 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:16.046309 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:16.046309 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:16.046309 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:16.048053 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:17:16.048053 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:17:16.048053 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:16.048053 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:16.048053 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 370/730] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:17:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:16.048053 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df37bb-cdda-4e8f-9be3-1550ecb8d058 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:16.063982 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-4ecdec4a-2fa4-4bbc-83b0-32f327b1b66e None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:17:16.065435 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4ecdec4a-2fa4-4bbc-83b0-32f327b1b66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:17:16.138276 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 361/731] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:17:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 03:17:16.139342 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecdec4a-2fa4-4bbc-83b0-32f327b1b66e None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:16.155504 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:16.178928 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df37bb-cdda-4e8f-9be3-1550ecb8d058 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:16.222680 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df7d8de-cf5a-4675-bebb-a17c7b81cb12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:16.223381 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df7d8de-cf5a-4675-bebb-a17c7b81cb12 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:16.223668 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df7d8de-cf5a-4675-bebb-a17c7b81cb12 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:16.223940 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df7d8de-cf5a-4675-bebb-a17c7b81cb12 None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:16.224693 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df7d8de-cf5a-4675-bebb-a17c7b81cb12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:16.224986 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df7d8de-cf5a-4675-bebb-a17c7b81cb12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:16.226335 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df7d8de-cf5a-4675-bebb-a17c7b81cb12 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:16.228083 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:16.240596 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 371/732] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:17:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:16.241924 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b3c8b-3b80-4530-8fdb-7e9003b37a47 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:16.242208 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b3c8b-3b80-4530-8fdb-7e9003b37a47 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:16.242480 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b3c8b-3b80-4530-8fdb-7e9003b37a47 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:16.247159 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 372/733] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:17:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:17:16.247159 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b3c8b-3b80-4530-8fdb-7e9003b37a47 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:16.253391 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecdec4a-2fa4-4bbc-83b0-32f327b1b66e None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:16.288563 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902a2b89-3336-471a-9007-49c634f78a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:16.289225 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a2b89-3336-471a-9007-49c634f78a82 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:16.289872 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a2b89-3336-471a-9007-49c634f78a82 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:16.290144 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a2b89-3336-471a-9007-49c634f78a82 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:16.291282 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902a2b89-3336-471a-9007-49c634f78a82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:16.291679 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902a2b89-3336-471a-9007-49c634f78a82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:16.293422 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902a2b89-3336-471a-9007-49c634f78a82 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:16.304921 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 362/734] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:17:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:16.310106 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902a2b89-3336-471a-9007-49c634f78a82 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:16.355184 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b3c8b-3b80-4530-8fdb-7e9003b37a47 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:16.396616 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3a0ae5-3646-4af0-8d55-0a4a850e09d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:16.397211 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a0ae5-3646-4af0-8d55-0a4a850e09d9 None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:16.397493 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a0ae5-3646-4af0-8d55-0a4a850e09d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:16.397765 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a0ae5-3646-4af0-8d55-0a4a850e09d9 None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:16.398522 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3a0ae5-3646-4af0-8d55-0a4a850e09d9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:16.399900 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3a0ae5-3646-4af0-8d55-0a4a850e09d9 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:16.410648 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:16.427156 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 373/735] 10.222.0.60 () {60 vars in 1141 bytes} [Sat Jul 2 03:17:16 2022] POST /identity/v3/services => generated 251 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:17:16.427156 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73721ff6-3064-4e21-bc98-06fdddf5d826 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:16.427156 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73721ff6-3064-4e21-bc98-06fdddf5d826 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:16.427156 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73721ff6-3064-4e21-bc98-06fdddf5d826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:16.436954 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-73721ff6-3064-4e21-bc98-06fdddf5d826 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:17:16.438175 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-73721ff6-3064-4e21-bc98-06fdddf5d826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:17:16.439587 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902a2b89-3336-471a-9007-49c634f78a82 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:16.484198 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093acde1-5ac0-4b15-8026-58fc8b6e378a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:16.485026 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093acde1-5ac0-4b15-8026-58fc8b6e378a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:16.485308 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093acde1-5ac0-4b15-8026-58fc8b6e378a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:16.485579 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093acde1-5ac0-4b15-8026-58fc8b6e378a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:16.495615 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093acde1-5ac0-4b15-8026-58fc8b6e378a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:16.497255 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093acde1-5ac0-4b15-8026-58fc8b6e378a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:16.500239 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:16.513443 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-093acde1-5ac0-4b15-8026-58fc8b6e378a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 02 03:17:16.513443 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:16.513443 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:16.513443 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:16.513443 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:16.513443 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:16.513443 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:16.513443 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:16.513443 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:16.513443 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:16.513443 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:16.513443 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:16.513443 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 03:17:16.513443 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 03:17:16.513443 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 03:17:16.513443 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 03:17:16.514492 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:16.514492 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:16.514492 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 03:17:16.514492 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 03:17:16.514492 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 03:17:16.514492 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 03:17:16.514492 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:16.514492 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:16.514492 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:16.514492 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:16.514492 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:16.514492 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:16.514492 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:16.514492 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:16.514492 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:16.514492 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:16.514492 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:16.514492 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:16.520646 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:16.520646 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:16.520646 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 03:17:16.520646 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 03:17:16.520646 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 03:17:16.520646 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 03:17:16.520646 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 03:17:16.520646 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 03:17:16.520646 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 02 03:17:16.520646 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:16.521254 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 374/736] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:17:16 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 03:17:16.521254 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73721ff6-3064-4e21-bc98-06fdddf5d826 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:16.521384 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 363/737] 10.222.0.60 () {56 vars in 1096 bytes} [Sat Jul 2 03:17:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:16.521384 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5122fc-b898-475c-8500-dd18f5efb089 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:16.521384 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5122fc-b898-475c-8500-dd18f5efb089 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:16.521576 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5122fc-b898-475c-8500-dd18f5efb089 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:16.527276 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 364/738] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:17:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:17:16.528176 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5122fc-b898-475c-8500-dd18f5efb089 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:16.637301 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73721ff6-3064-4e21-bc98-06fdddf5d826 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:16.649038 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5122fc-b898-475c-8500-dd18f5efb089 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:16.669073 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:16.675869 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d17e68a-5737-4548-86d1-b1836acdca08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:16.676684 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17e68a-5737-4548-86d1-b1836acdca08 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:16.676956 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17e68a-5737-4548-86d1-b1836acdca08 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:16.677220 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17e68a-5737-4548-86d1-b1836acdca08 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:16.684674 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d17e68a-5737-4548-86d1-b1836acdca08 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:16.686120 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d17e68a-5737-4548-86d1-b1836acdca08 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:16.686402 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b0a285-1c2f-42d1-95c5-4a760cb6d1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:16.687072 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b0a285-1c2f-42d1-95c5-4a760cb6d1c8 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:16.687381 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b0a285-1c2f-42d1-95c5-4a760cb6d1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:16.687650 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b0a285-1c2f-42d1-95c5-4a760cb6d1c8 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:16.688483 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b0a285-1c2f-42d1-95c5-4a760cb6d1c8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:16.688792 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b0a285-1c2f-42d1-95c5-4a760cb6d1c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:16.690217 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b0a285-1c2f-42d1-95c5-4a760cb6d1c8 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:16.702252 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-3d17e68a-5737-4548-86d1-b1836acdca08 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 02 03:17:16.702252 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:16.702252 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:16.702252 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:16.702252 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:16.702252 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:16.702252 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:16.702252 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:16.702252 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:16.702252 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:16.702252 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:16.702252 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:16.702252 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 03:17:16.702252 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 03:17:16.702252 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 03:17:16.702252 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 03:17:16.703241 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:16.703241 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:16.703241 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 03:17:16.703241 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 03:17:16.703241 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 03:17:16.703241 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 03:17:16.703241 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:16.703241 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:16.703241 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:16.703241 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:16.703241 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:16.703241 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:16.703241 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:16.703241 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:16.703241 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:16.703241 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:16.703241 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:16.703241 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:16.704208 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:16.704208 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:16.704208 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 03:17:16.704208 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 03:17:16.704208 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 03:17:16.704208 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 03:17:16.704208 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 03:17:16.704208 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 03:17:16.704208 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 02 03:17:16.704208 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:16.707478 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 375/739] 10.222.0.60 () {56 vars in 1117 bytes} [Sat Jul 2 03:17:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:16.708318 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 365/740] 10.222.0.60 () {56 vars in 1135 bytes} [Sat Jul 2 03:17:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:16.709135 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b0a285-1c2f-42d1-95c5-4a760cb6d1c8 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:16.709724 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd271af-0fb9-4c23-b7f0-09cb0020d169 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:16.710223 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd271af-0fb9-4c23-b7f0-09cb0020d169 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:16.710705 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd271af-0fb9-4c23-b7f0-09cb0020d169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:16.730751 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-4dd271af-0fb9-4c23-b7f0-09cb0020d169 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:17:16.732007 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-4dd271af-0fb9-4c23-b7f0-09cb0020d169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:17:16.768825 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:16.802078 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 376/741] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:17:16 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 03:17:16.803329 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd271af-0fb9-4c23-b7f0-09cb0020d169 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:16.824886 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b0a285-1c2f-42d1-95c5-4a760cb6d1c8 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:16.861066 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b60a3e-bc6c-46dd-9577-d339b735119f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:16.861863 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b60a3e-bc6c-46dd-9577-d339b735119f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:16.862151 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b60a3e-bc6c-46dd-9577-d339b735119f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:16.862419 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b60a3e-bc6c-46dd-9577-d339b735119f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:16.872766 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b60a3e-bc6c-46dd-9577-d339b735119f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:17:16.880363 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-a4b60a3e-bc6c-46dd-9577-d339b735119f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 03:17:16.880363 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:16.880363 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:16.880363 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:16.880363 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:16.880363 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:16.880363 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:16.880363 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:16.880363 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:16.880363 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:16.880363 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:16.880363 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:16.880363 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:17:16.880363 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:17:16.880363 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:17:16.880363 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:17:16.881277 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:17:16.881277 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:17:16.881277 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:17:16.881277 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:17:16.881277 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:16.881277 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:16.881277 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:16.881277 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:16.881277 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:16.881277 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:16.881277 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:16.881277 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:16.881277 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:16.881277 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:16.881277 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:16.881277 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:16.882099 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:16.882099 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:16.882099 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:16.882099 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:16.882099 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:17:16.882099 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:17:16.882099 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:17:16.882099 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:17:16.882099 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:17:16.882099 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:17:16.882099 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 03:17:16.882099 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:16.882099 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 366/742] 10.222.0.60 () {56 vars in 1096 bytes} [Sat Jul 2 03:17:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:16.882770 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b60a3e-bc6c-46dd-9577-d339b735119f None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:16.920118 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd271af-0fb9-4c23-b7f0-09cb0020d169 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:16.942126 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:16.957720 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98398ec-ce3f-4f35-be3b-441f2b576bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:16.958489 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98398ec-ce3f-4f35-be3b-441f2b576bd0 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:16.958773 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98398ec-ce3f-4f35-be3b-441f2b576bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:16.959044 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98398ec-ce3f-4f35-be3b-441f2b576bd0 None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:16.959914 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98398ec-ce3f-4f35-be3b-441f2b576bd0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:16.960222 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98398ec-ce3f-4f35-be3b-441f2b576bd0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:16.961652 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98398ec-ce3f-4f35-be3b-441f2b576bd0 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:16.984009 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 377/743] 10.222.0.60 () {56 vars in 1149 bytes} [Sat Jul 2 03:17:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:16.984009 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98398ec-ce3f-4f35-be3b-441f2b576bd0 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:16.993069 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b60a3e-bc6c-46dd-9577-d339b735119f None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:17.012300 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:17.031507 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22f3a2c-4d25-44f9-9466-5eefee9b9a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:17.032166 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22f3a2c-4d25-44f9-9466-5eefee9b9a8c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:17.032448 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22f3a2c-4d25-44f9-9466-5eefee9b9a8c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:17.032722 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22f3a2c-4d25-44f9-9466-5eefee9b9a8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:17.087898 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98398ec-ce3f-4f35-be3b-441f2b576bd0 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:17.106388 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22f3a2c-4d25-44f9-9466-5eefee9b9a8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:17.107898 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22f3a2c-4d25-44f9-9466-5eefee9b9a8c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:17.128585 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def7eb0a-d560-4569-bca8-cc6de3d6c3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:17.129260 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def7eb0a-d560-4569-bca8-cc6de3d6c3b5 None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:17.129542 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def7eb0a-d560-4569-bca8-cc6de3d6c3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:17.129812 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def7eb0a-d560-4569-bca8-cc6de3d6c3b5 None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:17.130547 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def7eb0a-d560-4569-bca8-cc6de3d6c3b5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:17.131976 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def7eb0a-d560-4569-bca8-cc6de3d6c3b5 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:17.155161 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 378/744] 10.222.0.60 () {60 vars in 1141 bytes} [Sat Jul 2 03:17:16 2022] POST /identity/v3/services => generated 240 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:17:17.155161 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def7eb0a-d560-4569-bca8-cc6de3d6c3b5 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:17.199079 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:17.255345 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 367/745] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Jul 2 03:17:16 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 03:17:17.256281 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22f3a2c-4d25-44f9-9466-5eefee9b9a8c None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:17.276678 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:17.291035 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def7eb0a-d560-4569-bca8-cc6de3d6c3b5 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:17.329614 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10048da-9d53-44f5-9681-c9a65f561b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:17.330308 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10048da-9d53-44f5-9681-c9a65f561b38 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:17.330586 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10048da-9d53-44f5-9681-c9a65f561b38 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:17.330864 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10048da-9d53-44f5-9681-c9a65f561b38 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:17.331652 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10048da-9d53-44f5-9681-c9a65f561b38 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:17.331961 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10048da-9d53-44f5-9681-c9a65f561b38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:17.333371 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10048da-9d53-44f5-9681-c9a65f561b38 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:17.344840 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 379/746] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Jul 2 03:17:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:17.345677 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10048da-9d53-44f5-9681-c9a65f561b38 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:17.371468 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22f3a2c-4d25-44f9-9466-5eefee9b9a8c None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:17.409213 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948b3e57-5453-457b-94e0-98313daaa6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:17.409875 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b3e57-5453-457b-94e0-98313daaa6a4 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:17.410154 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b3e57-5453-457b-94e0-98313daaa6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:17.410426 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b3e57-5453-457b-94e0-98313daaa6a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:17.483101 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10048da-9d53-44f5-9681-c9a65f561b38 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:17.495240 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948b3e57-5453-457b-94e0-98313daaa6a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:17.497572 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948b3e57-5453-457b-94e0-98313daaa6a4 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:17.499510 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:17.518144 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a0caf9-5b59-4e6c-9595-dfeab8b98e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:17.519090 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0caf9-5b59-4e6c-9595-dfeab8b98e65 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:17.519491 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0caf9-5b59-4e6c-9595-dfeab8b98e65 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:17.519860 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0caf9-5b59-4e6c-9595-dfeab8b98e65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:17.520970 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:17.534140 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a0caf9-5b59-4e6c-9595-dfeab8b98e65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:17.535731 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a0caf9-5b59-4e6c-9595-dfeab8b98e65 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:17.559278 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-92a0caf9-5b59-4e6c-9595-dfeab8b98e65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:17.559278 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:17.559278 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:17.559278 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:17.559278 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:17.559278 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:17.559278 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:17.559278 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:17.559278 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:17.559278 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:17.559278 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:17.559278 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:17.559278 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:17:17.559278 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:17:17.559278 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:17:17.560462 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:17:17.560462 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:17.560462 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:17.560462 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:17.560462 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:17.560462 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:17.560462 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:17.560462 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:17.560462 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:17.560462 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:17.560462 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:17.560462 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:17.560462 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:17.560462 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:17.560462 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:17.560462 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:17.560462 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:17.561450 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:17:17.561450 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:17:17.561450 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:17.561450 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:17.562597 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 380/747] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:17:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:17.563678 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a0caf9-5b59-4e6c-9595-dfeab8b98e65 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:17.632709 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 368/748] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Jul 2 03:17:17 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 02 03:17:17.633625 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948b3e57-5453-457b-94e0-98313daaa6a4 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:17.684154 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a0caf9-5b59-4e6c-9595-dfeab8b98e65 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:17.725419 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93861fb-e8fd-4428-a333-4bf78331d0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:17.726227 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93861fb-e8fd-4428-a333-4bf78331d0df None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:17.726511 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93861fb-e8fd-4428-a333-4bf78331d0df None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:17.727082 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93861fb-e8fd-4428-a333-4bf78331d0df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:17.735753 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948b3e57-5453-457b-94e0-98313daaa6a4 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:17.740829 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93861fb-e8fd-4428-a333-4bf78331d0df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:17.742283 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93861fb-e8fd-4428-a333-4bf78331d0df None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:17.752944 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:17.754661 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:17.765671 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-d93861fb-e8fd-4428-a333-4bf78331d0df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:17.765671 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:17.765671 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:17.765671 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:17.765671 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:17.765671 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:17.765671 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:17.765671 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:17.765671 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:17.765671 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:17.765671 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:17.765671 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:17.765671 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:17:17.765671 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:17:17.765671 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:17:17.766583 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:17:17.766583 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:17.766583 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:17.766583 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:17.766583 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:17.766583 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:17.766583 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:17.766583 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:17.766583 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:17.766583 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:17.766583 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:17.766583 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:17.766583 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:17.766583 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:17.766583 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:17.766583 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:17.766583 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:17.767508 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:17:17.767508 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:17:17.767508 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:17.767508 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:17.771861 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 381/749] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:17:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:17.772985 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93861fb-e8fd-4428-a333-4bf78331d0df None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:17.780674 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d66ff-faef-4100-971a-e8251f93d221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:17.781632 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d66ff-faef-4100-971a-e8251f93d221 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:17.782125 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d66ff-faef-4100-971a-e8251f93d221 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:17.782586 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d66ff-faef-4100-971a-e8251f93d221 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:17.783948 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892d66ff-faef-4100-971a-e8251f93d221 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:17.784451 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892d66ff-faef-4100-971a-e8251f93d221 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:17.786440 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892d66ff-faef-4100-971a-e8251f93d221 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:17.806171 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 369/750] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:17:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:17.806171 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d66ff-faef-4100-971a-e8251f93d221 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:17.889762 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93861fb-e8fd-4428-a333-4bf78331d0df None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:17.917986 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d66ff-faef-4100-971a-e8251f93d221 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:17.926430 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0818d36b-9e0f-4d3d-a0c0-fc6f17737e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:17.927283 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0818d36b-9e0f-4d3d-a0c0-fc6f17737e2b None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:17.927572 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0818d36b-9e0f-4d3d-a0c0-fc6f17737e2b None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:17.927844 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0818d36b-9e0f-4d3d-a0c0-fc6f17737e2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:17.941102 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0818d36b-9e0f-4d3d-a0c0-fc6f17737e2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:17.942584 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0818d36b-9e0f-4d3d-a0c0-fc6f17737e2b None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:17.961092 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-0818d36b-9e0f-4d3d-a0c0-fc6f17737e2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:17.961092 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:17.961092 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:17.961092 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:17.961092 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:17.961092 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:17.961092 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:17.961092 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:17.961092 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:17.961092 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:17.961092 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:17.961092 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:17.961092 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:17:17.961092 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:17:17.961092 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:17:17.962029 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:17:17.962029 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:17.962029 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:17.962029 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:17.962029 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:17.962029 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:17.962029 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:17.962029 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:17.962029 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:17.962029 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:17.962029 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:17.962029 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:17.962029 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:17.962029 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:17.962029 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:17.962029 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:17.962029 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:17.962904 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:17:17.962904 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:17:17.962904 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:17.962904 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:17.966692 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 382/751] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:17:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:17.967610 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585a17d5-a7a1-4a97-9437-8672eede7477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:17.968279 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a17d5-a7a1-4a97-9437-8672eede7477 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:17.968557 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a17d5-a7a1-4a97-9437-8672eede7477 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:17.968840 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a17d5-a7a1-4a97-9437-8672eede7477 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:17.969578 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585a17d5-a7a1-4a97-9437-8672eede7477 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:17.969880 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585a17d5-a7a1-4a97-9437-8672eede7477 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:17.971330 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585a17d5-a7a1-4a97-9437-8672eede7477 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:17.972898 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0818d36b-9e0f-4d3d-a0c0-fc6f17737e2b None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:17.985909 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 370/752] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:17:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:17.985909 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585a17d5-a7a1-4a97-9437-8672eede7477 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:18.041685 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:18.045731 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:18.112288 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0818d36b-9e0f-4d3d-a0c0-fc6f17737e2b None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:18.119168 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585a17d5-a7a1-4a97-9437-8672eede7477 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:18.153944 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e3d11-fb95-4e27-90ab-224ca1cabe6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:18.154929 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e3d11-fb95-4e27-90ab-224ca1cabe6f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:18.155508 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e3d11-fb95-4e27-90ab-224ca1cabe6f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:18.155919 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e3d11-fb95-4e27-90ab-224ca1cabe6f None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:18.156781 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285e3d11-fb95-4e27-90ab-224ca1cabe6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:18.157222 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285e3d11-fb95-4e27-90ab-224ca1cabe6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:18.157334 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ffada-d785-40ea-a20a-9da5fca06d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:18.158222 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ffada-d785-40ea-a20a-9da5fca06d9b None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:18.158590 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ffada-d785-40ea-a20a-9da5fca06d9b None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:18.158951 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ffada-d785-40ea-a20a-9da5fca06d9b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:18.159348 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285e3d11-fb95-4e27-90ab-224ca1cabe6f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:18.168313 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5ffada-d785-40ea-a20a-9da5fca06d9b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:18.170738 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5ffada-d785-40ea-a20a-9da5fca06d9b None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:18.172760 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 371/753] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:17:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:18.173783 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e3d11-fb95-4e27-90ab-224ca1cabe6f None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:18.193685 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-ee5ffada-d785-40ea-a20a-9da5fca06d9b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 03:17:18.193685 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:18.193685 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:18.193685 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:18.193685 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:18.193685 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:18.193685 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:18.193685 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:18.193685 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:18.193685 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:18.193685 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:18.193685 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:18.193685 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 03:17:18.193685 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 03:17:18.193685 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 03:17:18.194647 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 03:17:18.194647 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:18.194647 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:18.194647 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:18.194647 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:18.194647 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:18.194647 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:18.194647 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:18.194647 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:18.194647 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:18.194647 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:18.194647 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:18.194647 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:18.194647 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:18.194647 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:18.194647 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:18.194647 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:18.195581 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 03:17:18.195581 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 03:17:18.195581 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 03:17:18.195581 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 03:17:18.195581 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 03:17:18.195581 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 03:17:18.195581 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 03:17:18.195581 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:18.199202 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 383/754] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Jul 2 03:17:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:18.200226 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ffada-d785-40ea-a20a-9da5fca06d9b None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:18.294648 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:18.300543 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e3d11-fb95-4e27-90ab-224ca1cabe6f None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:18.326485 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ffada-d785-40ea-a20a-9da5fca06d9b None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:18.342864 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:18.350460 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d1ee9-d54c-45be-adbc-027ac3f6aa8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:18.351602 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d1ee9-d54c-45be-adbc-027ac3f6aa8f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:18.352526 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d1ee9-d54c-45be-adbc-027ac3f6aa8f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:18.353004 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d1ee9-d54c-45be-adbc-027ac3f6aa8f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:18.363813 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763d1ee9-d54c-45be-adbc-027ac3f6aa8f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:18.365615 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763d1ee9-d54c-45be-adbc-027ac3f6aa8f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:18.366992 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf10b5a-e212-4c96-93e5-6ab876f690af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:18.367997 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf10b5a-e212-4c96-93e5-6ab876f690af None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:18.368340 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf10b5a-e212-4c96-93e5-6ab876f690af None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:18.368676 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf10b5a-e212-4c96-93e5-6ab876f690af None admin] PATH_INFO: `/v3/projects/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:18.376405 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf10b5a-e212-4c96-93e5-6ab876f690af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:18.377922 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf10b5a-e212-4c96-93e5-6ab876f690af None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:18.383601 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-763d1ee9-d54c-45be-adbc-027ac3f6aa8f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 02 03:17:18.383601 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:18.383601 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:18.383601 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:18.383601 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:18.383601 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:18.383601 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:18.383601 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:18.383601 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:18.383601 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:18.383601 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:18.383601 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:18.383601 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 03:17:18.383601 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 03:17:18.383601 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 03:17:18.383601 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 03:17:18.384532 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:18.384532 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:18.384532 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 03:17:18.384532 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 03:17:18.384532 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 03:17:18.384532 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 03:17:18.384532 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:18.384532 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:18.384532 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:18.384532 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:18.384532 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:18.384532 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:18.384532 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:18.384532 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:18.384532 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:18.384532 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:18.384532 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:18.384532 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:18.385530 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:18.385530 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:18.385530 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 03:17:18.385530 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 03:17:18.385530 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 03:17:18.385530 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 03:17:18.385530 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 03:17:18.385530 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 03:17:18.385530 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 02 03:17:18.385530 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:18.392581 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 372/755] 10.222.0.60 () {56 vars in 1093 bytes} [Sat Jul 2 03:17:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:18.392581 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d1ee9-d54c-45be-adbc-027ac3f6aa8f None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:18.400990 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-7bf10b5a-e212-4c96-93e5-6ab876f690af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 03:17:18.400990 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:18.400990 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:18.400990 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:18.400990 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:18.400990 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:18.400990 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:18.400990 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:18.400990 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:18.400990 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:18.400990 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:18.400990 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:18.400990 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 03:17:18.400990 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 03:17:18.400990 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 03:17:18.401890 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 03:17:18.401890 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:18.401890 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:18.401890 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:18.401890 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:18.401890 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:18.401890 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:18.401890 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:18.401890 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:18.401890 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:18.401890 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:18.401890 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:18.401890 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:18.401890 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:18.401890 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:18.401890 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:18.401890 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:18.402782 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 03:17:18.402782 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 03:17:18.402782 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 03:17:18.402782 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 03:17:18.402782 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 03:17:18.402782 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 03:17:18.402782 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 03:17:18.402782 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:18.406793 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 384/756] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Jul 2 03:17:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:18.408063 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf10b5a-e212-4c96-93e5-6ab876f690af None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:18.518017 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d1ee9-d54c-45be-adbc-027ac3f6aa8f None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:18.518458 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf10b5a-e212-4c96-93e5-6ab876f690af None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:18.552925 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178ca1b9-9e73-4a3a-a568-e657fa86d86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:18.553209 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f3d60-3d73-46f1-a42a-28dce96c20bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:18.553512 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ca1b9-9e73-4a3a-a568-e657fa86d86a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:18.553792 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ca1b9-9e73-4a3a-a568-e657fa86d86a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:18.553892 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f3d60-3d73-46f1-a42a-28dce96c20bf None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:18.554055 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ca1b9-9e73-4a3a-a568-e657fa86d86a None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:18.554148 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f3d60-3d73-46f1-a42a-28dce96c20bf None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:18.554387 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f3d60-3d73-46f1-a42a-28dce96c20bf None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:18.554865 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178ca1b9-9e73-4a3a-a568-e657fa86d86a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:18.555238 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178ca1b9-9e73-4a3a-a568-e657fa86d86a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:18.555363 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f3d60-3d73-46f1-a42a-28dce96c20bf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:18.555639 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f3d60-3d73-46f1-a42a-28dce96c20bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:18.556674 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178ca1b9-9e73-4a3a-a568-e657fa86d86a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:18.557075 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f3d60-3d73-46f1-a42a-28dce96c20bf None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:18.573671 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 373/757] 10.222.0.60 () {56 vars in 1148 bytes} [Sat Jul 2 03:17:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:18.573671 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178ca1b9-9e73-4a3a-a568-e657fa86d86a None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:18.574479 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 385/758] 10.222.0.60 () {56 vars in 1133 bytes} [Sat Jul 2 03:17:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:18.578618 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d8707-6fa8-4ff5-a89e-9749874d13ae None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:18.578618 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d8707-6fa8-4ff5-a89e-9749874d13ae None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:18.578618 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d8707-6fa8-4ff5-a89e-9749874d13ae None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:18.578618 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 386/759] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:17:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:17:18.578618 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7d8707-6fa8-4ff5-a89e-9749874d13ae None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:18.599584 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:18.611113 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:18.685001 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178ca1b9-9e73-4a3a-a568-e657fa86d86a None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:18.685706 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7d8707-6fa8-4ff5-a89e-9749874d13ae None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:18.719862 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05195d66-c937-47a7-9d2e-3ca82cca852f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:18.720526 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05195d66-c937-47a7-9d2e-3ca82cca852f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:18.720803 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05195d66-c937-47a7-9d2e-3ca82cca852f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:18.721114 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05195d66-c937-47a7-9d2e-3ca82cca852f None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:18.721850 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05195d66-c937-47a7-9d2e-3ca82cca852f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:18.722160 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05195d66-c937-47a7-9d2e-3ca82cca852f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:18.722596 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4896d0d6-20ba-4d76-bf68-a86f406aa9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:18.723324 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4896d0d6-20ba-4d76-bf68-a86f406aa9f0 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:18.723603 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4896d0d6-20ba-4d76-bf68-a86f406aa9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:18.723700 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05195d66-c937-47a7-9d2e-3ca82cca852f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:18.723870 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4896d0d6-20ba-4d76-bf68-a86f406aa9f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:18.724745 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4896d0d6-20ba-4d76-bf68-a86f406aa9f0 None admin] RBAC: Adding query filter params (role.id=5dcd130cda6c490595e862dc2348e83d, scope.project.id=e09dc5d9d4904c2b89b0cabed237d55e, user.id=692ec343bf9f4339ba691440f55a6c37) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:18.725180 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4896d0d6-20ba-4d76-bf68-a86f406aa9f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:18.726753 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4896d0d6-20ba-4d76-bf68-a86f406aa9f0 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:18.743181 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 387/760] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Jul 2 03:17:18 2022] GET /identity/v3/role_assignments?user.id=692ec343bf9f4339ba691440f55a6c37&scope.project.id=e09dc5d9d4904c2b89b0cabed237d55e&role.id=5dcd130cda6c490595e862dc2348e83d => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:18.743181 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4896d0d6-20ba-4d76-bf68-a86f406aa9f0 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:18.751741 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 374/761] 10.222.0.60 () {56 vars in 1148 bytes} [Sat Jul 2 03:17:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:18.753383 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9eb524-b926-48d2-a590-925d0b751f80 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:18.753768 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9eb524-b926-48d2-a590-925d0b751f80 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:18.754118 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9eb524-b926-48d2-a590-925d0b751f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:18.774201 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-8f9eb524-b926-48d2-a590-925d0b751f80 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:17:18.775866 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8f9eb524-b926-48d2-a590-925d0b751f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:17:18.855198 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 375/762] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:17:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 03:17:18.856352 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9eb524-b926-48d2-a590-925d0b751f80 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:18.874645 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:18.881642 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:18.892415 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4896d0d6-20ba-4d76-bf68-a86f406aa9f0 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:18.927812 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0239396d-94da-42a4-a3da-adab30c2c9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:18.928939 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0239396d-94da-42a4-a3da-adab30c2c9bc None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:18.929394 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0239396d-94da-42a4-a3da-adab30c2c9bc None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:18.929840 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0239396d-94da-42a4-a3da-adab30c2c9bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:18.941271 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0239396d-94da-42a4-a3da-adab30c2c9bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:18.943021 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0239396d-94da-42a4-a3da-adab30c2c9bc None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:18.962625 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-0239396d-94da-42a4-a3da-adab30c2c9bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:18.962625 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:18.962625 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:18.962625 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:18.962625 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:18.962625 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:18.962625 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:18.962625 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:18.962625 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:18.962625 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:18.962625 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:18.962625 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:18.962625 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:17:18.962625 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:17:18.962625 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:17:18.963683 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:17:18.963683 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:18.963683 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:18.963683 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:18.963683 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:18.963683 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:18.963683 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:18.963683 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:18.963683 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:18.963683 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:18.963683 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:18.963683 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:18.963683 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:18.963683 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:18.963683 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:18.963683 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:18.963683 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:18.964596 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:17:18.964596 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:17:18.964596 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:18.964596 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:18.966928 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 388/763] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:17:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:18.967967 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0239396d-94da-42a4-a3da-adab30c2c9bc None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:18.980309 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9eb524-b926-48d2-a590-925d0b751f80 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:19.017275 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02cf517-428b-4aa0-b845-3b52077c2aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:19.017948 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02cf517-428b-4aa0-b845-3b52077c2aa3 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:19.018215 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02cf517-428b-4aa0-b845-3b52077c2aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:19.018507 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02cf517-428b-4aa0-b845-3b52077c2aa3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:19.019466 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02cf517-428b-4aa0-b845-3b52077c2aa3 None admin] RBAC: Adding query filter params (role.id=3c71d0e875cd4a00849f14227be8f7ed, scope.project.id=e09dc5d9d4904c2b89b0cabed237d55e, user.id=3333e7495b9546d882e2a2211ff8875c) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:19.019795 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02cf517-428b-4aa0-b845-3b52077c2aa3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:19.021341 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02cf517-428b-4aa0-b845-3b52077c2aa3 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:19.034828 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 376/764] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Jul 2 03:17:18 2022] GET /identity/v3/role_assignments?user.id=3333e7495b9546d882e2a2211ff8875c&scope.project.id=e09dc5d9d4904c2b89b0cabed237d55e&role.id=3c71d0e875cd4a00849f14227be8f7ed => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:19.034828 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02cf517-428b-4aa0-b845-3b52077c2aa3 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:19.144683 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0239396d-94da-42a4-a3da-adab30c2c9bc None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:19.189768 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4803d5-7fa4-4007-b077-40925931bde2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:19.190607 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4803d5-7fa4-4007-b077-40925931bde2 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:19.190886 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4803d5-7fa4-4007-b077-40925931bde2 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:19.191180 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4803d5-7fa4-4007-b077-40925931bde2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:19.191861 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4803d5-7fa4-4007-b077-40925931bde2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:19.193261 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4803d5-7fa4-4007-b077-40925931bde2 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:19.218144 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-5c4803d5-7fa4-4007-b077-40925931bde2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 02 03:17:19.218144 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:19.218144 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 02 03:17:19.218144 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 02 03:17:19.218144 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 02 03:17:19.218144 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 02 03:17:19.218144 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 02 03:17:19.218144 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 03:17:19.218144 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 02 03:17:19.218144 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:19.218144 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 03:17:19.218144 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:19.218144 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:19.218144 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:19.218144 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:19.218144 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:19.219157 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:19.219157 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:19.219157 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:19.219157 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:19.219157 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:19.219157 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:19.219157 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:19.219157 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 02 03:17:19.219157 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 02 03:17:19.219157 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 02 03:17:19.219157 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 02 03:17:19.219157 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:19.219157 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:19.219157 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:19.219157 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:19.219157 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:19.219999 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:19.219999 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:19.219999 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:19.219999 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:19.219999 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:19.219999 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:19.219999 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:19.219999 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:19.219999 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:19.219999 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:19.219999 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:19.219999 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 02 03:17:19.219999 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 03:17:19.219999 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 02 03:17:19.219999 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:19.223828 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 389/765] 10.222.0.60 () {56 vars in 1129 bytes} [Sat Jul 2 03:17:18 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:19.224816 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:19.227820 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4803d5-7fa4-4007-b077-40925931bde2 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:19.243411 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:19.346215 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4803d5-7fa4-4007-b077-40925931bde2 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:19.389293 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dda5c24-91c0-4053-ba59-66b8c8f22a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:19.390214 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda5c24-91c0-4053-ba59-66b8c8f22a67 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:19.390807 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda5c24-91c0-4053-ba59-66b8c8f22a67 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:19.391264 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda5c24-91c0-4053-ba59-66b8c8f22a67 None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:19.392627 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dda5c24-91c0-4053-ba59-66b8c8f22a67 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:19.393205 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dda5c24-91c0-4053-ba59-66b8c8f22a67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:19.394960 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dda5c24-91c0-4053-ba59-66b8c8f22a67 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:19.401228 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 390/766] 10.222.0.60 () {56 vars in 1124 bytes} [Sat Jul 2 03:17:19 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:17:19.402814 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732f883-4a45-41b1-b587-ae1b7c686f02 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:19.403266 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732f883-4a45-41b1-b587-ae1b7c686f02 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:19.403671 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732f883-4a45-41b1-b587-ae1b7c686f02 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:19.409545 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 391/767] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:17:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:17:19.410683 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2cbd0-d6d1-45e0-8dfb-6d54df540bda None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:19.410968 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2cbd0-d6d1-45e0-8dfb-6d54df540bda None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:19.411277 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2cbd0-d6d1-45e0-8dfb-6d54df540bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:19.426536 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02cf517-428b-4aa0-b845-3b52077c2aa3 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:19.437170 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-78e2cbd0-d6d1-45e0-8dfb-6d54df540bda None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:17:19.438182 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-78e2cbd0-d6d1-45e0-8dfb-6d54df540bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:17:19.463024 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae58e11-c79c-4cfb-b32e-05691b92bcdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:19.464211 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae58e11-c79c-4cfb-b32e-05691b92bcdc None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:19.464694 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae58e11-c79c-4cfb-b32e-05691b92bcdc None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:19.465213 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae58e11-c79c-4cfb-b32e-05691b92bcdc None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:19.466144 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae58e11-c79c-4cfb-b32e-05691b92bcdc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:19.466726 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae58e11-c79c-4cfb-b32e-05691b92bcdc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:19.468413 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae58e11-c79c-4cfb-b32e-05691b92bcdc None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:19.481503 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 377/768] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:17:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 453 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:19.482721 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae58e11-c79c-4cfb-b32e-05691b92bcdc None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:19.527166 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 392/769] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:17:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 03:17:19.527166 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e2cbd0-d6d1-45e0-8dfb-6d54df540bda None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:19.527166 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:19.598938 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae58e11-c79c-4cfb-b32e-05691b92bcdc None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:19.632400 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:19.640203 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e89c7f-8386-494f-acac-d33118011218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:19.641148 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e89c7f-8386-494f-acac-d33118011218 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:19.641434 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e89c7f-8386-494f-acac-d33118011218 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:19.641710 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e89c7f-8386-494f-acac-d33118011218 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:19.642429 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e89c7f-8386-494f-acac-d33118011218 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:19.642739 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e89c7f-8386-494f-acac-d33118011218 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:19.644647 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e89c7f-8386-494f-acac-d33118011218 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:19.655323 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 378/770] 10.222.0.60 () {56 vars in 1124 bytes} [Sat Jul 2 03:17:19 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:19.656395 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e89c7f-8386-494f-acac-d33118011218 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:19.663784 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e2cbd0-d6d1-45e0-8dfb-6d54df540bda None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:19.701035 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1cd6e6-a1f3-4020-a787-5237d7dc8272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:19.702183 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1cd6e6-a1f3-4020-a787-5237d7dc8272 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:19.702681 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1cd6e6-a1f3-4020-a787-5237d7dc8272 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:19.703189 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1cd6e6-a1f3-4020-a787-5237d7dc8272 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:19.710282 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1cd6e6-a1f3-4020-a787-5237d7dc8272 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:19.711990 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1cd6e6-a1f3-4020-a787-5237d7dc8272 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:19.726094 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-5c1cd6e6-a1f3-4020-a787-5237d7dc8272 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 03:17:19.726094 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:19.726094 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:19.726094 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:19.726094 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:19.726094 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:19.726094 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:19.726094 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:19.726094 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:19.726094 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:19.726094 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:19.726094 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:19.726094 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 03:17:19.726094 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 03:17:19.726094 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 03:17:19.727039 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 03:17:19.727039 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:19.727039 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:19.727039 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:19.727039 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:19.727039 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:19.727039 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:19.727039 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:19.727039 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:19.727039 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:19.727039 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:19.727039 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:19.727039 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:19.727039 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:19.727039 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:19.727039 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:19.727039 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:19.727992 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 03:17:19.727992 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 03:17:19.727992 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 03:17:19.727992 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 03:17:19.727992 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 03:17:19.727992 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 03:17:19.727992 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 03:17:19.727992 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:19.730580 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 393/771] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Jul 2 03:17:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:19.731695 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1cd6e6-a1f3-4020-a787-5237d7dc8272 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:19.789776 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e89c7f-8386-494f-acac-d33118011218 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:19.811905 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:19.825198 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36531527-e832-44d1-8ce5-e18ddc3f8990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:19.826296 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36531527-e832-44d1-8ce5-e18ddc3f8990 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:19.826824 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36531527-e832-44d1-8ce5-e18ddc3f8990 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:19.827339 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36531527-e832-44d1-8ce5-e18ddc3f8990 None admin] PATH_INFO: `/v3/services/network` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:19.828218 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36531527-e832-44d1-8ce5-e18ddc3f8990 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:19.829808 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36531527-e832-44d1-8ce5-e18ddc3f8990 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:19.843949 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-36531527-e832-44d1-8ce5-e18ddc3f8990 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 02 03:17:19.843949 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:19.843949 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 02 03:17:19.843949 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 02 03:17:19.843949 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 02 03:17:19.843949 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 02 03:17:19.843949 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 02 03:17:19.843949 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 03:17:19.843949 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 02 03:17:19.843949 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:19.843949 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 03:17:19.843949 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:19.843949 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:19.843949 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:19.843949 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:19.843949 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:19.843949 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:19.844987 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:19.844987 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:19.844987 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:19.844987 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:19.844987 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:19.844987 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:19.844987 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 02 03:17:19.844987 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 02 03:17:19.844987 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 02 03:17:19.844987 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 02 03:17:19.844987 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:19.844987 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:19.844987 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:19.844987 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:19.844987 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:19.844987 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:19.845846 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:19.845846 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:19.845846 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:19.845846 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:19.845846 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:19.845846 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:19.845846 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:19.845846 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:19.845846 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:19.845846 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:19.845846 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 02 03:17:19.845846 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 03:17:19.845846 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 02 03:17:19.845846 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:19.848704 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 379/772] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Jul 2 03:17:19 2022] GET /identity/v3/services/network => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:19.849720 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36531527-e832-44d1-8ce5-e18ddc3f8990 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:19.860231 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1cd6e6-a1f3-4020-a787-5237d7dc8272 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:19.899231 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c29c632-66cd-4e6f-82e1-ea440b0015a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:19.900071 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29c632-66cd-4e6f-82e1-ea440b0015a6 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:19.900350 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29c632-66cd-4e6f-82e1-ea440b0015a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:19.900615 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29c632-66cd-4e6f-82e1-ea440b0015a6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:19.901437 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c29c632-66cd-4e6f-82e1-ea440b0015a6 None admin] RBAC: Adding query filter params (interface=public, service_id=5f42e0ed304f4d10854d4e8e32458f56, region_id=RegionOne) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:19.902216 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c29c632-66cd-4e6f-82e1-ea440b0015a6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:19.903361 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c29c632-66cd-4e6f-82e1-ea440b0015a6 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:19.916676 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:19.917816 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 394/773] 10.222.0.60 () {56 vars in 1251 bytes} [Sat Jul 2 03:17:19 2022] GET /identity/v3/endpoints?service_id=5f42e0ed304f4d10854d4e8e32458f56&interface=public®ion_id=RegionOne => generated 194 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:19.918755 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c29c632-66cd-4e6f-82e1-ea440b0015a6 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:19.959418 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36531527-e832-44d1-8ce5-e18ddc3f8990 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:19.995554 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab5ca5-ab22-4ba9-8790-47552a1566d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:19.996621 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab5ca5-ab22-4ba9-8790-47552a1566d8 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:19.997106 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab5ca5-ab22-4ba9-8790-47552a1566d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:19.997580 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab5ca5-ab22-4ba9-8790-47552a1566d8 None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:19.998592 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ab5ca5-ab22-4ba9-8790-47552a1566d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:19.999107 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ab5ca5-ab22-4ba9-8790-47552a1566d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:20.000825 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ab5ca5-ab22-4ba9-8790-47552a1566d8 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:20.013318 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 380/774] 10.222.0.60 () {56 vars in 1148 bytes} [Sat Jul 2 03:17:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:20.014429 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab5ca5-ab22-4ba9-8790-47552a1566d8 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:20.032059 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c29c632-66cd-4e6f-82e1-ea440b0015a6 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:20.063969 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:20.073711 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d1d54-b4fa-400e-9438-33eba46d88ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:20.074376 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d1d54-b4fa-400e-9438-33eba46d88ac None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:20.074670 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d1d54-b4fa-400e-9438-33eba46d88ac None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:20.074919 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d1d54-b4fa-400e-9438-33eba46d88ac None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:20.075661 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91d1d54-b4fa-400e-9438-33eba46d88ac None admin] RBAC: Adding query filter params (name=network) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:20.075964 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91d1d54-b4fa-400e-9438-33eba46d88ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:20.077624 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91d1d54-b4fa-400e-9438-33eba46d88ac None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:20.087076 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 395/775] 10.222.0.60 () {56 vars in 1112 bytes} [Sat Jul 2 03:17:19 2022] GET /identity/v3/services?name=network => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:20.087916 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d1d54-b4fa-400e-9438-33eba46d88ac None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:20.120936 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab5ca5-ab22-4ba9-8790-47552a1566d8 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:20.141286 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:20.155819 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b3be3b-5dc9-4133-92ca-dab4bf45e302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:20.156618 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3be3b-5dc9-4133-92ca-dab4bf45e302 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:20.156999 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3be3b-5dc9-4133-92ca-dab4bf45e302 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:20.157372 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3be3b-5dc9-4133-92ca-dab4bf45e302 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:20.158181 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b3be3b-5dc9-4133-92ca-dab4bf45e302 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:20.159690 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b3be3b-5dc9-4133-92ca-dab4bf45e302 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:20.171225 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 381/776] 10.222.0.60 () {56 vars in 1087 bytes} [Sat Jul 2 03:17:20 2022] GET /identity/v3/services => generated 772 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:20.171225 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b3be3b-5dc9-4133-92ca-dab4bf45e302 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:20.226056 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d1d54-b4fa-400e-9438-33eba46d88ac None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:20.279006 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b3be3b-5dc9-4133-92ca-dab4bf45e302 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:20.293838 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9077f-1d45-49a1-bd35-bb442ed3b43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:20.295006 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9077f-1d45-49a1-bd35-bb442ed3b43d None admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:20.295476 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9077f-1d45-49a1-bd35-bb442ed3b43d None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:20.295894 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9077f-1d45-49a1-bd35-bb442ed3b43d None admin] PATH_INFO: `/v3/projects/e09dc5d9d4904c2b89b0cabed237d55e/users/13530240e2d446b6bf26a431d001362a/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:20.300555 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc9077f-1d45-49a1-bd35-bb442ed3b43d None admin] RBAC: Authorizing `identity:create_grant(project_id=e09dc5d9d4904c2b89b0cabed237d55e, user_id=13530240e2d446b6bf26a431d001362a, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:20.302201 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc9077f-1d45-49a1-bd35-bb442ed3b43d None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:20.319025 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc4e09f-3d67-4540-b153-5e1652fc3aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:20.319887 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4e09f-3d67-4540-b153-5e1652fc3aa6 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:20.320267 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4e09f-3d67-4540-b153-5e1652fc3aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:20.320638 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4e09f-3d67-4540-b153-5e1652fc3aa6 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:20.321524 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc4e09f-3d67-4540-b153-5e1652fc3aa6 None admin] RBAC: Adding query filter params (type=network) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:20.321993 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc4e09f-3d67-4540-b153-5e1652fc3aa6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:20.323600 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc4e09f-3d67-4540-b153-5e1652fc3aa6 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:20.334368 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 382/777] 10.222.0.60 () {56 vars in 1112 bytes} [Sat Jul 2 03:17:20 2022] GET /identity/v3/services?type=network => generated 350 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:20.337666 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 396/778] 10.222.0.60 () {58 vars in 1439 bytes} [Sat Jul 2 03:17:20 2022] PUT /identity/v3/projects/e09dc5d9d4904c2b89b0cabed237d55e/users/13530240e2d446b6bf26a431d001362a/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:17:20.340370 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc4e09f-3d67-4540-b153-5e1652fc3aa6 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:20.401796 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:20.461686 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc4e09f-3d67-4540-b153-5e1652fc3aa6 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:20.499485 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a73084-ae12-47fb-bbc8-8fae4fe6d693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:20.500172 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a73084-ae12-47fb-bbc8-8fae4fe6d693 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:20.500455 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a73084-ae12-47fb-bbc8-8fae4fe6d693 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:20.500732 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a73084-ae12-47fb-bbc8-8fae4fe6d693 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:20.501556 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a73084-ae12-47fb-bbc8-8fae4fe6d693 None admin] RBAC: Adding query filter params (interface=public, service_id=d6b9462fddbb47828f4884f5523e1cdb, region_id=RegionOne) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:20.501872 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a73084-ae12-47fb-bbc8-8fae4fe6d693 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:20.503344 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a73084-ae12-47fb-bbc8-8fae4fe6d693 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:20.512688 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 383/779] 10.222.0.60 () {56 vars in 1251 bytes} [Sat Jul 2 03:17:20 2022] GET /identity/v3/endpoints?service_id=d6b9462fddbb47828f4884f5523e1cdb&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:20.518177 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9077f-1d45-49a1-bd35-bb442ed3b43d None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:20.583922 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:20.637599 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9077f-1d45-49a1-bd35-bb442ed3b43d None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:20.672714 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b46a1d8-008b-4748-a38e-57af9f7a0d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:20.673393 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b46a1d8-008b-4748-a38e-57af9f7a0d70 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:20.673672 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b46a1d8-008b-4748-a38e-57af9f7a0d70 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:20.673990 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b46a1d8-008b-4748-a38e-57af9f7a0d70 None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:20.674696 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b46a1d8-008b-4748-a38e-57af9f7a0d70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:20.676113 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b46a1d8-008b-4748-a38e-57af9f7a0d70 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:20.681900 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 397/780] 10.222.0.60 () {56 vars in 1087 bytes} [Sat Jul 2 03:17:20 2022] GET /identity/v3/services => generated 772 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:20.955247 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab21cd-2d4f-4481-b073-d86b7fa521d9 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:20.955659 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab21cd-2d4f-4481-b073-d86b7fa521d9 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:20.955833 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab21cd-2d4f-4481-b073-d86b7fa521d9 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:20.957480 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 384/781] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:17:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:17:20.962888 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d6de7-f8d1-4ce9-b69c-739033bc66c9 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:20.963278 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d6de7-f8d1-4ce9-b69c-739033bc66c9 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:20.963561 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d6de7-f8d1-4ce9-b69c-739033bc66c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:20.983112 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-8d6d6de7-f8d1-4ce9-b69c-739033bc66c9 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:17:20.984354 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-8d6d6de7-f8d1-4ce9-b69c-739033bc66c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:17:21.065962 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 398/782] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:17:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 03:17:21.108699 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab21cd-2d4f-4481-b073-d86b7fa521d9 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:21.242579 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab21cd-2d4f-4481-b073-d86b7fa521d9 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:21.253695 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e4fb8-5af1-4b3f-8009-052588c51ac3 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:21.254206 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e4fb8-5af1-4b3f-8009-052588c51ac3 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:21.254281 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e4fb8-5af1-4b3f-8009-052588c51ac3 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:21.257131 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 399/783] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:17:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:17:21.261216 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4156e06-8e35-49b6-b321-229cd2b70109 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:21.261502 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4156e06-8e35-49b6-b321-229cd2b70109 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:21.261773 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4156e06-8e35-49b6-b321-229cd2b70109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:21.262946 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:21.285713 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce985b6d-4210-41bf-bb35-343167d78ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:21.286516 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce985b6d-4210-41bf-bb35-343167d78ea1 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:21.286837 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce985b6d-4210-41bf-bb35-343167d78ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:21.287114 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce985b6d-4210-41bf-bb35-343167d78ea1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:21.298796 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce985b6d-4210-41bf-bb35-343167d78ea1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:17:21.306613 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-ce985b6d-4210-41bf-bb35-343167d78ea1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 03:17:21.306613 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:21.306613 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:21.306613 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:21.306613 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:21.306613 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:21.306613 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:21.306613 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:21.306613 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:21.306613 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:21.306613 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:21.306613 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:21.306613 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:17:21.306613 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:17:21.306613 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:17:21.306613 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:17:21.307607 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:17:21.307607 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:17:21.307607 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:17:21.307607 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:17:21.307607 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:21.307607 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:21.307607 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:21.307607 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:21.307607 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:21.307607 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:21.307607 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:21.307607 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:21.307607 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:21.307607 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:21.307607 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:21.307607 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:21.308423 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:21.308423 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:21.308423 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:21.308423 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:21.308423 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:17:21.308423 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:17:21.308423 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:17:21.308423 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:17:21.308423 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:17:21.308423 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:17:21.308423 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 03:17:21.308423 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:21.309051 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-e4156e06-8e35-49b6-b321-229cd2b70109 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:17:21.309126 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 385/784] 10.222.0.60 () {56 vars in 1096 bytes} [Sat Jul 2 03:17:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:21.309477 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-e4156e06-8e35-49b6-b321-229cd2b70109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:17:21.318263 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce985b6d-4210-41bf-bb35-343167d78ea1 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:21.414243 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:21.458468 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 400/785] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:17:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 02 03:17:21.471678 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce985b6d-4210-41bf-bb35-343167d78ea1 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:21.496691 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4156e06-8e35-49b6-b321-229cd2b70109 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:21.527924 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781eb052-43bb-4e48-96f8-13645197d504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:21.529163 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781eb052-43bb-4e48-96f8-13645197d504 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:21.530567 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781eb052-43bb-4e48-96f8-13645197d504 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:21.531157 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781eb052-43bb-4e48-96f8-13645197d504 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:21.532979 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781eb052-43bb-4e48-96f8-13645197d504 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:21.533715 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781eb052-43bb-4e48-96f8-13645197d504 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:21.535972 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781eb052-43bb-4e48-96f8-13645197d504 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:21.553919 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 386/786] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Jul 2 03:17:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:21.559895 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781eb052-43bb-4e48-96f8-13645197d504 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:21.613099 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:21.687501 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4156e06-8e35-49b6-b321-229cd2b70109 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:21.725015 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781eb052-43bb-4e48-96f8-13645197d504 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:21.761118 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b9f250-2210-4a19-bdd2-43b50e189255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:21.762839 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9f250-2210-4a19-bdd2-43b50e189255 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:21.763586 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9f250-2210-4a19-bdd2-43b50e189255 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:21.763890 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f857b2bf-1ef5-4fcf-8cc3-228ddd0a1728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:21.764363 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9f250-2210-4a19-bdd2-43b50e189255 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:21.764662 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857b2bf-1ef5-4fcf-8cc3-228ddd0a1728 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:21.764945 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857b2bf-1ef5-4fcf-8cc3-228ddd0a1728 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:21.765227 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857b2bf-1ef5-4fcf-8cc3-228ddd0a1728 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:21.777611 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b9f250-2210-4a19-bdd2-43b50e189255 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:21.779285 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b9f250-2210-4a19-bdd2-43b50e189255 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:21.797653 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-f0b9f250-2210-4a19-bdd2-43b50e189255 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:21.797653 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:21.797653 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:21.797653 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:21.797653 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:21.797653 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:21.797653 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:21.797653 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:21.797653 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:21.797653 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:21.797653 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:21.797653 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:21.797653 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:17:21.797653 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:17:21.797653 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:17:21.798552 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:17:21.798552 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:21.798552 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:21.798552 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:21.798552 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:21.798552 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:21.798552 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:21.798552 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:21.798552 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:21.798552 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:21.798552 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:21.798552 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:21.798552 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:21.798552 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:21.798552 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:21.798552 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:21.798552 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:21.799734 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:17:21.799734 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:17:21.799734 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:21.799734 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:21.801676 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 387/787] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:17:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 03:17:21.807716 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f857b2bf-1ef5-4fcf-8cc3-228ddd0a1728 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:17:21.811095 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-f857b2bf-1ef5-4fcf-8cc3-228ddd0a1728 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 02 03:17:21.811095 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:21.811095 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:21.811095 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:21.811095 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:21.811095 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:21.811095 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:21.811095 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:21.811095 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:21.811095 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:21.811095 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:21.811095 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:21.811095 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:17:21.811095 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:17:21.811095 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:17:21.811095 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:17:21.812003 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:17:21.812003 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:17:21.812003 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:17:21.812003 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:17:21.812003 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:21.812003 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:21.812003 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:21.812003 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:21.812003 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:21.812003 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:21.812003 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:21.812003 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:21.812003 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:21.812003 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:21.812003 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:21.812003 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:21.812834 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:21.812834 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:21.812834 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:21.812834 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:21.812834 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:17:21.812834 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:17:21.812834 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:17:21.812834 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:17:21.812834 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:17:21.812834 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:17:21.812834 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 02 03:17:21.812834 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:21.815966 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b9f250-2210-4a19-bdd2-43b50e189255 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:21.821271 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 401/788] 10.222.0.60 () {56 vars in 1102 bytes} [Sat Jul 2 03:17:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 03:17:21.822454 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f857b2bf-1ef5-4fcf-8cc3-228ddd0a1728 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:21.883551 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:21.911512 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:21.924938 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b9f250-2210-4a19-bdd2-43b50e189255 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:21.960487 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6bbde-865a-490f-ae15-42b5a407e33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:21.961436 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6bbde-865a-490f-ae15-42b5a407e33f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:21.961887 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6bbde-865a-490f-ae15-42b5a407e33f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:21.962362 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6bbde-865a-490f-ae15-42b5a407e33f None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:21.963406 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a6bbde-865a-490f-ae15-42b5a407e33f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:21.964023 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a6bbde-865a-490f-ae15-42b5a407e33f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:21.965568 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a6bbde-865a-490f-ae15-42b5a407e33f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:21.978688 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 388/789] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:17:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:17:21.984349 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6bbde-865a-490f-ae15-42b5a407e33f None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:22.056134 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f857b2bf-1ef5-4fcf-8cc3-228ddd0a1728 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:22.123455 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c5ab87-0c3b-4d92-b366-03141708ce7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:22.124144 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c5ab87-0c3b-4d92-b366-03141708ce7e None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:22.124422 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c5ab87-0c3b-4d92-b366-03141708ce7e None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:22.124694 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c5ab87-0c3b-4d92-b366-03141708ce7e None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:22.125469 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c5ab87-0c3b-4d92-b366-03141708ce7e None admin] RBAC: Adding query filter params (name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:22.125778 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c5ab87-0c3b-4d92-b366-03141708ce7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:22.127194 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c5ab87-0c3b-4d92-b366-03141708ce7e None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:22.138717 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 402/790] 10.222.0.60 () {56 vars in 1103 bytes} [Sat Jul 2 03:17:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:22.144352 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c5ab87-0c3b-4d92-b366-03141708ce7e None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:22.213182 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6bbde-865a-490f-ae15-42b5a407e33f None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:22.249594 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c5ab87-0c3b-4d92-b366-03141708ce7e None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:22.251575 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:22.284159 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413d462-76a8-4dab-accf-91972af878e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:22.284995 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413d462-76a8-4dab-accf-91972af878e4 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:22.285247 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413d462-76a8-4dab-accf-91972af878e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:22.285514 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413d462-76a8-4dab-accf-91972af878e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:22.297097 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b413d462-76a8-4dab-accf-91972af878e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:22.298549 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b413d462-76a8-4dab-accf-91972af878e4 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:22.301700 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11841b29-d262-42aa-95af-4e96b0451685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:22.302520 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11841b29-d262-42aa-95af-4e96b0451685 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:22.302801 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11841b29-d262-42aa-95af-4e96b0451685 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:22.303079 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11841b29-d262-42aa-95af-4e96b0451685 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:22.316319 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-b413d462-76a8-4dab-accf-91972af878e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:22.316319 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:22.316319 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:22.316319 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:22.316319 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:22.316319 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:22.316319 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:22.316319 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:22.316319 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:22.316319 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:22.316319 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:22.316319 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:22.316319 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:17:22.316319 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:17:22.316319 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:17:22.317222 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:17:22.317222 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:22.317222 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:22.317222 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:22.317222 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:22.317222 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:22.317222 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:22.317222 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:22.317222 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:22.317222 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:22.317222 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:22.317222 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:22.317222 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:22.317222 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:22.317222 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:22.317222 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:22.317222 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:22.318095 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:17:22.318095 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:17:22.318095 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:22.318095 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:22.318095 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 403/791] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:17:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:22.319671 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11841b29-d262-42aa-95af-4e96b0451685 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:22.321150 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11841b29-d262-42aa-95af-4e96b0451685 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:22.323442 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413d462-76a8-4dab-accf-91972af878e4 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:22.352132 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-11841b29-d262-42aa-95af-4e96b0451685 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 02 03:17:22.352132 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:22.352132 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:22.352132 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:22.352132 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:22.352132 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:22.352132 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:22.352132 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:22.352132 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:22.352132 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:22.352132 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:22.352132 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:22.352132 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 03:17:22.352132 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 03:17:22.352132 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 03:17:22.352132 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 03:17:22.353126 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:22.353126 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:22.353126 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 03:17:22.353126 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 03:17:22.353126 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 03:17:22.353126 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 03:17:22.353126 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:22.353126 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:22.353126 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:22.353126 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:22.353126 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:22.353126 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:22.353126 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:22.353126 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:22.353126 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:22.353126 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:22.353126 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:22.353126 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:22.354172 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:22.354172 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:22.354172 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 03:17:22.354172 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 03:17:22.354172 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 03:17:22.354172 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 03:17:22.354172 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 03:17:22.354172 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 03:17:22.354172 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 02 03:17:22.354172 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:22.354172 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 389/792] 10.222.0.60 () {56 vars in 1096 bytes} [Sat Jul 2 03:17:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:22.359978 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11841b29-d262-42aa-95af-4e96b0451685 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:22.379475 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:22.444419 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413d462-76a8-4dab-accf-91972af878e4 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:22.486184 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4441a491-c729-4205-aee9-9bf2d783d3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:22.486868 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4441a491-c729-4205-aee9-9bf2d783d3ca None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:22.487181 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4441a491-c729-4205-aee9-9bf2d783d3ca None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:22.487473 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4441a491-c729-4205-aee9-9bf2d783d3ca None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:22.488220 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4441a491-c729-4205-aee9-9bf2d783d3ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:22.488527 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4441a491-c729-4205-aee9-9bf2d783d3ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:22.489906 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4441a491-c729-4205-aee9-9bf2d783d3ca None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:22.510660 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 404/793] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:17:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:17:22.525694 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4441a491-c729-4205-aee9-9bf2d783d3ca None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:22.543467 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:22.583435 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11841b29-d262-42aa-95af-4e96b0451685 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:22.656953 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4441a491-c729-4205-aee9-9bf2d783d3ca None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:22.675831 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d243676-79fc-492c-a4a9-56a2f2343191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:22.676906 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d243676-79fc-492c-a4a9-56a2f2343191 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:22.677388 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d243676-79fc-492c-a4a9-56a2f2343191 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:22.677859 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d243676-79fc-492c-a4a9-56a2f2343191 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:22.678909 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d243676-79fc-492c-a4a9-56a2f2343191 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:22.679443 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d243676-79fc-492c-a4a9-56a2f2343191 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:22.681102 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d243676-79fc-492c-a4a9-56a2f2343191 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:22.697538 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aada0274-0626-443c-a309-eddcf74a2781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:22.698367 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada0274-0626-443c-a309-eddcf74a2781 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:22.698651 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada0274-0626-443c-a309-eddcf74a2781 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:22.698926 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada0274-0626-443c-a309-eddcf74a2781 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:22.712317 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aada0274-0626-443c-a309-eddcf74a2781 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:22.713827 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aada0274-0626-443c-a309-eddcf74a2781 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:22.716511 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 390/794] 10.222.0.60 () {56 vars in 1135 bytes} [Sat Jul 2 03:17:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:22.722293 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d243676-79fc-492c-a4a9-56a2f2343191 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:22.740972 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-aada0274-0626-443c-a309-eddcf74a2781 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 02 03:17:22.740972 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:22.740972 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:22.740972 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:22.740972 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:22.740972 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:22.740972 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:22.740972 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:22.740972 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:22.740972 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:22.740972 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:22.740972 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:22.740972 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 03:17:22.740972 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 03:17:22.740972 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 03:17:22.740972 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 03:17:22.742004 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:22.742004 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:22.742004 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 03:17:22.742004 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 03:17:22.742004 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 03:17:22.742004 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 03:17:22.742004 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:22.742004 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:22.742004 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:22.742004 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:22.742004 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:22.742004 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:22.742004 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:22.742004 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:22.742004 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:22.742004 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:22.742004 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:22.742004 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:22.742966 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:22.742966 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:22.742966 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 03:17:22.742966 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 03:17:22.742966 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 03:17:22.742966 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 03:17:22.742966 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 03:17:22.742966 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 03:17:22.742966 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 02 03:17:22.742966 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:22.742966 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 405/795] 10.222.0.60 () {56 vars in 1117 bytes} [Sat Jul 2 03:17:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 03:17:22.743785 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c7c6a-8366-4bac-92f5-a36cdbcb1f4f None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:22.744046 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c7c6a-8366-4bac-92f5-a36cdbcb1f4f None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:22.744454 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c7c6a-8366-4bac-92f5-a36cdbcb1f4f None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:22.746336 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 406/796] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:17:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:17:22.750780 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3c7c6a-8366-4bac-92f5-a36cdbcb1f4f None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:22.820095 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:22.822584 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:22.856652 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d243676-79fc-492c-a4a9-56a2f2343191 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:22.866898 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3c7c6a-8366-4bac-92f5-a36cdbcb1f4f None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:22.902722 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c664e6c-08ec-4355-ad66-1bcc56932efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:22.903421 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2141015a-038c-4d83-89e2-531e718a69f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:22.904098 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2141015a-038c-4d83-89e2-531e718a69f4 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:22.904319 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c664e6c-08ec-4355-ad66-1bcc56932efd None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:22.904485 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2141015a-038c-4d83-89e2-531e718a69f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:22.904634 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2141015a-038c-4d83-89e2-531e718a69f4 None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:22.905121 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c664e6c-08ec-4355-ad66-1bcc56932efd None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:22.905446 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2141015a-038c-4d83-89e2-531e718a69f4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:22.905716 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c664e6c-08ec-4355-ad66-1bcc56932efd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:22.905825 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2141015a-038c-4d83-89e2-531e718a69f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:22.907156 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2141015a-038c-4d83-89e2-531e718a69f4 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:22.920065 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c664e6c-08ec-4355-ad66-1bcc56932efd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:22.922232 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c664e6c-08ec-4355-ad66-1bcc56932efd None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:22.924949 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 407/797] 10.222.0.60 () {56 vars in 1149 bytes} [Sat Jul 2 03:17:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:22.926203 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f1658-d675-46b8-966f-57aeb2bb2961 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:22.926529 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f1658-d675-46b8-966f-57aeb2bb2961 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:22.926805 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f1658-d675-46b8-966f-57aeb2bb2961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:22.943215 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-574f1658-d675-46b8-966f-57aeb2bb2961 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:17:22.944384 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-574f1658-d675-46b8-966f-57aeb2bb2961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:17:22.948125 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-1c664e6c-08ec-4355-ad66-1bcc56932efd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:22.948125 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:22.948125 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:22.948125 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:22.948125 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:22.948125 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:22.948125 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:22.948125 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:22.948125 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:22.948125 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:22.948125 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:22.948125 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:22.948125 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:17:22.948125 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:17:22.948125 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:17:22.949106 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:17:22.949106 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:22.949106 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:22.949106 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:22.949106 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:22.949106 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:22.949106 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:22.949106 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:22.949106 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:22.949106 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:22.949106 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:22.949106 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:22.949106 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:22.949106 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:22.949106 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:22.949106 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:22.949106 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:22.950005 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:17:22.950005 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:17:22.950005 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:22.950005 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:22.951276 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 391/798] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:17:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:22.953195 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12403385-ee14-4e4b-b379-69b4385a65b5 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:22.953698 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12403385-ee14-4e4b-b379-69b4385a65b5 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:22.954537 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12403385-ee14-4e4b-b379-69b4385a65b5 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:22.956723 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 392/799] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:17:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:17:22.957621 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12403385-ee14-4e4b-b379-69b4385a65b5 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:23.014234 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 408/800] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:17:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 03:17:23.019416 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f1658-d675-46b8-966f-57aeb2bb2961 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:23.073709 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12403385-ee14-4e4b-b379-69b4385a65b5 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:23.079419 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:23.092834 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:23.113455 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea649e94-9091-4cd1-b45b-4e563e822f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:23.114200 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea649e94-9091-4cd1-b45b-4e563e822f43 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:23.114479 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea649e94-9091-4cd1-b45b-4e563e822f43 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:23.114754 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea649e94-9091-4cd1-b45b-4e563e822f43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:23.122152 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f1658-d675-46b8-966f-57aeb2bb2961 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:23.125974 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea649e94-9091-4cd1-b45b-4e563e822f43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:23.127459 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea649e94-9091-4cd1-b45b-4e563e822f43 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:23.145370 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-ea649e94-9091-4cd1-b45b-4e563e822f43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:23.145370 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:23.145370 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:23.145370 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:23.145370 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:23.145370 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:23.145370 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:23.145370 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:23.145370 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:23.145370 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:23.145370 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:23.145370 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:23.145370 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:17:23.145370 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:17:23.145370 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:17:23.146283 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:17:23.146283 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:23.146283 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:23.146283 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:23.146283 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:23.146283 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:23.146283 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:23.146283 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:23.146283 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:23.146283 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:23.146283 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:23.146283 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:23.146283 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:23.146283 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:23.146283 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:23.146283 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:23.146283 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:23.153214 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:17:23.153214 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:17:23.153214 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:23.153214 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:23.153214 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 393/801] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:17:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:23.153214 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c4ee44-7128-49c7-adeb-12c3597eab8e None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:23.153214 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c4ee44-7128-49c7-adeb-12c3597eab8e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:23.153214 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c4ee44-7128-49c7-adeb-12c3597eab8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:23.165720 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-06c4ee44-7128-49c7-adeb-12c3597eab8e None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:17:23.166048 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252a366-c69d-4c9a-8336-2860cbb4088d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:23.166669 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252a366-c69d-4c9a-8336-2860cbb4088d None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:23.166943 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252a366-c69d-4c9a-8336-2860cbb4088d None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:23.167241 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252a366-c69d-4c9a-8336-2860cbb4088d None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:23.167399 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-06c4ee44-7128-49c7-adeb-12c3597eab8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:17:23.167966 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8252a366-c69d-4c9a-8336-2860cbb4088d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:23.168265 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8252a366-c69d-4c9a-8336-2860cbb4088d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:23.169614 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8252a366-c69d-4c9a-8336-2860cbb4088d None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:23.186266 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 409/802] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:17:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:23.186266 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252a366-c69d-4c9a-8336-2860cbb4088d None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:23.248705 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 394/803] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:17:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 03:17:23.249679 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c4ee44-7128-49c7-adeb-12c3597eab8e None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:23.298406 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252a366-c69d-4c9a-8336-2860cbb4088d None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:23.315206 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:23.333127 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c6831-6bf4-4592-9a5c-244923593aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:23.333925 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c6831-6bf4-4592-9a5c-244923593aa4 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:23.334204 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c6831-6bf4-4592-9a5c-244923593aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:23.334475 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c6831-6bf4-4592-9a5c-244923593aa4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:23.345338 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c6831-6bf4-4592-9a5c-244923593aa4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:17:23.349684 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:23.353041 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-1e6c6831-6bf4-4592-9a5c-244923593aa4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 03:17:23.353041 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:23.353041 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:23.353041 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:23.353041 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:23.353041 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:23.353041 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:23.353041 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:23.353041 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:23.353041 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:23.353041 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:23.353041 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:23.353041 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:17:23.353041 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:17:23.353041 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:17:23.353041 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:17:23.354136 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:17:23.354136 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:17:23.354136 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:17:23.354136 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:17:23.354136 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:23.354136 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:23.354136 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:23.354136 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:23.354136 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:23.354136 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:23.354136 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:23.354136 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:23.354136 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:23.354136 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:23.354136 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:23.354136 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:23.359981 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:23.359981 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:23.359981 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:23.359981 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:23.359981 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:17:23.359981 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:17:23.359981 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:17:23.359981 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:17:23.359981 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:17:23.359981 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:17:23.359981 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 03:17:23.359981 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:23.359981 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 410/804] 10.222.0.60 () {56 vars in 1096 bytes} [Sat Jul 2 03:17:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:23.360821 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c4ee44-7128-49c7-adeb-12c3597eab8e None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:23.360919 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c6831-6bf4-4592-9a5c-244923593aa4 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:23.394031 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf1c51-4637-437c-ad55-4f1cc7b6521a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:23.394681 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf1c51-4637-437c-ad55-4f1cc7b6521a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:23.394960 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf1c51-4637-437c-ad55-4f1cc7b6521a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:23.395271 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf1c51-4637-437c-ad55-4f1cc7b6521a None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:23.395992 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cf1c51-4637-437c-ad55-4f1cc7b6521a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:23.396294 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cf1c51-4637-437c-ad55-4f1cc7b6521a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:23.397669 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cf1c51-4637-437c-ad55-4f1cc7b6521a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:23.409419 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 395/805] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:17:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:23.410657 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138ec86-d4ae-4b53-975b-62a7fc381f36 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:23.410938 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138ec86-d4ae-4b53-975b-62a7fc381f36 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:23.411235 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138ec86-d4ae-4b53-975b-62a7fc381f36 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:23.412595 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 396/806] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:17:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:17:23.413112 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138ec86-d4ae-4b53-975b-62a7fc381f36 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:23.459479 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c6831-6bf4-4592-9a5c-244923593aa4 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:23.492381 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec560ce-0961-48e5-b89f-04a05b3c9cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:23.493177 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec560ce-0961-48e5-b89f-04a05b3c9cf0 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:23.493461 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec560ce-0961-48e5-b89f-04a05b3c9cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:23.493733 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec560ce-0961-48e5-b89f-04a05b3c9cf0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:23.502096 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec560ce-0961-48e5-b89f-04a05b3c9cf0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:23.503590 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec560ce-0961-48e5-b89f-04a05b3c9cf0 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:23.510055 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138ec86-d4ae-4b53-975b-62a7fc381f36 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:23.517673 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-aec560ce-0961-48e5-b89f-04a05b3c9cf0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 03:17:23.517673 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:23.517673 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:23.517673 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:23.517673 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:23.517673 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:23.517673 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:23.517673 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:23.517673 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:23.517673 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:23.517673 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:23.517673 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:23.517673 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 03:17:23.517673 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 03:17:23.517673 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 03:17:23.518591 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 03:17:23.518591 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:23.518591 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:23.518591 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:23.518591 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:23.518591 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:23.518591 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:23.518591 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:23.518591 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:23.518591 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:23.518591 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:23.518591 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:23.518591 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:23.518591 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:23.518591 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:23.518591 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:23.518591 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:23.519489 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 03:17:23.519489 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 03:17:23.519489 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 03:17:23.519489 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 03:17:23.519489 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 03:17:23.519489 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 03:17:23.519489 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 03:17:23.519489 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:23.519489 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 411/807] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Jul 2 03:17:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:23.519970 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec560ce-0961-48e5-b89f-04a05b3c9cf0 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:23.548855 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26081cc8-e211-4f11-a80b-a537a56e4630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:23.549662 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26081cc8-e211-4f11-a80b-a537a56e4630 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:23.549937 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26081cc8-e211-4f11-a80b-a537a56e4630 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:23.550203 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26081cc8-e211-4f11-a80b-a537a56e4630 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:23.550844 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26081cc8-e211-4f11-a80b-a537a56e4630 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:23.552258 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26081cc8-e211-4f11-a80b-a537a56e4630 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:23.557979 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:23.564590 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-26081cc8-e211-4f11-a80b-a537a56e4630 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 02 03:17:23.564590 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:23.564590 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 02 03:17:23.564590 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 02 03:17:23.564590 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 02 03:17:23.564590 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 02 03:17:23.564590 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 02 03:17:23.564590 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 03:17:23.564590 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 02 03:17:23.564590 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:23.564590 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 03:17:23.564590 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:23.564590 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:23.564590 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:23.564590 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:23.564590 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:23.565517 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:23.565517 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:23.565517 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:23.565517 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:23.565517 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:23.565517 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:23.565517 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:23.565517 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 02 03:17:23.565517 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 02 03:17:23.565517 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 02 03:17:23.565517 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 02 03:17:23.565517 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:23.565517 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:23.565517 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:23.565517 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:23.565517 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:23.566519 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:23.566519 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:23.566519 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:23.566519 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:23.566519 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:23.566519 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:23.566519 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:23.566519 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:23.566519 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:23.566519 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:23.566519 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:23.566519 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 02 03:17:23.566519 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 03:17:23.566519 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 02 03:17:23.566519 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:23.566519 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 397/808] 10.222.0.60 () {56 vars in 1129 bytes} [Sat Jul 2 03:17:23 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:23.567674 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26081cc8-e211-4f11-a80b-a537a56e4630 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:23.591226 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:23.620897 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec560ce-0961-48e5-b89f-04a05b3c9cf0 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:23.654016 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618bcb19-303a-478f-91a9-4a1da3f06fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:23.654615 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618bcb19-303a-478f-91a9-4a1da3f06fa4 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:23.654894 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618bcb19-303a-478f-91a9-4a1da3f06fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:23.655261 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618bcb19-303a-478f-91a9-4a1da3f06fa4 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:23.656023 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618bcb19-303a-478f-91a9-4a1da3f06fa4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:23.656325 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618bcb19-303a-478f-91a9-4a1da3f06fa4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:23.657685 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618bcb19-303a-478f-91a9-4a1da3f06fa4 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:23.666379 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 412/809] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Jul 2 03:17:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:23.667609 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392d479-2ca9-4473-b7c3-77885605b3ce None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:23.667890 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392d479-2ca9-4473-b7c3-77885605b3ce None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:23.668159 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392d479-2ca9-4473-b7c3-77885605b3ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:23.676999 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26081cc8-e211-4f11-a80b-a537a56e4630 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:23.683922 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-4392d479-2ca9-4473-b7c3-77885605b3ce None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:17:23.685111 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-4392d479-2ca9-4473-b7c3-77885605b3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:17:23.709223 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f97ea0-a2cb-4158-bf7d-5dc784cb3a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:23.710017 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f97ea0-a2cb-4158-bf7d-5dc784cb3a48 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:23.710295 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f97ea0-a2cb-4158-bf7d-5dc784cb3a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:23.710592 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f97ea0-a2cb-4158-bf7d-5dc784cb3a48 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:23.717236 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f97ea0-a2cb-4158-bf7d-5dc784cb3a48 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:23.718684 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f97ea0-a2cb-4158-bf7d-5dc784cb3a48 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:23.733268 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-f5f97ea0-a2cb-4158-bf7d-5dc784cb3a48 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 03:17:23.733268 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:23.733268 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:23.733268 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:23.733268 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:23.733268 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:23.733268 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:23.733268 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:23.733268 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:23.733268 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:23.733268 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:23.733268 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:23.733268 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 03:17:23.733268 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 03:17:23.733268 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 03:17:23.734180 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 03:17:23.734180 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:23.734180 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:23.734180 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:23.734180 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:23.734180 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:23.734180 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:23.734180 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:23.734180 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:23.734180 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:23.734180 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:23.734180 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:23.734180 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:23.734180 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:23.734180 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:23.734180 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:23.734180 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:23.735060 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 03:17:23.735060 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 03:17:23.735060 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 03:17:23.735060 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 03:17:23.735060 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 03:17:23.735060 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 03:17:23.735060 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 03:17:23.735060 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:23.735060 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 398/810] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Jul 2 03:17:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:23.735578 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f97ea0-a2cb-4158-bf7d-5dc784cb3a48 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:23.751893 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 413/811] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:17:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 03:17:23.752731 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392d479-2ca9-4473-b7c3-77885605b3ce None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:23.783345 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:23.817948 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:23.836922 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f97ea0-a2cb-4158-bf7d-5dc784cb3a48 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:23.853346 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392d479-2ca9-4473-b7c3-77885605b3ce None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:23.871230 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad659a3a-fabd-48b4-b18d-ac11a7364c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:23.871884 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad659a3a-fabd-48b4-b18d-ac11a7364c06 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:23.872164 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad659a3a-fabd-48b4-b18d-ac11a7364c06 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:23.872479 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad659a3a-fabd-48b4-b18d-ac11a7364c06 None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:23.873255 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad659a3a-fabd-48b4-b18d-ac11a7364c06 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:23.873560 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad659a3a-fabd-48b4-b18d-ac11a7364c06 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:23.874983 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad659a3a-fabd-48b4-b18d-ac11a7364c06 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:23.886130 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac8491-2d80-4d69-927e-9bb13923df8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:23.886651 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 399/812] 10.222.0.60 () {56 vars in 1148 bytes} [Sat Jul 2 03:17:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:23.886858 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac8491-2d80-4d69-927e-9bb13923df8a None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:23.887163 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac8491-2d80-4d69-927e-9bb13923df8a None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:23.887497 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad659a3a-fabd-48b4-b18d-ac11a7364c06 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:23.887594 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac8491-2d80-4d69-927e-9bb13923df8a None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:23.888203 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fac8491-2d80-4d69-927e-9bb13923df8a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:23.888512 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fac8491-2d80-4d69-927e-9bb13923df8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:23.889865 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fac8491-2d80-4d69-927e-9bb13923df8a None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:23.899373 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 414/813] 10.222.0.60 () {56 vars in 1124 bytes} [Sat Jul 2 03:17:23 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:23.899373 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac8491-2d80-4d69-927e-9bb13923df8a None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:23.987861 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:23.991771 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad659a3a-fabd-48b4-b18d-ac11a7364c06 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:23.994339 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac8491-2d80-4d69-927e-9bb13923df8a None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:24.026366 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef827e22-90b4-4a8c-9a66-b6c6b171ea17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:24.027188 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef827e22-90b4-4a8c-9a66-b6c6b171ea17 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:24.027468 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef827e22-90b4-4a8c-9a66-b6c6b171ea17 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:24.027741 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef827e22-90b4-4a8c-9a66-b6c6b171ea17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:24.030947 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01d6f92-a659-4288-b806-56337d5eb538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:24.031625 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d6f92-a659-4288-b806-56337d5eb538 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:24.031895 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d6f92-a659-4288-b806-56337d5eb538 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:24.032223 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d6f92-a659-4288-b806-56337d5eb538 None admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:24.033001 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01d6f92-a659-4288-b806-56337d5eb538 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:24.033296 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01d6f92-a659-4288-b806-56337d5eb538 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:24.034719 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01d6f92-a659-4288-b806-56337d5eb538 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:24.038868 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef827e22-90b4-4a8c-9a66-b6c6b171ea17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:24.040703 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef827e22-90b4-4a8c-9a66-b6c6b171ea17 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:24.042433 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:24.046536 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 415/814] 10.222.0.60 () {56 vars in 1148 bytes} [Sat Jul 2 03:17:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:24.047936 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01d6f92-a659-4288-b806-56337d5eb538 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:24.059918 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-ef827e22-90b4-4a8c-9a66-b6c6b171ea17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:24.059918 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:24.059918 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:24.059918 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:24.059918 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:24.059918 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:24.059918 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:24.059918 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:24.059918 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:24.059918 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:24.059918 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:24.059918 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:24.059918 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:17:24.059918 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:17:24.059918 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:17:24.060891 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:17:24.060891 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:24.060891 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:24.060891 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:24.060891 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:24.060891 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:24.060891 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:24.060891 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:24.060891 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:24.060891 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:24.060891 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:24.060891 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:24.060891 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:24.060891 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:24.060891 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:24.060891 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:24.060891 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:24.061763 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:17:24.061763 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:17:24.061763 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:24.061763 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:24.061763 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 400/815] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:17:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:24.062202 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef827e22-90b4-4a8c-9a66-b6c6b171ea17 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:24.148842 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01d6f92-a659-4288-b806-56337d5eb538 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:24.156981 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef827e22-90b4-4a8c-9a66-b6c6b171ea17 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:24.181178 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e1cea-0a01-4df3-bc91-e547f86bb5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:24.182013 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e1cea-0a01-4df3-bc91-e547f86bb5d1 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:24.182292 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e1cea-0a01-4df3-bc91-e547f86bb5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:24.182566 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e1cea-0a01-4df3-bc91-e547f86bb5d1 None admin] PATH_INFO: `/v3/services/network` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:24.183249 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92e1cea-0a01-4df3-bc91-e547f86bb5d1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:24.184619 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92e1cea-0a01-4df3-bc91-e547f86bb5d1 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:24.190828 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c1b32e-4283-4ae2-ab82-bacc34b14c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:24.191756 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1b32e-4283-4ae2-ab82-bacc34b14c0c None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:24.192032 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1b32e-4283-4ae2-ab82-bacc34b14c0c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:24.192299 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1b32e-4283-4ae2-ab82-bacc34b14c0c None admin] PATH_INFO: `/v3/projects/e09dc5d9d4904c2b89b0cabed237d55e/users/692ec343bf9f4339ba691440f55a6c37/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:24.194293 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c1b32e-4283-4ae2-ab82-bacc34b14c0c None admin] RBAC: Authorizing `identity:create_grant(project_id=e09dc5d9d4904c2b89b0cabed237d55e, user_id=692ec343bf9f4339ba691440f55a6c37, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:24.195747 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c1b32e-4283-4ae2-ab82-bacc34b14c0c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:24.196068 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-d92e1cea-0a01-4df3-bc91-e547f86bb5d1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 02 03:17:24.196068 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:24.196068 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 02 03:17:24.196068 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 02 03:17:24.196068 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 02 03:17:24.196068 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 02 03:17:24.196068 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 02 03:17:24.196068 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 03:17:24.196068 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 02 03:17:24.196068 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:24.196068 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 03:17:24.196068 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:24.196068 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:24.196068 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:24.196068 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:24.196068 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:24.196068 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:24.197248 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:24.197248 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:24.197248 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:24.197248 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:24.197248 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:24.197248 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:24.197248 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 02 03:17:24.197248 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 02 03:17:24.197248 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 02 03:17:24.197248 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 02 03:17:24.197248 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:24.197248 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:24.197248 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:24.197248 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:24.197248 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:24.197248 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:24.203606 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:24.203606 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:24.203606 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:24.203606 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:24.203606 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:24.203606 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:24.203606 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:24.203606 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:24.203606 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:24.203606 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:24.203606 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 02 03:17:24.203606 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 03:17:24.203606 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 02 03:17:24.203606 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:24.203606 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 416/816] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Jul 2 03:17:24 2022] GET /identity/v3/services/network => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:24.204436 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e1cea-0a01-4df3-bc91-e547f86bb5d1 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:24.208847 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 401/817] 10.222.0.60 () {58 vars in 1439 bytes} [Sat Jul 2 03:17:24 2022] PUT /identity/v3/projects/e09dc5d9d4904c2b89b0cabed237d55e/users/692ec343bf9f4339ba691440f55a6c37/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:17:24.209626 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c1b32e-4283-4ae2-ab82-bacc34b14c0c None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:24.221223 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:24.282219 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:24.316352 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e1cea-0a01-4df3-bc91-e547f86bb5d1 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:24.332873 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c1b32e-4283-4ae2-ab82-bacc34b14c0c None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:24.358113 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2440241e-c559-4ca0-b499-d60d471e933e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:24.358782 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440241e-c559-4ca0-b499-d60d471e933e None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:24.359060 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440241e-c559-4ca0-b499-d60d471e933e None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:24.359357 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440241e-c559-4ca0-b499-d60d471e933e None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:24.360072 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2440241e-c559-4ca0-b499-d60d471e933e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:24.360377 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2440241e-c559-4ca0-b499-d60d471e933e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:24.361776 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2440241e-c559-4ca0-b499-d60d471e933e None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:24.371336 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 417/818] 10.222.0.60 () {56 vars in 1124 bytes} [Sat Jul 2 03:17:24 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:24.372085 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2440241e-c559-4ca0-b499-d60d471e933e None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:24.376817 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf5721a-a7e5-4ea8-8718-eebcb99600c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:24.378263 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5721a-a7e5-4ea8-8718-eebcb99600c5 None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:24.378750 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5721a-a7e5-4ea8-8718-eebcb99600c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:24.379327 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5721a-a7e5-4ea8-8718-eebcb99600c5 None admin] PATH_INFO: `/v3/projects/e09dc5d9d4904c2b89b0cabed237d55e/users/3333e7495b9546d882e2a2211ff8875c/roles/3c71d0e875cd4a00849f14227be8f7ed` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:24.395018 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf5721a-a7e5-4ea8-8718-eebcb99600c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=e09dc5d9d4904c2b89b0cabed237d55e, user_id=3333e7495b9546d882e2a2211ff8875c, role_id=3c71d0e875cd4a00849f14227be8f7ed)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:24.396774 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf5721a-a7e5-4ea8-8718-eebcb99600c5 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:24.413799 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 402/819] 10.222.0.60 () {58 vars in 1439 bytes} [Sat Jul 2 03:17:24 2022] PUT /identity/v3/projects/e09dc5d9d4904c2b89b0cabed237d55e/users/3333e7495b9546d882e2a2211ff8875c/roles/3c71d0e875cd4a00849f14227be8f7ed => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:17:24.419424 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf5721a-a7e5-4ea8-8718-eebcb99600c5 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:24.481604 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:24.504251 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2440241e-c559-4ca0-b499-d60d471e933e None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:24.529283 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf5721a-a7e5-4ea8-8718-eebcb99600c5 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:24.531988 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:24.547101 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25df66d-a2d7-44e3-bdc7-f5c85faaf710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:24.547758 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25df66d-a2d7-44e3-bdc7-f5c85faaf710 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:24.548041 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25df66d-a2d7-44e3-bdc7-f5c85faaf710 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:24.548319 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25df66d-a2d7-44e3-bdc7-f5c85faaf710 None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:24.549060 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25df66d-a2d7-44e3-bdc7-f5c85faaf710 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:24.549409 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25df66d-a2d7-44e3-bdc7-f5c85faaf710 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:24.550933 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25df66d-a2d7-44e3-bdc7-f5c85faaf710 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:24.567165 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 418/820] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:17:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:24.567656 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd88ba1-d2a1-4072-a3f2-56f8358ea736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:24.568071 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25df66d-a2d7-44e3-bdc7-f5c85faaf710 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:24.568332 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd88ba1-d2a1-4072-a3f2-56f8358ea736 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:24.568713 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd88ba1-d2a1-4072-a3f2-56f8358ea736 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:24.568988 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd88ba1-d2a1-4072-a3f2-56f8358ea736 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:24.569705 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd88ba1-d2a1-4072-a3f2-56f8358ea736 None admin] RBAC: Adding query filter params (name=network) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:24.570018 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd88ba1-d2a1-4072-a3f2-56f8358ea736 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:24.571427 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd88ba1-d2a1-4072-a3f2-56f8358ea736 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:24.576881 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 403/821] 10.222.0.60 () {56 vars in 1112 bytes} [Sat Jul 2 03:17:24 2022] GET /identity/v3/services?name=network => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:24.577738 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd88ba1-d2a1-4072-a3f2-56f8358ea736 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:24.683398 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25df66d-a2d7-44e3-bdc7-f5c85faaf710 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:24.694558 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd88ba1-d2a1-4072-a3f2-56f8358ea736 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:24.724547 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0792164a-c07a-4125-9704-a8b47f0fab97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:24.725350 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792164a-c07a-4125-9704-a8b47f0fab97 None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:24.725632 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792164a-c07a-4125-9704-a8b47f0fab97 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:24.725906 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792164a-c07a-4125-9704-a8b47f0fab97 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:24.726882 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0792164a-c07a-4125-9704-a8b47f0fab97 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:24.729020 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0792164a-c07a-4125-9704-a8b47f0fab97 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:24.733533 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc92ee56-2442-4c29-91d9-d138e947ab8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:24.734717 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92ee56-2442-4c29-91d9-d138e947ab8f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:24.735272 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92ee56-2442-4c29-91d9-d138e947ab8f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:24.735732 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92ee56-2442-4c29-91d9-d138e947ab8f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:24.744566 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc92ee56-2442-4c29-91d9-d138e947ab8f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:24.746055 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc92ee56-2442-4c29-91d9-d138e947ab8f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:24.750398 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:24.757664 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 419/822] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Jul 2 03:17:24 2022] POST /identity/v3/endpoints => generated 346 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:17:24.758835 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0792164a-c07a-4125-9704-a8b47f0fab97 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:24.764889 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-fc92ee56-2442-4c29-91d9-d138e947ab8f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 02 03:17:24.764889 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:24.764889 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:24.764889 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:24.764889 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:24.764889 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:24.764889 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:24.764889 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:24.764889 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:24.764889 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:24.764889 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:24.764889 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:24.764889 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 03:17:24.764889 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 03:17:24.764889 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 03:17:24.764889 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 03:17:24.765882 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:24.765882 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:24.765882 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 03:17:24.765882 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 03:17:24.765882 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 03:17:24.765882 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 03:17:24.765882 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:24.765882 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:24.765882 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:24.765882 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:24.765882 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:24.765882 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:24.765882 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:24.765882 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:24.765882 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:24.765882 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:24.765882 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:24.765882 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:24.766821 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:24.766821 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:24.766821 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 03:17:24.766821 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 03:17:24.766821 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 03:17:24.766821 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 03:17:24.766821 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 03:17:24.766821 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 03:17:24.766821 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 02 03:17:24.766821 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:24.770088 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 404/823] 10.222.0.60 () {56 vars in 1093 bytes} [Sat Jul 2 03:17:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:24.775904 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc92ee56-2442-4c29-91d9-d138e947ab8f None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:24.813682 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:24.896663 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc92ee56-2442-4c29-91d9-d138e947ab8f None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:24.940565 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b853a38f-88ea-4815-ac32-e2b1271f71d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:24.941251 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853a38f-88ea-4815-ac32-e2b1271f71d7 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:24.941525 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853a38f-88ea-4815-ac32-e2b1271f71d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:24.941800 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853a38f-88ea-4815-ac32-e2b1271f71d7 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:24.942642 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b853a38f-88ea-4815-ac32-e2b1271f71d7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:24.942948 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b853a38f-88ea-4815-ac32-e2b1271f71d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:24.944511 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b853a38f-88ea-4815-ac32-e2b1271f71d7 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:24.969303 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 405/824] 10.222.0.60 () {56 vars in 1133 bytes} [Sat Jul 2 03:17:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:24.970649 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b853a38f-88ea-4815-ac32-e2b1271f71d7 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:25.023570 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0792164a-c07a-4125-9704-a8b47f0fab97 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:25.068258 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:25.072533 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be152f87-c7ee-4dbe-8da1-0e47d4667714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:25.073553 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be152f87-c7ee-4dbe-8da1-0e47d4667714 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:25.073832 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be152f87-c7ee-4dbe-8da1-0e47d4667714 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:25.074110 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be152f87-c7ee-4dbe-8da1-0e47d4667714 None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:25.074835 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be152f87-c7ee-4dbe-8da1-0e47d4667714 None admin] RBAC: Adding query filter params (type=network) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:25.075152 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be152f87-c7ee-4dbe-8da1-0e47d4667714 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:25.077551 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be152f87-c7ee-4dbe-8da1-0e47d4667714 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:25.086030 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 420/825] 10.222.0.60 () {56 vars in 1112 bytes} [Sat Jul 2 03:17:24 2022] GET /identity/v3/services?type=network => generated 350 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:25.091919 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be152f87-c7ee-4dbe-8da1-0e47d4667714 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:25.093051 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b853a38f-88ea-4815-ac32-e2b1271f71d7 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:25.133217 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38dd174-a19b-44d4-b0ca-5204d22e6fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:25.133862 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38dd174-a19b-44d4-b0ca-5204d22e6fa5 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:25.134146 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38dd174-a19b-44d4-b0ca-5204d22e6fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:25.134429 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38dd174-a19b-44d4-b0ca-5204d22e6fa5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:25.187486 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:25.255970 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38dd174-a19b-44d4-b0ca-5204d22e6fa5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:25.257762 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38dd174-a19b-44d4-b0ca-5204d22e6fa5 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:25.262807 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be152f87-c7ee-4dbe-8da1-0e47d4667714 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:25.328627 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf3e77-9905-42a9-ae13-590ce3487b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:25.329276 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf3e77-9905-42a9-ae13-590ce3487b38 None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:25.329510 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf3e77-9905-42a9-ae13-590ce3487b38 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:25.329738 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf3e77-9905-42a9-ae13-590ce3487b38 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:25.330501 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccf3e77-9905-42a9-ae13-590ce3487b38 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:25.332231 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccf3e77-9905-42a9-ae13-590ce3487b38 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:25.366904 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 421/826] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Jul 2 03:17:25 2022] POST /identity/v3/endpoints => generated 327 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 03:17:25.409679 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:25.415490 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 406/827] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Jul 2 03:17:24 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 02 03:17:25.421672 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf3e77-9905-42a9-ae13-590ce3487b38 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:25.568206 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf3e77-9905-42a9-ae13-590ce3487b38 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:25.583979 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:25.606604 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6002c3-f2b8-4153-b067-190c9c553ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:25.607449 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6002c3-f2b8-4153-b067-190c9c553ac8 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:25.607730 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6002c3-f2b8-4153-b067-190c9c553ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:25.608002 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6002c3-f2b8-4153-b067-190c9c553ac8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:25.619220 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6002c3-f2b8-4153-b067-190c9c553ac8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:25.620694 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6002c3-f2b8-4153-b067-190c9c553ac8 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:25.638283 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-4d6002c3-f2b8-4153-b067-190c9c553ac8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:25.638283 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:25.638283 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:25.638283 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:25.638283 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:25.638283 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:25.638283 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:25.638283 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:25.638283 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:25.638283 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:25.638283 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:25.638283 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:25.638283 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:17:25.638283 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:17:25.638283 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:17:25.639223 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:17:25.639223 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:25.639223 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:25.639223 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:25.639223 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:25.639223 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:25.639223 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:25.639223 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:25.639223 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:25.639223 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:25.639223 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:25.639223 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:25.639223 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:25.639223 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:25.639223 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:25.639223 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:25.639223 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:25.640113 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:17:25.640113 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:17:25.640113 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:25.640113 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:25.640113 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 422/828] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:17:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:25.645819 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38dd174-a19b-44d4-b0ca-5204d22e6fa5 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:25.783311 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38dd174-a19b-44d4-b0ca-5204d22e6fa5 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:25.826700 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a2a33d-9229-42f4-95fe-569d7269df57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:25.827430 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a2a33d-9229-42f4-95fe-569d7269df57 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:25.827710 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a2a33d-9229-42f4-95fe-569d7269df57 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:25.827984 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a2a33d-9229-42f4-95fe-569d7269df57 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:25.828710 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a2a33d-9229-42f4-95fe-569d7269df57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:25.829016 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a2a33d-9229-42f4-95fe-569d7269df57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:25.830389 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a2a33d-9229-42f4-95fe-569d7269df57 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:25.845074 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 407/829] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:17:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:25.850731 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6002c3-f2b8-4153-b067-190c9c553ac8 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:25.955453 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6002c3-f2b8-4153-b067-190c9c553ac8 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:25.989445 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81ff412-6f39-46d2-9a59-4acde340f711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:25.990567 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ff412-6f39-46d2-9a59-4acde340f711 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:25.991093 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ff412-6f39-46d2-9a59-4acde340f711 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:25.991616 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ff412-6f39-46d2-9a59-4acde340f711 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:25.998611 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81ff412-6f39-46d2-9a59-4acde340f711 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:26.000303 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81ff412-6f39-46d2-9a59-4acde340f711 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:26.014782 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-b81ff412-6f39-46d2-9a59-4acde340f711 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 03:17:26.014782 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:26.014782 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:26.014782 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:26.014782 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:26.014782 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:26.014782 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:26.014782 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:26.014782 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:26.014782 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:26.014782 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:26.014782 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:26.014782 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 03:17:26.014782 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 03:17:26.014782 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 03:17:26.015725 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 03:17:26.015725 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:26.015725 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:26.015725 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:26.015725 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:26.015725 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:26.015725 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:26.015725 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:26.015725 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:26.015725 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:26.015725 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:26.015725 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:26.015725 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:26.015725 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:26.015725 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:26.015725 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:26.015725 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:26.016611 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 03:17:26.016611 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 03:17:26.016611 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 03:17:26.016611 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 03:17:26.016611 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 03:17:26.016611 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 03:17:26.016611 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 03:17:26.016611 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:26.019150 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 423/830] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Jul 2 03:17:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 03:17:26.031195 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a2a33d-9229-42f4-95fe-569d7269df57 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:26.068709 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:26.127844 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a2a33d-9229-42f4-95fe-569d7269df57 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:26.161398 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc98a00-2738-4184-9922-fb1c1e77bee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:26.162065 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc98a00-2738-4184-9922-fb1c1e77bee2 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:26.162339 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc98a00-2738-4184-9922-fb1c1e77bee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:26.162608 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc98a00-2738-4184-9922-fb1c1e77bee2 None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:26.163417 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc98a00-2738-4184-9922-fb1c1e77bee2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:26.163720 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc98a00-2738-4184-9922-fb1c1e77bee2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:26.165522 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc98a00-2738-4184-9922-fb1c1e77bee2 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:26.183236 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 408/831] 10.222.0.60 () {56 vars in 1148 bytes} [Sat Jul 2 03:17:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:26.188225 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81ff412-6f39-46d2-9a59-4acde340f711 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:26.219888 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:26.293526 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81ff412-6f39-46d2-9a59-4acde340f711 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:26.331402 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec7c54-2431-45fd-99cd-57f81808b554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:26.332170 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec7c54-2431-45fd-99cd-57f81808b554 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:26.332360 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec7c54-2431-45fd-99cd-57f81808b554 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:26.332614 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec7c54-2431-45fd-99cd-57f81808b554 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:26.333460 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ec7c54-2431-45fd-99cd-57f81808b554 None admin] RBAC: Adding query filter params (role.id=5dcd130cda6c490595e862dc2348e83d, scope.project.id=e09dc5d9d4904c2b89b0cabed237d55e, user.id=13530240e2d446b6bf26a431d001362a) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:26.333767 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ec7c54-2431-45fd-99cd-57f81808b554 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:26.335229 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ec7c54-2431-45fd-99cd-57f81808b554 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:26.341764 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 424/832] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Jul 2 03:17:26 2022] GET /identity/v3/role_assignments?user.id=13530240e2d446b6bf26a431d001362a&scope.project.id=e09dc5d9d4904c2b89b0cabed237d55e&role.id=5dcd130cda6c490595e862dc2348e83d => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:26.430383 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74106fb-8b90-4d34-869d-7b1c9e2e103f None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:26.430913 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74106fb-8b90-4d34-869d-7b1c9e2e103f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:26.430913 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74106fb-8b90-4d34-869d-7b1c9e2e103f None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:26.432758 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 409/833] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:17:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:17:26.438351 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483209c4-9a70-4463-90be-76ed500276c8 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:26.438638 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483209c4-9a70-4463-90be-76ed500276c8 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:26.438914 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483209c4-9a70-4463-90be-76ed500276c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:26.456888 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-483209c4-9a70-4463-90be-76ed500276c8 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:17:26.458108 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-483209c4-9a70-4463-90be-76ed500276c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:17:26.530460 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 425/834] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:17:26 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 03:17:26.555843 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74106fb-8b90-4d34-869d-7b1c9e2e103f None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:26.633005 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec2450-ca0b-4c56-8b59-0f19c83c2f2f None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:26.633338 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec2450-ca0b-4c56-8b59-0f19c83c2f2f None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:26.633524 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec2450-ca0b-4c56-8b59-0f19c83c2f2f None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:26.635100 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 426/835] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:17:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 03:17:26.640339 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226668a3-fe72-465e-8f27-d32ef9108807 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:26.640869 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226668a3-fe72-465e-8f27-d32ef9108807 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:26.641239 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226668a3-fe72-465e-8f27-d32ef9108807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:26.659150 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-226668a3-fe72-465e-8f27-d32ef9108807 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:17:26.660475 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-226668a3-fe72-465e-8f27-d32ef9108807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:17:26.671058 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74106fb-8b90-4d34-869d-7b1c9e2e103f None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:26.673033 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:26.677300 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:26.719272 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeeda95-e8f0-4dfc-92f1-59c5add10a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:26.720095 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeeda95-e8f0-4dfc-92f1-59c5add10a2a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:26.720378 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeeda95-e8f0-4dfc-92f1-59c5add10a2a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:26.720655 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeeda95-e8f0-4dfc-92f1-59c5add10a2a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:26.732960 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeeda95-e8f0-4dfc-92f1-59c5add10a2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:17:26.740992 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-feeeda95-e8f0-4dfc-92f1-59c5add10a2a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 03:17:26.740992 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:26.740992 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:26.740992 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:26.740992 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:26.740992 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:26.740992 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:26.740992 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:26.740992 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:26.740992 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:26.740992 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:26.740992 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:26.740992 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:17:26.740992 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:17:26.740992 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:17:26.740992 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:17:26.742030 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:17:26.742030 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:17:26.742030 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:17:26.742030 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:17:26.742030 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:26.742030 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:26.742030 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:26.742030 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:26.742030 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:26.742030 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:26.742030 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:26.742030 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:26.742030 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:26.742030 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:26.742030 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:26.742030 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:26.742865 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:26.742865 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:26.742865 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:26.742865 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:26.742865 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:17:26.742865 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:17:26.742865 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:17:26.742865 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:17:26.742865 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:17:26.742865 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:17:26.742865 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 03:17:26.742865 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:26.742865 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 410/836] 10.222.0.60 () {56 vars in 1096 bytes} [Sat Jul 2 03:17:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 03:17:26.748826 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeeda95-e8f0-4dfc-92f1-59c5add10a2a None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:26.863465 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeeda95-e8f0-4dfc-92f1-59c5add10a2a None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:26.879485 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 427/837] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:17:26 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 02 03:17:26.902483 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226668a3-fe72-465e-8f27-d32ef9108807 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:26.911443 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8661e7e-b4c5-4bcf-af47-5f452694401e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:26.912118 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8661e7e-b4c5-4bcf-af47-5f452694401e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:26.912394 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8661e7e-b4c5-4bcf-af47-5f452694401e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:26.912666 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8661e7e-b4c5-4bcf-af47-5f452694401e None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:26.913551 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8661e7e-b4c5-4bcf-af47-5f452694401e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:26.913856 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8661e7e-b4c5-4bcf-af47-5f452694401e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:26.915657 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8661e7e-b4c5-4bcf-af47-5f452694401e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:26.929373 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 411/838] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Jul 2 03:17:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:17:26.930397 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8661e7e-b4c5-4bcf-af47-5f452694401e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:26.958715 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:27.030898 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226668a3-fe72-465e-8f27-d32ef9108807 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:27.051299 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8661e7e-b4c5-4bcf-af47-5f452694401e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:27.066512 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882c1e5f-92b9-4ca5-8763-f496ab3b8c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:27.067314 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c1e5f-92b9-4ca5-8763-f496ab3b8c52 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:27.067680 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c1e5f-92b9-4ca5-8763-f496ab3b8c52 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:27.068045 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c1e5f-92b9-4ca5-8763-f496ab3b8c52 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:27.082456 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882c1e5f-92b9-4ca5-8763-f496ab3b8c52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:17:27.093623 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-882c1e5f-92b9-4ca5-8763-f496ab3b8c52 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 02 03:17:27.093623 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:27.093623 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:27.093623 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:27.093623 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:27.093623 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:27.093623 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:27.093623 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:27.093623 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:27.093623 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:27.093623 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:27.093623 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:27.093623 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:17:27.093623 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:17:27.093623 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:17:27.093623 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:17:27.094610 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:17:27.094610 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:17:27.094610 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:17:27.094610 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:17:27.094610 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:27.094610 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:27.094610 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:27.094610 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:27.094610 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:27.094610 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:27.094610 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:27.094610 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:27.094610 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:27.094610 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:27.094610 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:27.094610 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:27.095468 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:27.095468 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:27.095468 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:27.095468 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:27.095468 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:17:27.095468 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:17:27.095468 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:17:27.095468 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:17:27.095468 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:17:27.095468 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:17:27.095468 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 02 03:17:27.095468 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:27.096108 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96857af0-f5c6-41fe-887f-76ea5c884f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:27.096108 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96857af0-f5c6-41fe-887f-76ea5c884f6e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:27.096108 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96857af0-f5c6-41fe-887f-76ea5c884f6e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:27.096108 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96857af0-f5c6-41fe-887f-76ea5c884f6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:27.098406 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 428/839] 10.222.0.60 () {56 vars in 1102 bytes} [Sat Jul 2 03:17:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 03:17:27.104417 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882c1e5f-92b9-4ca5-8763-f496ab3b8c52 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:27.113362 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96857af0-f5c6-41fe-887f-76ea5c884f6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:27.114964 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96857af0-f5c6-41fe-887f-76ea5c884f6e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:27.120546 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:27.134654 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-96857af0-f5c6-41fe-887f-76ea5c884f6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:27.134654 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:27.134654 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:27.134654 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:27.134654 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:27.134654 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:27.134654 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:27.134654 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:27.134654 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:27.134654 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:27.134654 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:27.134654 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:27.134654 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:17:27.134654 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:17:27.134654 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:17:27.135642 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:17:27.135642 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:27.135642 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:27.135642 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:27.135642 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:27.135642 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:27.135642 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:27.135642 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:27.135642 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:27.135642 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:27.135642 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:27.135642 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:27.135642 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:27.135642 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:27.135642 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:27.135642 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:27.135642 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:27.136540 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:17:27.136540 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:17:27.136540 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:27.136540 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:27.140882 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 412/840] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:17:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:27.141851 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96857af0-f5c6-41fe-887f-76ea5c884f6e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:27.227375 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:27.237586 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882c1e5f-92b9-4ca5-8763-f496ab3b8c52 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:27.252825 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96857af0-f5c6-41fe-887f-76ea5c884f6e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:27.272046 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959a9590-0a14-4cc4-97b2-4f349815c085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:27.273096 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a9590-0a14-4cc4-97b2-4f349815c085 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:27.273096 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a9590-0a14-4cc4-97b2-4f349815c085 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:27.273365 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a9590-0a14-4cc4-97b2-4f349815c085 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:27.274190 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959a9590-0a14-4cc4-97b2-4f349815c085 None admin] RBAC: Adding query filter params (name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:27.274429 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959a9590-0a14-4cc4-97b2-4f349815c085 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:27.276175 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959a9590-0a14-4cc4-97b2-4f349815c085 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:27.288974 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 429/841] 10.222.0.60 () {56 vars in 1103 bytes} [Sat Jul 2 03:17:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:27.288974 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09798ef7-8677-48c5-92c3-f9791cbc39d9 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:27.288974 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09798ef7-8677-48c5-92c3-f9791cbc39d9 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:27.288974 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09798ef7-8677-48c5-92c3-f9791cbc39d9 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:27.288974 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 430/842] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:17:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:17:27.291802 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a14796-54af-4cad-b4eb-482c8e1fa33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:27.292475 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a14796-54af-4cad-b4eb-482c8e1fa33c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:27.292747 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a14796-54af-4cad-b4eb-482c8e1fa33c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:27.293020 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a14796-54af-4cad-b4eb-482c8e1fa33c None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:27.293176 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09798ef7-8677-48c5-92c3-f9791cbc39d9 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:27.293749 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a14796-54af-4cad-b4eb-482c8e1fa33c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:27.294058 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a14796-54af-4cad-b4eb-482c8e1fa33c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:27.295479 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a14796-54af-4cad-b4eb-482c8e1fa33c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:27.312450 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 413/843] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:17:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:27.312450 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf5290-3231-4a9d-b6ab-1ad4bfaef7d0 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:27.312450 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf5290-3231-4a9d-b6ab-1ad4bfaef7d0 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:27.312450 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf5290-3231-4a9d-b6ab-1ad4bfaef7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:27.326505 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-edcf5290-3231-4a9d-b6ab-1ad4bfaef7d0 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:17:27.327721 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-edcf5290-3231-4a9d-b6ab-1ad4bfaef7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:17:27.366716 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:27.400584 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 414/844] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:17:27 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 03:17:27.401754 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf5290-3231-4a9d-b6ab-1ad4bfaef7d0 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:27.416624 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09798ef7-8677-48c5-92c3-f9791cbc39d9 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:27.453736 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7fc8ba-8b7a-43d9-85df-7e50ed77c919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:27.454528 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7fc8ba-8b7a-43d9-85df-7e50ed77c919 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:27.454800 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7fc8ba-8b7a-43d9-85df-7e50ed77c919 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:27.455063 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7fc8ba-8b7a-43d9-85df-7e50ed77c919 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:27.465674 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7fc8ba-8b7a-43d9-85df-7e50ed77c919 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:27.467107 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7fc8ba-8b7a-43d9-85df-7e50ed77c919 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:27.477352 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:27.484992 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-9f7fc8ba-8b7a-43d9-85df-7e50ed77c919 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:27.484992 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:27.484992 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:27.484992 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:27.484992 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:27.484992 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:27.484992 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:27.484992 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:27.484992 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:27.484992 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:27.484992 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:27.484992 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:27.484992 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:17:27.484992 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:17:27.484992 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:17:27.485879 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:17:27.485879 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:27.485879 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:27.485879 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:27.485879 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:27.485879 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:27.485879 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:27.485879 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:27.485879 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:27.485879 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:27.485879 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:27.485879 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:27.485879 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:27.485879 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:27.485879 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:27.485879 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:27.485879 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:27.486767 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:17:27.486767 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:17:27.486767 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:27.486767 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:27.486767 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 431/845] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:17:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:27.487055 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7fc8ba-8b7a-43d9-85df-7e50ed77c919 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:27.516427 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf5290-3231-4a9d-b6ab-1ad4bfaef7d0 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:27.552478 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43b63fa-991c-4cab-a18c-e2eb3150881a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:27.553696 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b63fa-991c-4cab-a18c-e2eb3150881a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:27.554103 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b63fa-991c-4cab-a18c-e2eb3150881a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:27.554337 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b63fa-991c-4cab-a18c-e2eb3150881a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:27.561862 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43b63fa-991c-4cab-a18c-e2eb3150881a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:27.563334 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43b63fa-991c-4cab-a18c-e2eb3150881a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:27.577620 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-a43b63fa-991c-4cab-a18c-e2eb3150881a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 02 03:17:27.577620 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:27.577620 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:27.577620 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:27.577620 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:27.577620 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:27.577620 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:27.577620 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:27.577620 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:27.577620 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:27.577620 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:27.577620 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:27.577620 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 03:17:27.577620 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 03:17:27.577620 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 03:17:27.577620 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 03:17:27.578622 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:27.578622 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:27.578622 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 03:17:27.578622 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 03:17:27.578622 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 03:17:27.578622 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 03:17:27.578622 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:27.578622 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:27.578622 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:27.578622 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:27.578622 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:27.578622 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:27.578622 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:27.578622 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:27.578622 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:27.578622 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:27.578622 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:27.578622 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:27.579598 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:27.579598 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:27.579598 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 03:17:27.579598 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 03:17:27.579598 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 03:17:27.579598 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 03:17:27.579598 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 03:17:27.579598 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 03:17:27.579598 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 02 03:17:27.579598 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:27.579598 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 415/846] 10.222.0.60 () {56 vars in 1096 bytes} [Sat Jul 2 03:17:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:27.579598 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43b63fa-991c-4cab-a18c-e2eb3150881a None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:27.605744 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7fc8ba-8b7a-43d9-85df-7e50ed77c919 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:27.630447 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:27.642268 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105bc249-2d85-4143-8f2d-17f46c536222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:27.643058 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105bc249-2d85-4143-8f2d-17f46c536222 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:27.643374 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105bc249-2d85-4143-8f2d-17f46c536222 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:27.643640 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105bc249-2d85-4143-8f2d-17f46c536222 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:27.644292 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105bc249-2d85-4143-8f2d-17f46c536222 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:27.645653 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105bc249-2d85-4143-8f2d-17f46c536222 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:27.657374 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-105bc249-2d85-4143-8f2d-17f46c536222 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 02 03:17:27.657374 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:27.657374 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 02 03:17:27.657374 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 02 03:17:27.657374 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 02 03:17:27.657374 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 02 03:17:27.657374 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 02 03:17:27.657374 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 03:17:27.657374 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 02 03:17:27.657374 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:27.657374 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 03:17:27.657374 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:27.657374 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:27.657374 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:27.657374 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:27.657374 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:27.657374 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:27.658354 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:27.658354 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:27.658354 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:27.658354 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:27.658354 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:27.658354 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:27.658354 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 02 03:17:27.658354 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 02 03:17:27.658354 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 02 03:17:27.658354 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 02 03:17:27.658354 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:27.658354 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:27.658354 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:27.658354 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:27.658354 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:27.658354 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:27.665182 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:27.665182 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:27.665182 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:27.665182 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:27.665182 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:27.665182 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:27.665182 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:27.665182 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:27.665182 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:27.665182 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:27.665182 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 02 03:17:27.665182 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 03:17:27.665182 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 02 03:17:27.665182 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:27.665182 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 432/847] 10.222.0.60 () {56 vars in 1114 bytes} [Sat Jul 2 03:17:27 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:27.666034 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105bc249-2d85-4143-8f2d-17f46c536222 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:27.689332 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43b63fa-991c-4cab-a18c-e2eb3150881a None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:27.714399 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:27.723936 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4da3e6-e11a-4f89-bada-b2e1680f7e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:27.724599 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4da3e6-e11a-4f89-bada-b2e1680f7e6b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:27.724905 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4da3e6-e11a-4f89-bada-b2e1680f7e6b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:27.725158 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4da3e6-e11a-4f89-bada-b2e1680f7e6b None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:27.725880 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4da3e6-e11a-4f89-bada-b2e1680f7e6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:27.726185 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4da3e6-e11a-4f89-bada-b2e1680f7e6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:27.727598 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4da3e6-e11a-4f89-bada-b2e1680f7e6b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:27.740188 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 416/848] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:17:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:27.740944 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4da3e6-e11a-4f89-bada-b2e1680f7e6b None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:27.769394 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105bc249-2d85-4143-8f2d-17f46c536222 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:27.804497 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635127a2-28cf-4231-acf5-f48b2a08e88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:27.805166 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635127a2-28cf-4231-acf5-f48b2a08e88c None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:27.805452 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635127a2-28cf-4231-acf5-f48b2a08e88c None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:27.805718 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635127a2-28cf-4231-acf5-f48b2a08e88c None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:27.806610 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635127a2-28cf-4231-acf5-f48b2a08e88c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:27.806918 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635127a2-28cf-4231-acf5-f48b2a08e88c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:27.808455 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635127a2-28cf-4231-acf5-f48b2a08e88c None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:27.825824 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 433/849] 10.222.0.60 () {56 vars in 1135 bytes} [Sat Jul 2 03:17:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:27.826623 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635127a2-28cf-4231-acf5-f48b2a08e88c None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:27.846577 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4da3e6-e11a-4f89-bada-b2e1680f7e6b None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:27.877988 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:27.884649 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bf5a3d-4caa-43d7-80fe-27ec9afaad1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:27.885506 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf5a3d-4caa-43d7-80fe-27ec9afaad1c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:27.885951 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf5a3d-4caa-43d7-80fe-27ec9afaad1c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:27.886361 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf5a3d-4caa-43d7-80fe-27ec9afaad1c None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:27.887231 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bf5a3d-4caa-43d7-80fe-27ec9afaad1c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:27.887672 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bf5a3d-4caa-43d7-80fe-27ec9afaad1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:27.889193 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bf5a3d-4caa-43d7-80fe-27ec9afaad1c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:27.894001 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 417/850] 10.222.0.60 () {56 vars in 1114 bytes} [Sat Jul 2 03:17:27 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:27.894773 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bf5a3d-4caa-43d7-80fe-27ec9afaad1c None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:27.941467 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635127a2-28cf-4231-acf5-f48b2a08e88c None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:27.946957 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:27.978135 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d3dbe-5f0a-4d3f-8b14-e50b560c591d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:27.978964 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d3dbe-5f0a-4d3f-8b14-e50b560c591d None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:27.979276 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d3dbe-5f0a-4d3f-8b14-e50b560c591d None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:27.979546 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d3dbe-5f0a-4d3f-8b14-e50b560c591d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:27.987153 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135d3dbe-5f0a-4d3f-8b14-e50b560c591d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:27.988588 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135d3dbe-5f0a-4d3f-8b14-e50b560c591d None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:27.999616 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bf5a3d-4caa-43d7-80fe-27ec9afaad1c None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:28.004246 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-135d3dbe-5f0a-4d3f-8b14-e50b560c591d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 02 03:17:28.004246 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:28.004246 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:28.004246 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:28.004246 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:28.004246 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:28.004246 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:28.004246 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:28.004246 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:28.004246 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:28.004246 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:28.004246 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:28.004246 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 03:17:28.004246 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 03:17:28.004246 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 03:17:28.004246 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 03:17:28.005166 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:28.005166 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:28.005166 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 03:17:28.005166 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 03:17:28.005166 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 03:17:28.005166 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 03:17:28.005166 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:28.005166 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:28.005166 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:28.005166 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:28.005166 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:28.005166 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:28.005166 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:28.005166 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:28.005166 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:28.005166 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:28.005166 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:28.005166 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:28.006211 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:28.006211 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:28.006211 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 03:17:28.006211 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 03:17:28.006211 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 03:17:28.006211 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 03:17:28.006211 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 03:17:28.006211 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 03:17:28.006211 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 02 03:17:28.006211 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:28.006211 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 434/851] 10.222.0.60 () {56 vars in 1117 bytes} [Sat Jul 2 03:17:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:28.006803 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d3dbe-5f0a-4d3f-8b14-e50b560c591d None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:28.041313 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fb5aec-abe9-472a-ac31-e1dec7d0fc72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:28.041962 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb5aec-abe9-472a-ac31-e1dec7d0fc72 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:28.042244 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb5aec-abe9-472a-ac31-e1dec7d0fc72 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:28.042503 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb5aec-abe9-472a-ac31-e1dec7d0fc72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:28.115272 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d3dbe-5f0a-4d3f-8b14-e50b560c591d None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:28.115512 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fb5aec-abe9-472a-ac31-e1dec7d0fc72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:28.117280 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fb5aec-abe9-472a-ac31-e1dec7d0fc72 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:28.123018 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:28.152191 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4ec9af-8499-4a21-ac7c-23efed7bc4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:28.153243 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ec9af-8499-4a21-ac7c-23efed7bc4fc None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:28.153527 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ec9af-8499-4a21-ac7c-23efed7bc4fc None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:28.153801 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ec9af-8499-4a21-ac7c-23efed7bc4fc None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:28.154522 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4ec9af-8499-4a21-ac7c-23efed7bc4fc None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:28.154829 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4ec9af-8499-4a21-ac7c-23efed7bc4fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:28.156372 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4ec9af-8499-4a21-ac7c-23efed7bc4fc None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:28.161707 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 435/852] 10.222.0.60 () {56 vars in 1114 bytes} [Sat Jul 2 03:17:28 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:28.167458 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4ec9af-8499-4a21-ac7c-23efed7bc4fc None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:28.174698 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:28.233881 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 418/853] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Jul 2 03:17:27 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 02 03:17:28.240199 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fb5aec-abe9-472a-ac31-e1dec7d0fc72 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:28.297231 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4ec9af-8499-4a21-ac7c-23efed7bc4fc None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:28.348502 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e65ff7-a053-486d-abf9-84886a48cda5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:28.350195 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e65ff7-a053-486d-abf9-84886a48cda5 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:28.350693 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e65ff7-a053-486d-abf9-84886a48cda5 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:28.351059 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e65ff7-a053-486d-abf9-84886a48cda5 None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:28.352271 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e65ff7-a053-486d-abf9-84886a48cda5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:28.352977 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e65ff7-a053-486d-abf9-84886a48cda5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:28.354869 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e65ff7-a053-486d-abf9-84886a48cda5 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:28.356776 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fb5aec-abe9-472a-ac31-e1dec7d0fc72 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:28.377710 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 436/854] 10.222.0.60 () {56 vars in 1149 bytes} [Sat Jul 2 03:17:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:28.383535 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e65ff7-a053-486d-abf9-84886a48cda5 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:28.400092 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56123b7f-3533-4ed4-a4a8-90c04bef64cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:28.401078 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56123b7f-3533-4ed4-a4a8-90c04bef64cc None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:28.401370 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56123b7f-3533-4ed4-a4a8-90c04bef64cc None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:28.401649 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56123b7f-3533-4ed4-a4a8-90c04bef64cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:28.414740 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56123b7f-3533-4ed4-a4a8-90c04bef64cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:28.417041 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56123b7f-3533-4ed4-a4a8-90c04bef64cc None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:28.419791 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:28.437292 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-56123b7f-3533-4ed4-a4a8-90c04bef64cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:28.437292 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:28.437292 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:28.437292 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:28.437292 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:28.437292 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:28.437292 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:28.437292 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:28.437292 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:28.437292 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:28.437292 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:28.437292 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:28.437292 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:17:28.437292 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:17:28.437292 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:17:28.438256 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:17:28.438256 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:28.438256 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:28.438256 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:28.438256 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:28.438256 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:28.438256 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:28.438256 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:28.438256 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:28.438256 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:28.438256 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:28.438256 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:28.438256 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:28.438256 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:28.438256 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:28.438256 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:28.438256 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:28.439108 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:17:28.439108 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:17:28.439108 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:28.439108 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:28.439108 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 419/855] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:17:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:28.445600 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56123b7f-3533-4ed4-a4a8-90c04bef64cc None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:28.449104 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:28.502587 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e65ff7-a053-486d-abf9-84886a48cda5 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:28.537376 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6387c4a-48b7-4127-b420-1c1086714d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:28.538040 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6387c4a-48b7-4127-b420-1c1086714d0c None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:28.538318 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6387c4a-48b7-4127-b420-1c1086714d0c None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:28.538595 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6387c4a-48b7-4127-b420-1c1086714d0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:28.548810 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56123b7f-3533-4ed4-a4a8-90c04bef64cc None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:28.582592 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356bbbc5-f6a9-46c8-88df-f3c52b00561a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:28.583278 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356bbbc5-f6a9-46c8-88df-f3c52b00561a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:28.583563 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356bbbc5-f6a9-46c8-88df-f3c52b00561a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:28.583878 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356bbbc5-f6a9-46c8-88df-f3c52b00561a None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:28.584618 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356bbbc5-f6a9-46c8-88df-f3c52b00561a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:28.584915 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356bbbc5-f6a9-46c8-88df-f3c52b00561a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:28.586266 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356bbbc5-f6a9-46c8-88df-f3c52b00561a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:28.598289 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 420/856] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:17:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:28.599374 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac8b79-d558-49a9-9b73-e2dc48228f82 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:28.599656 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac8b79-d558-49a9-9b73-e2dc48228f82 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:28.599924 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac8b79-d558-49a9-9b73-e2dc48228f82 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:28.601261 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 421/857] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:17:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:17:28.603976 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac8b79-d558-49a9-9b73-e2dc48228f82 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:28.624910 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6387c4a-48b7-4127-b420-1c1086714d0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:28.626348 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6387c4a-48b7-4127-b420-1c1086714d0c None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:28.655227 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:28.669026 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:28.710364 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac8b79-d558-49a9-9b73-e2dc48228f82 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:28.741263 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 437/858] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Jul 2 03:17:28 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 02 03:17:28.741263 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1948b-b0c4-4d38-847f-f8f55a59dbd3 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:28.741263 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1948b-b0c4-4d38-847f-f8f55a59dbd3 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:28.741263 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1948b-b0c4-4d38-847f-f8f55a59dbd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:28.753208 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad37eb-f741-4757-b8f1-14dcc16a1aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:28.754020 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad37eb-f741-4757-b8f1-14dcc16a1aaa None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:28.754284 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad37eb-f741-4757-b8f1-14dcc16a1aaa None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:28.754552 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad37eb-f741-4757-b8f1-14dcc16a1aaa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:28.754740 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-09e1948b-b0c4-4d38-847f-f8f55a59dbd3 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:17:28.755969 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-09e1948b-b0c4-4d38-847f-f8f55a59dbd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:17:28.761513 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ad37eb-f741-4757-b8f1-14dcc16a1aaa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:28.762959 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ad37eb-f741-4757-b8f1-14dcc16a1aaa None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:28.777794 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-86ad37eb-f741-4757-b8f1-14dcc16a1aaa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 03:17:28.777794 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:28.777794 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:28.777794 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:28.777794 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:28.777794 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:28.777794 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:28.777794 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:28.777794 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:28.777794 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:28.777794 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:28.777794 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:28.777794 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 03:17:28.777794 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 03:17:28.777794 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 03:17:28.778875 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 03:17:28.778875 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:28.778875 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:28.778875 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:28.778875 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:28.778875 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:28.778875 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:28.778875 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:28.778875 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:28.778875 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:28.778875 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:28.778875 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:28.778875 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:28.778875 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:28.778875 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:28.778875 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:28.778875 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:28.779791 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 03:17:28.779791 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 03:17:28.779791 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 03:17:28.779791 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 03:17:28.779791 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 03:17:28.779791 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 03:17:28.779791 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 03:17:28.779791 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:28.779791 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 422/859] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Jul 2 03:17:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:28.779791 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad37eb-f741-4757-b8f1-14dcc16a1aaa None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:28.831692 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 438/860] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:17:28 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 03:17:28.832364 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e1948b-b0c4-4d38-847f-f8f55a59dbd3 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:28.893582 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:28.902395 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad37eb-f741-4757-b8f1-14dcc16a1aaa None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:28.927924 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:28.939392 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e1948b-b0c4-4d38-847f-f8f55a59dbd3 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:28.940340 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9c7e29-1139-4647-8860-18667a16ded8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:28.941140 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c7e29-1139-4647-8860-18667a16ded8 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:28.941423 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c7e29-1139-4647-8860-18667a16ded8 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:28.941701 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c7e29-1139-4647-8860-18667a16ded8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:28.952444 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9c7e29-1139-4647-8860-18667a16ded8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:28.953910 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9c7e29-1139-4647-8860-18667a16ded8 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:28.971454 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-fe9c7e29-1139-4647-8860-18667a16ded8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:28.971454 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:28.971454 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:28.971454 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:28.971454 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:28.971454 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:28.971454 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:28.971454 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:28.971454 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:28.971454 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:28.971454 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:28.971454 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:28.971454 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:17:28.971454 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:17:28.971454 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:17:28.972343 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:17:28.972343 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:28.972343 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:28.972343 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:28.972343 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:28.972343 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:28.972343 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:28.972343 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:28.972343 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:28.972343 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:28.972343 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:28.972343 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:28.972343 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:28.972343 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:28.972343 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:28.972343 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:28.972343 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:28.973212 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:17:28.973212 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:17:28.973212 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:28.973212 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:28.973212 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 423/861] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:17:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:28.973596 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9c7e29-1139-4647-8860-18667a16ded8 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:28.977121 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7ed635-2631-4809-826a-098fd35b8538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:28.977836 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ed635-2631-4809-826a-098fd35b8538 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:28.978113 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ed635-2631-4809-826a-098fd35b8538 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:28.978449 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ed635-2631-4809-826a-098fd35b8538 None admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:28.979276 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7ed635-2631-4809-826a-098fd35b8538 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:28.979576 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7ed635-2631-4809-826a-098fd35b8538 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:28.981012 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7ed635-2631-4809-826a-098fd35b8538 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:28.998313 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 439/862] 10.222.0.60 () {56 vars in 1148 bytes} [Sat Jul 2 03:17:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:28.999336 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7ed635-2631-4809-826a-098fd35b8538 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:29.080951 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9c7e29-1139-4647-8860-18667a16ded8 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:29.105458 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7ed635-2631-4809-826a-098fd35b8538 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:29.116302 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4153fd4a-fa12-4999-a812-b1f59cf0134d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:29.117110 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153fd4a-fa12-4999-a812-b1f59cf0134d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:29.117389 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153fd4a-fa12-4999-a812-b1f59cf0134d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:29.117659 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153fd4a-fa12-4999-a812-b1f59cf0134d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:29.118308 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4153fd4a-fa12-4999-a812-b1f59cf0134d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:29.119799 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4153fd4a-fa12-4999-a812-b1f59cf0134d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:29.122663 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:29.132222 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-4153fd4a-fa12-4999-a812-b1f59cf0134d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 02 03:17:29.132222 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:29.132222 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 02 03:17:29.132222 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 02 03:17:29.132222 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 02 03:17:29.132222 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 02 03:17:29.132222 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 02 03:17:29.132222 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 03:17:29.132222 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 02 03:17:29.132222 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:29.132222 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 03:17:29.132222 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:29.132222 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:29.132222 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:29.132222 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:29.132222 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:29.133367 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:29.133367 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:29.133367 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:29.133367 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:29.133367 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:29.133367 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:29.133367 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:29.133367 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 02 03:17:29.133367 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 02 03:17:29.133367 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 02 03:17:29.133367 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 02 03:17:29.133367 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:29.133367 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:29.133367 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:29.133367 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:29.133367 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:29.139541 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:29.139541 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:29.139541 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:29.139541 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:29.139541 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:29.139541 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:29.139541 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:29.139541 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:29.139541 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:29.139541 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:29.139541 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:29.139541 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 02 03:17:29.139541 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 03:17:29.139541 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 02 03:17:29.139541 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:29.139541 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 424/863] 10.222.0.60 () {56 vars in 1132 bytes} [Sat Jul 2 03:17:28 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:29.140598 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4153fd4a-fa12-4999-a812-b1f59cf0134d None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:29.149247 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c390223b-3f86-45b6-8a86-9699880537a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:29.150176 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c390223b-3f86-45b6-8a86-9699880537a3 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:29.150459 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c390223b-3f86-45b6-8a86-9699880537a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:29.150748 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c390223b-3f86-45b6-8a86-9699880537a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:29.151629 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c390223b-3f86-45b6-8a86-9699880537a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:29.151936 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c390223b-3f86-45b6-8a86-9699880537a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:29.153307 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c390223b-3f86-45b6-8a86-9699880537a3 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:29.171049 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 440/864] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:17:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:29.171049 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c390223b-3f86-45b6-8a86-9699880537a3 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:29.183616 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:29.246445 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4153fd4a-fa12-4999-a812-b1f59cf0134d None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:29.278230 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c390223b-3f86-45b6-8a86-9699880537a3 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:29.284418 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f60cd6f-45eb-4c2e-89e8-196b61f512a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:29.285086 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60cd6f-45eb-4c2e-89e8-196b61f512a1 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:29.285360 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60cd6f-45eb-4c2e-89e8-196b61f512a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:29.285632 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60cd6f-45eb-4c2e-89e8-196b61f512a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:29.286455 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f60cd6f-45eb-4c2e-89e8-196b61f512a1 None admin] RBAC: Adding query filter params (role.id=5dcd130cda6c490595e862dc2348e83d, scope.project.id=e09dc5d9d4904c2b89b0cabed237d55e, user.id=692ec343bf9f4339ba691440f55a6c37) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:29.286763 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f60cd6f-45eb-4c2e-89e8-196b61f512a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:29.288243 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f60cd6f-45eb-4c2e-89e8-196b61f512a1 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:29.295559 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 425/865] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Jul 2 03:17:29 2022] GET /identity/v3/role_assignments?user.id=692ec343bf9f4339ba691440f55a6c37&scope.project.id=e09dc5d9d4904c2b89b0cabed237d55e&role.id=5dcd130cda6c490595e862dc2348e83d => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:29.296364 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f60cd6f-45eb-4c2e-89e8-196b61f512a1 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:29.335748 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d915941a-44ac-42ee-b529-927bc709d5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:29.337161 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d915941a-44ac-42ee-b529-927bc709d5f6 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:29.338843 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d915941a-44ac-42ee-b529-927bc709d5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:29.339377 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d915941a-44ac-42ee-b529-927bc709d5f6 None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:29.340327 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d915941a-44ac-42ee-b529-927bc709d5f6 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:29.340868 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d915941a-44ac-42ee-b529-927bc709d5f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:29.342491 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d915941a-44ac-42ee-b529-927bc709d5f6 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:29.356065 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 441/866] 10.222.0.60 () {56 vars in 1126 bytes} [Sat Jul 2 03:17:29 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:29.358047 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d915941a-44ac-42ee-b529-927bc709d5f6 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:29.422775 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:29.429386 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f60cd6f-45eb-4c2e-89e8-196b61f512a1 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:29.431112 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:29.469116 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0454d64-1a1a-4325-8c57-3d080c8888e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:29.469969 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0454d64-1a1a-4325-8c57-3d080c8888e3 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:29.470283 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0454d64-1a1a-4325-8c57-3d080c8888e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:29.470693 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0454d64-1a1a-4325-8c57-3d080c8888e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:29.478541 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0454d64-1a1a-4325-8c57-3d080c8888e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:29.480377 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0454d64-1a1a-4325-8c57-3d080c8888e3 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:29.493484 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d915941a-44ac-42ee-b529-927bc709d5f6 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:29.495468 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-e0454d64-1a1a-4325-8c57-3d080c8888e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 03:17:29.495468 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:29.495468 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:29.495468 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:29.495468 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:29.495468 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:29.495468 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:29.495468 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:29.495468 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:29.495468 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:29.495468 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:29.495468 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:29.495468 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 03:17:29.495468 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 03:17:29.495468 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 03:17:29.496543 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 03:17:29.496543 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:29.496543 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:29.496543 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:29.496543 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:29.496543 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:29.496543 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:29.496543 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:29.496543 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:29.496543 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:29.496543 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:29.496543 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:29.496543 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:29.496543 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:29.496543 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:29.496543 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:29.496543 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:29.497648 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 03:17:29.497648 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 03:17:29.497648 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 03:17:29.497648 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 03:17:29.497648 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 03:17:29.497648 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 03:17:29.497648 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 03:17:29.497648 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:29.497648 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 426/867] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Jul 2 03:17:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:29.504471 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0454d64-1a1a-4325-8c57-3d080c8888e3 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:29.537988 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee3daa9-7253-44a6-8d10-acf68d726a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:29.538748 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3daa9-7253-44a6-8d10-acf68d726a1e None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:29.539463 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3daa9-7253-44a6-8d10-acf68d726a1e None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:29.539874 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3daa9-7253-44a6-8d10-acf68d726a1e None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:29.540527 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee3daa9-7253-44a6-8d10-acf68d726a1e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:29.540944 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee3daa9-7253-44a6-8d10-acf68d726a1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:29.542313 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee3daa9-7253-44a6-8d10-acf68d726a1e None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:29.547866 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 442/868] 10.222.0.60 () {56 vars in 1126 bytes} [Sat Jul 2 03:17:29 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:29.617868 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0454d64-1a1a-4325-8c57-3d080c8888e3 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:29.657633 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f596971-1700-43d3-9d1c-e80d0057a269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:29.658638 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f596971-1700-43d3-9d1c-e80d0057a269 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:29.659069 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f596971-1700-43d3-9d1c-e80d0057a269 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:29.659513 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f596971-1700-43d3-9d1c-e80d0057a269 None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:29.660464 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f596971-1700-43d3-9d1c-e80d0057a269 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:29.660968 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f596971-1700-43d3-9d1c-e80d0057a269 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:29.662610 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f596971-1700-43d3-9d1c-e80d0057a269 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:29.679107 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 427/869] 10.222.0.60 () {56 vars in 1148 bytes} [Sat Jul 2 03:17:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:17:29.685486 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee3daa9-7253-44a6-8d10-acf68d726a1e None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:29.799523 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee3daa9-7253-44a6-8d10-acf68d726a1e None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:29.808103 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:29.837802 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d1b3f1-ca46-42d7-bf57-9a6b22dbc56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:29.838717 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d1b3f1-ca46-42d7-bf57-9a6b22dbc56d None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:29.839159 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d1b3f1-ca46-42d7-bf57-9a6b22dbc56d None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:29.839604 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d1b3f1-ca46-42d7-bf57-9a6b22dbc56d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:29.840602 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d1b3f1-ca46-42d7-bf57-9a6b22dbc56d None admin] RBAC: Adding query filter params (role.id=3c71d0e875cd4a00849f14227be8f7ed, scope.project.id=e09dc5d9d4904c2b89b0cabed237d55e, user.id=3333e7495b9546d882e2a2211ff8875c) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:29.841071 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d1b3f1-ca46-42d7-bf57-9a6b22dbc56d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:29.842756 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d1b3f1-ca46-42d7-bf57-9a6b22dbc56d None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:29.849924 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 443/870] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Jul 2 03:17:29 2022] GET /identity/v3/role_assignments?user.id=3333e7495b9546d882e2a2211ff8875c&scope.project.id=e09dc5d9d4904c2b89b0cabed237d55e&role.id=3c71d0e875cd4a00849f14227be8f7ed => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:30.266827 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae3b8f-ece1-4edf-a3a0-c612f1f6d86f None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:30.267284 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae3b8f-ece1-4edf-a3a0-c612f1f6d86f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:30.267464 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae3b8f-ece1-4edf-a3a0-c612f1f6d86f None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:30.269066 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 428/871] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:17:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:17:30.274594 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4539bd-dad2-497f-8b83-5ef27cf4f1e5 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:30.274887 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4539bd-dad2-497f-8b83-5ef27cf4f1e5 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:30.275235 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4539bd-dad2-497f-8b83-5ef27cf4f1e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:30.292955 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-5a4539bd-dad2-497f-8b83-5ef27cf4f1e5 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:17:30.294088 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-5a4539bd-dad2-497f-8b83-5ef27cf4f1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:17:30.367367 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 444/872] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:17:30 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 03:17:30.387023 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae3b8f-ece1-4edf-a3a0-c612f1f6d86f None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:30.413182 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:30.496040 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae3b8f-ece1-4edf-a3a0-c612f1f6d86f None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:30.533585 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe5afeb-694a-4ab2-9d95-57a744737400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:30.534641 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5afeb-694a-4ab2-9d95-57a744737400 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:30.535143 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5afeb-694a-4ab2-9d95-57a744737400 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:30.535640 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5afeb-694a-4ab2-9d95-57a744737400 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:30.536561 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe5afeb-694a-4ab2-9d95-57a744737400 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:30.538141 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe5afeb-694a-4ab2-9d95-57a744737400 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:30.554203 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 429/873] 10.222.0.60 () {60 vars in 1141 bytes} [Sat Jul 2 03:17:30 2022] POST /identity/v3/services => generated 251 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:17:31.423114 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fbf757-fd1a-4c7a-b8bf-410115754dbc None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:31.423657 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fbf757-fd1a-4c7a-b8bf-410115754dbc None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:31.423734 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fbf757-fd1a-4c7a-b8bf-410115754dbc None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:31.425332 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 445/874] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:17:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:17:31.430524 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a31c3-6881-4fb7-979c-69b755edd95e None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:31.430918 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a31c3-6881-4fb7-979c-69b755edd95e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:31.431098 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a31c3-6881-4fb7-979c-69b755edd95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:31.448816 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-e40a31c3-6881-4fb7-979c-69b755edd95e None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:17:31.450008 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e40a31c3-6881-4fb7-979c-69b755edd95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:17:31.529236 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 430/875] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:17:31 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 03:17:31.551576 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fbf757-fd1a-4c7a-b8bf-410115754dbc None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:31.652527 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:31.656934 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fbf757-fd1a-4c7a-b8bf-410115754dbc None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:31.695919 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28799286-2e5e-4c7b-a245-57bf4a7d77aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:31.696769 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28799286-2e5e-4c7b-a245-57bf4a7d77aa None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:31.697055 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28799286-2e5e-4c7b-a245-57bf4a7d77aa None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:31.697328 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28799286-2e5e-4c7b-a245-57bf4a7d77aa None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:31.697991 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28799286-2e5e-4c7b-a245-57bf4a7d77aa None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:31.699412 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28799286-2e5e-4c7b-a245-57bf4a7d77aa None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:31.711556 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-28799286-2e5e-4c7b-a245-57bf4a7d77aa None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 02 03:17:31.711556 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:31.711556 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 02 03:17:31.711556 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 02 03:17:31.711556 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 02 03:17:31.711556 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 02 03:17:31.711556 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 02 03:17:31.711556 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 03:17:31.711556 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 02 03:17:31.711556 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:31.711556 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 03:17:31.711556 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:31.711556 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:31.711556 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:31.711556 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:31.711556 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:31.711556 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:31.712631 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:31.712631 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:31.712631 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:31.712631 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:31.712631 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:31.712631 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:31.712631 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 02 03:17:31.712631 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 02 03:17:31.712631 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 02 03:17:31.712631 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 02 03:17:31.712631 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:31.712631 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:31.712631 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:31.712631 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:31.712631 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:31.712631 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:31.713466 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:31.713466 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:31.713466 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:31.713466 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:31.713466 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:31.713466 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:31.713466 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:31.713466 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:31.713466 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:31.713466 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:31.713466 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 02 03:17:31.713466 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 03:17:31.713466 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 02 03:17:31.713466 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:31.713466 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 446/876] 10.222.0.60 () {56 vars in 1126 bytes} [Sat Jul 2 03:17:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:31.719165 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40a31c3-6881-4fb7-979c-69b755edd95e None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:31.722839 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33b0a3-c575-4310-a301-853decf3a0af None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:31.723144 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33b0a3-c575-4310-a301-853decf3a0af None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:31.723439 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33b0a3-c575-4310-a301-853decf3a0af None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:31.724894 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 447/877] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:17:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 03:17:31.729512 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df3ed0-f499-4864-b088-95c9ebcefc4e None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:31.729801 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df3ed0-f499-4864-b088-95c9ebcefc4e None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:31.730076 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df3ed0-f499-4864-b088-95c9ebcefc4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:31.736475 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:31.747059 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-a8df3ed0-f499-4864-b088-95c9ebcefc4e None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:17:31.748292 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-a8df3ed0-f499-4864-b088-95c9ebcefc4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:17:31.819926 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 448/878] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:17:31 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 03:17:31.845287 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df3ed0-f499-4864-b088-95c9ebcefc4e None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:31.849832 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40a31c3-6881-4fb7-979c-69b755edd95e None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:31.889239 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce85aca-7342-4914-b0fb-9cc9fbb2db83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:31.889916 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce85aca-7342-4914-b0fb-9cc9fbb2db83 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:31.890196 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce85aca-7342-4914-b0fb-9cc9fbb2db83 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:31.890465 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce85aca-7342-4914-b0fb-9cc9fbb2db83 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:31.891208 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce85aca-7342-4914-b0fb-9cc9fbb2db83 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:31.891517 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce85aca-7342-4914-b0fb-9cc9fbb2db83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:31.893327 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce85aca-7342-4914-b0fb-9cc9fbb2db83 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:31.904231 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 431/879] 10.222.0.60 () {56 vars in 1122 bytes} [Sat Jul 2 03:17:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:31.908054 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce85aca-7342-4914-b0fb-9cc9fbb2db83 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:31.949545 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:31.956842 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df3ed0-f499-4864-b088-95c9ebcefc4e None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:31.994289 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:31.995223 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cbf76c-468e-4b8a-ac1b-054608bfe4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:31.995818 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cbf76c-468e-4b8a-ac1b-054608bfe4cb None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:31.996212 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cbf76c-468e-4b8a-ac1b-054608bfe4cb None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:31.996491 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cbf76c-468e-4b8a-ac1b-054608bfe4cb None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:31.997228 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cbf76c-468e-4b8a-ac1b-054608bfe4cb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:31.998666 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cbf76c-468e-4b8a-ac1b-054608bfe4cb None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:32.023604 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 449/880] 10.222.0.60 () {60 vars in 1141 bytes} [Sat Jul 2 03:17:31 2022] POST /identity/v3/services => generated 269 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:17:32.036848 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce85aca-7342-4914-b0fb-9cc9fbb2db83 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:32.054446 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73b8d0-210e-45e0-98bf-66177d95bdca None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:32.054790 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73b8d0-210e-45e0-98bf-66177d95bdca None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:32.055015 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73b8d0-210e-45e0-98bf-66177d95bdca None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:32.056658 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 450/881] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:17:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 03:17:32.062222 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a902d05-ae28-4419-9251-3cf833ec3af9 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:32.062542 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a902d05-ae28-4419-9251-3cf833ec3af9 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:32.062817 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a902d05-ae28-4419-9251-3cf833ec3af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:32.081587 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-3a902d05-ae28-4419-9251-3cf833ec3af9 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:17:32.082998 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-3a902d05-ae28-4419-9251-3cf833ec3af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:17:32.085894 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a6d89e-f128-4d4a-8d87-238fd3222217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:32.086707 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a6d89e-f128-4d4a-8d87-238fd3222217 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:32.088132 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a6d89e-f128-4d4a-8d87-238fd3222217 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:32.088453 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a6d89e-f128-4d4a-8d87-238fd3222217 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:32.089272 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a6d89e-f128-4d4a-8d87-238fd3222217 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:32.089589 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a6d89e-f128-4d4a-8d87-238fd3222217 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:32.091200 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a6d89e-f128-4d4a-8d87-238fd3222217 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:32.098726 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 432/882] 10.222.0.60 () {56 vars in 1122 bytes} [Sat Jul 2 03:17:31 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:32.170550 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 451/883] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:17:32 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 02 03:17:32.194840 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a6d89e-f128-4d4a-8d87-238fd3222217 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:32.307002 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a6d89e-f128-4d4a-8d87-238fd3222217 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:32.338134 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:32.343808 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f864b2-4d8e-4bed-9fe6-baac2be2024c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:32.344640 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f864b2-4d8e-4bed-9fe6-baac2be2024c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:32.344911 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f864b2-4d8e-4bed-9fe6-baac2be2024c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:32.345183 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f864b2-4d8e-4bed-9fe6-baac2be2024c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:32.357662 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f864b2-4d8e-4bed-9fe6-baac2be2024c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:17:32.367093 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-a6f864b2-4d8e-4bed-9fe6-baac2be2024c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 02 03:17:32.367093 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:32.367093 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:32.367093 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:32.367093 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:32.367093 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:32.367093 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:32.367093 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:32.367093 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:32.367093 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:32.367093 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:32.367093 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:32.367093 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:17:32.367093 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:17:32.367093 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:17:32.367093 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:17:32.368040 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:17:32.368040 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:17:32.368040 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:17:32.368040 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:17:32.368040 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:32.368040 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:32.368040 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:32.368040 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:32.368040 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:32.368040 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:32.368040 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:32.368040 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:32.368040 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:32.368040 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:32.368040 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:32.368040 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:32.368971 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:32.368971 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:32.368971 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:32.368971 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:32.368971 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:17:32.368971 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:17:32.368971 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:17:32.368971 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:17:32.368971 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:17:32.368971 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:17:32.368971 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 02 03:17:32.368971 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:32.369595 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 433/884] 10.222.0.60 () {56 vars in 1120 bytes} [Sat Jul 2 03:17:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:32.376578 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a902d05-ae28-4419-9251-3cf833ec3af9 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:32.474330 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:32.490914 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a902d05-ae28-4419-9251-3cf833ec3af9 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:32.526507 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e33cb-18c7-4f5c-8a44-67144b0c108e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:32.527457 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e33cb-18c7-4f5c-8a44-67144b0c108e None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:32.527928 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e33cb-18c7-4f5c-8a44-67144b0c108e None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:32.528263 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e33cb-18c7-4f5c-8a44-67144b0c108e None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:32.529401 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8e33cb-18c7-4f5c-8a44-67144b0c108e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:32.529710 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8e33cb-18c7-4f5c-8a44-67144b0c108e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:32.531098 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8e33cb-18c7-4f5c-8a44-67144b0c108e None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:32.540327 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 452/885] 10.222.0.60 () {56 vars in 1115 bytes} [Sat Jul 2 03:17:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:32.545620 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f864b2-4d8e-4bed-9fe6-baac2be2024c None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:32.613517 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89471d9-411f-493e-9ed5-6fae8cac36bc None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:32.613861 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89471d9-411f-493e-9ed5-6fae8cac36bc None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:32.614070 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89471d9-411f-493e-9ed5-6fae8cac36bc None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:32.616727 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 453/886] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:17:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 03:17:32.627152 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b356c-6b03-4ce6-a4d4-c27b023f8585 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:32.627152 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b356c-6b03-4ce6-a4d4-c27b023f8585 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:32.627152 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b356c-6b03-4ce6-a4d4-c27b023f8585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:32.643159 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-5d3b356c-6b03-4ce6-a4d4-c27b023f8585 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:17:32.644458 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-5d3b356c-6b03-4ce6-a4d4-c27b023f8585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:17:32.652326 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f864b2-4d8e-4bed-9fe6-baac2be2024c None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:32.694602 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce20c6-fbd6-45c1-ab4c-c895c3cfad47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:32.695935 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce20c6-fbd6-45c1-ab4c-c895c3cfad47 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:32.696292 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce20c6-fbd6-45c1-ab4c-c895c3cfad47 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:32.696634 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce20c6-fbd6-45c1-ab4c-c895c3cfad47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:32.711331 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fce20c6-fbd6-45c1-ab4c-c895c3cfad47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:32.713596 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fce20c6-fbd6-45c1-ab4c-c895c3cfad47 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:32.720541 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 454/887] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:17:32 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 02 03:17:32.738559 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-2fce20c6-fbd6-45c1-ab4c-c895c3cfad47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:32.738559 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:32.738559 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:32.738559 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:32.738559 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:32.738559 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:32.738559 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:32.738559 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:32.738559 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:32.738559 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:32.738559 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:32.738559 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:32.738559 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:17:32.738559 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:17:32.738559 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:17:32.739546 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:17:32.739546 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:32.739546 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:32.739546 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:32.739546 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:32.739546 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:32.739546 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:32.739546 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:32.739546 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:32.739546 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:32.739546 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:32.739546 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:32.739546 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:32.739546 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:32.739546 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:32.739546 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:32.739546 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:32.740504 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:17:32.740504 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:17:32.740504 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:32.740504 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:32.742764 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 434/888] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:17:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:32.751082 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce20c6-fbd6-45c1-ab4c-c895c3cfad47 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:32.751242 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3b356c-6b03-4ce6-a4d4-c27b023f8585 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:32.810255 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:32.840216 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:32.871920 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3b356c-6b03-4ce6-a4d4-c27b023f8585 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:32.878470 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce20c6-fbd6-45c1-ab4c-c895c3cfad47 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:32.916748 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c67b46b-2ce0-4d87-92fb-582a4dc59fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:32.917421 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67b46b-2ce0-4d87-92fb-582a4dc59fec None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:32.917709 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67b46b-2ce0-4d87-92fb-582a4dc59fec None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:32.917987 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67b46b-2ce0-4d87-92fb-582a4dc59fec None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:32.918720 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c67b46b-2ce0-4d87-92fb-582a4dc59fec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:32.919027 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c67b46b-2ce0-4d87-92fb-582a4dc59fec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:32.920087 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a1c080-fb7d-4561-aaa6-ebdbb548a1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:32.920459 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c67b46b-2ce0-4d87-92fb-582a4dc59fec None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:32.921321 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1c080-fb7d-4561-aaa6-ebdbb548a1b9 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:32.922064 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1c080-fb7d-4561-aaa6-ebdbb548a1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:32.922518 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1c080-fb7d-4561-aaa6-ebdbb548a1b9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:32.923932 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a1c080-fb7d-4561-aaa6-ebdbb548a1b9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:32.925524 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a1c080-fb7d-4561-aaa6-ebdbb548a1b9 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:32.938175 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 435/889] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:17:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:17:32.939062 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c67b46b-2ce0-4d87-92fb-582a4dc59fec None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:32.940321 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-56a1c080-fb7d-4561-aaa6-ebdbb548a1b9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 02 03:17:32.940321 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:32.940321 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 02 03:17:32.940321 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 02 03:17:32.940321 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 02 03:17:32.940321 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 02 03:17:32.940321 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 02 03:17:32.940321 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 03:17:32.940321 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 02 03:17:32.940321 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:32.940321 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 03:17:32.940321 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:32.940321 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:32.940321 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:32.940321 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:32.940321 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:32.940321 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:32.941283 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:32.941283 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:32.941283 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:32.941283 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:32.941283 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:32.941283 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:32.941283 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 02 03:17:32.941283 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 02 03:17:32.941283 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 02 03:17:32.941283 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 02 03:17:32.941283 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:32.941283 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:32.941283 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:32.941283 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:32.941283 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:32.941283 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:32.942132 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:32.942132 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:32.942132 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:32.942132 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:32.942132 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:32.942132 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:32.942132 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:32.942132 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:32.942132 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:32.942132 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:32.942132 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 02 03:17:32.942132 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 03:17:32.942132 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 02 03:17:32.942132 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:32.950882 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 455/890] 10.222.0.60 () {56 vars in 1114 bytes} [Sat Jul 2 03:17:32 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:32.952266 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a1c080-fb7d-4561-aaa6-ebdbb548a1b9 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:33.061481 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c67b46b-2ce0-4d87-92fb-582a4dc59fec None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:33.065216 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:33.084611 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a1c080-fb7d-4561-aaa6-ebdbb548a1b9 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:33.106081 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9875a43-abf5-4ff4-b196-8ea8148b71da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:33.107336 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9875a43-abf5-4ff4-b196-8ea8148b71da None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:33.107729 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9875a43-abf5-4ff4-b196-8ea8148b71da None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:33.108107 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9875a43-abf5-4ff4-b196-8ea8148b71da None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:33.117021 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9875a43-abf5-4ff4-b196-8ea8148b71da None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:33.119535 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9875a43-abf5-4ff4-b196-8ea8148b71da None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:33.127418 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9777883-17db-4ef7-a864-52a23e80e214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:33.128301 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9777883-17db-4ef7-a864-52a23e80e214 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:33.128729 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9777883-17db-4ef7-a864-52a23e80e214 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:33.129145 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9777883-17db-4ef7-a864-52a23e80e214 None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:33.130017 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9777883-17db-4ef7-a864-52a23e80e214 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:33.130520 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9777883-17db-4ef7-a864-52a23e80e214 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:33.132103 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9777883-17db-4ef7-a864-52a23e80e214 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:33.137072 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-c9875a43-abf5-4ff4-b196-8ea8148b71da None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 02 03:17:33.137072 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:33.137072 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:33.137072 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:33.137072 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:33.137072 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:33.137072 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:33.137072 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:33.137072 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:33.137072 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:33.137072 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:33.137072 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:33.137072 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 03:17:33.137072 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 03:17:33.137072 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 03:17:33.137072 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 03:17:33.138192 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:33.138192 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:33.138192 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 03:17:33.138192 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 03:17:33.138192 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 03:17:33.138192 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 03:17:33.138192 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:33.138192 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:33.138192 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:33.138192 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:33.138192 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:33.138192 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:33.138192 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:33.138192 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:33.138192 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:33.138192 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:33.138192 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:33.138192 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:33.139260 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:33.139260 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:33.139260 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 03:17:33.139260 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 03:17:33.139260 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 03:17:33.139260 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 03:17:33.139260 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 03:17:33.139260 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 03:17:33.139260 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 02 03:17:33.139260 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:33.144406 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 436/892] 10.222.0.60 () {56 vars in 1117 bytes} [Sat Jul 2 03:17:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:33.144616 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 456/892] 10.222.0.60 () {56 vars in 1114 bytes} [Sat Jul 2 03:17:32 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:33.145560 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9875a43-abf5-4ff4-b196-8ea8148b71da None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:33.147052 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9777883-17db-4ef7-a864-52a23e80e214 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:33.152485 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:33.277772 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9875a43-abf5-4ff4-b196-8ea8148b71da None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:33.280437 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9777883-17db-4ef7-a864-52a23e80e214 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:33.322548 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d52d5c-d703-4289-ac2c-182b65825e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:33.322929 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d52d5c-d703-4289-ac2c-182b65825e64 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:33.323253 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d52d5c-d703-4289-ac2c-182b65825e64 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:33.323528 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d52d5c-d703-4289-ac2c-182b65825e64 None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:33.324266 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d52d5c-d703-4289-ac2c-182b65825e64 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:33.324532 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d52d5c-d703-4289-ac2c-182b65825e64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:33.325897 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d52d5c-d703-4289-ac2c-182b65825e64 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:33.329647 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc306e-257d-4124-9319-f5997c9c5623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:33.330578 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc306e-257d-4124-9319-f5997c9c5623 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:33.331316 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc306e-257d-4124-9319-f5997c9c5623 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:33.331437 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 457/893] 10.222.0.60 () {56 vars in 1114 bytes} [Sat Jul 2 03:17:33 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:17:33.331853 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc306e-257d-4124-9319-f5997c9c5623 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:33.332707 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cc306e-257d-4124-9319-f5997c9c5623 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:33.333025 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cc306e-257d-4124-9319-f5997c9c5623 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:33.334446 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cc306e-257d-4124-9319-f5997c9c5623 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:33.340782 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d52d5c-d703-4289-ac2c-182b65825e64 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:33.360317 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 437/894] 10.222.0.60 () {56 vars in 1149 bytes} [Sat Jul 2 03:17:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:33.371928 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc306e-257d-4124-9319-f5997c9c5623 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:33.419482 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:33.420971 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:33.457004 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d52d5c-d703-4289-ac2c-182b65825e64 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:33.481108 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc306e-257d-4124-9319-f5997c9c5623 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:33.491735 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea6042b-df90-4578-bb9a-440f80b303e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:33.493063 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea6042b-df90-4578-bb9a-440f80b303e4 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:33.493625 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea6042b-df90-4578-bb9a-440f80b303e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:33.494103 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea6042b-df90-4578-bb9a-440f80b303e4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:33.495169 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea6042b-df90-4578-bb9a-440f80b303e4 None admin] RBAC: Adding query filter params (interface=public, service_id=ae215b232491453385335741aa41a698, region_id=RegionOne) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:33.495687 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea6042b-df90-4578-bb9a-440f80b303e4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:33.497289 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea6042b-df90-4578-bb9a-440f80b303e4 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:33.503023 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 458/895] 10.222.0.60 () {56 vars in 1251 bytes} [Sat Jul 2 03:17:33 2022] GET /identity/v3/endpoints?service_id=ae215b232491453385335741aa41a698&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:17:33.509818 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea6042b-df90-4578-bb9a-440f80b303e4 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:33.518839 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956b7564-d927-4513-8f3d-fc974dff87a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:33.519519 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b7564-d927-4513-8f3d-fc974dff87a1 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:33.519799 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b7564-d927-4513-8f3d-fc974dff87a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:33.520071 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b7564-d927-4513-8f3d-fc974dff87a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:33.590220 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956b7564-d927-4513-8f3d-fc974dff87a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:33.592546 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956b7564-d927-4513-8f3d-fc974dff87a1 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:33.621171 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:33.629383 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea6042b-df90-4578-bb9a-440f80b303e4 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:33.659904 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:33.667973 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2b7571-2546-4644-9d7d-c58e0c4321b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:33.668907 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b7571-2546-4644-9d7d-c58e0c4321b9 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:33.669196 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b7571-2546-4644-9d7d-c58e0c4321b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:33.669473 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b7571-2546-4644-9d7d-c58e0c4321b9 None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:33.670163 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2b7571-2546-4644-9d7d-c58e0c4321b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:33.671659 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2b7571-2546-4644-9d7d-c58e0c4321b9 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:33.679892 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 459/896] 10.222.0.60 () {56 vars in 1087 bytes} [Sat Jul 2 03:17:33 2022] GET /identity/v3/services => generated 1268 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:17:33.713729 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 438/897] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Jul 2 03:17:33 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 02 03:17:33.722058 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2b7571-2546-4644-9d7d-c58e0c4321b9 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:33.839510 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2b7571-2546-4644-9d7d-c58e0c4321b9 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:33.875632 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ac071-eb2c-41ad-b326-ba711919148b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:33.876357 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ac071-eb2c-41ad-b326-ba711919148b None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:33.876638 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ac071-eb2c-41ad-b326-ba711919148b None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:33.876912 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ac071-eb2c-41ad-b326-ba711919148b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:33.888658 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41ac071-eb2c-41ad-b326-ba711919148b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:33.890121 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41ac071-eb2c-41ad-b326-ba711919148b None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:33.907894 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-f41ac071-eb2c-41ad-b326-ba711919148b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:33.907894 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:33.907894 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:33.907894 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:33.907894 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:33.907894 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:33.907894 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:33.907894 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:33.907894 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:33.907894 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:33.907894 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:33.907894 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:33.907894 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:17:33.907894 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:17:33.907894 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:17:33.908939 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:17:33.908939 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:33.908939 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:33.908939 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:33.908939 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:33.908939 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:33.908939 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:33.908939 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:33.908939 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:33.908939 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:33.908939 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:33.908939 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:33.908939 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:33.908939 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:33.908939 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:33.908939 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:33.908939 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:33.910270 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:17:33.910270 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:17:33.910270 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:33.910270 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:33.910270 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 460/898] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:17:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:33.915579 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956b7564-d927-4513-8f3d-fc974dff87a1 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:34.022159 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956b7564-d927-4513-8f3d-fc974dff87a1 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:34.047042 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:34.059928 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d79fbc-ccd9-4a8e-ad4b-99701a5f5b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:34.060985 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d79fbc-ccd9-4a8e-ad4b-99701a5f5b3f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:34.061487 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d79fbc-ccd9-4a8e-ad4b-99701a5f5b3f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:34.061979 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d79fbc-ccd9-4a8e-ad4b-99701a5f5b3f None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:34.062956 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d79fbc-ccd9-4a8e-ad4b-99701a5f5b3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:34.063490 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d79fbc-ccd9-4a8e-ad4b-99701a5f5b3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:34.065125 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d79fbc-ccd9-4a8e-ad4b-99701a5f5b3f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:34.077895 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 439/899] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:17:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:34.084569 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ac071-eb2c-41ad-b326-ba711919148b None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:34.137404 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:34.182648 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a51113-2a14-4cfc-822c-bf8484821cfd None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:34.183057 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a51113-2a14-4cfc-822c-bf8484821cfd None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:34.183378 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a51113-2a14-4cfc-822c-bf8484821cfd None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:34.185048 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 440/900] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:17:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:17:34.190449 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddfc060-4918-429d-99d2-e2aa880338b9 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:34.190736 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddfc060-4918-429d-99d2-e2aa880338b9 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:34.191106 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddfc060-4918-429d-99d2-e2aa880338b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:34.194741 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ac071-eb2c-41ad-b326-ba711919148b None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:34.211841 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-2ddfc060-4918-429d-99d2-e2aa880338b9 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:17:34.213374 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2ddfc060-4918-429d-99d2-e2aa880338b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:17:34.236052 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7d6ae1-08b1-4fb4-a0f6-84b7fb9de77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:34.236854 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d6ae1-08b1-4fb4-a0f6-84b7fb9de77c None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:34.237130 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d6ae1-08b1-4fb4-a0f6-84b7fb9de77c None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:34.237399 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d6ae1-08b1-4fb4-a0f6-84b7fb9de77c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:34.244869 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7d6ae1-08b1-4fb4-a0f6-84b7fb9de77c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:34.246437 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7d6ae1-08b1-4fb4-a0f6-84b7fb9de77c None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:34.261431 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-0a7d6ae1-08b1-4fb4-a0f6-84b7fb9de77c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 03:17:34.261431 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:34.261431 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:34.261431 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:34.261431 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:34.261431 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:34.261431 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:34.261431 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:34.261431 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:34.261431 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:34.261431 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:34.261431 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:34.261431 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 03:17:34.261431 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 03:17:34.261431 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 03:17:34.262367 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 03:17:34.262367 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:34.262367 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:34.262367 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:34.262367 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:34.262367 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:34.262367 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:34.262367 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:34.262367 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:34.262367 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:34.262367 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:34.262367 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:34.262367 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:34.262367 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:34.262367 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:34.262367 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:34.262367 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:34.263626 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 03:17:34.263626 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 03:17:34.263626 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 03:17:34.263626 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 03:17:34.263626 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 03:17:34.263626 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 03:17:34.263626 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 03:17:34.263626 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:34.263626 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 461/901] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Jul 2 03:17:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:34.268291 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7d6ae1-08b1-4fb4-a0f6-84b7fb9de77c None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:34.296370 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 441/902] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:17:34 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 02 03:17:34.297582 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549a912-91ad-4b49-a953-f8bde2fdfe50 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:34.297873 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549a912-91ad-4b49-a953-f8bde2fdfe50 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:34.298142 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549a912-91ad-4b49-a953-f8bde2fdfe50 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:34.299581 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 442/903] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:17:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:17:34.307297 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d787409-c0ea-46c1-bf85-2302e73c1d4e None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:34.307297 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d787409-c0ea-46c1-bf85-2302e73c1d4e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:34.307297 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d787409-c0ea-46c1-bf85-2302e73c1d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:34.322753 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-3d787409-c0ea-46c1-bf85-2302e73c1d4e None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:17:34.323978 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3d787409-c0ea-46c1-bf85-2302e73c1d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:17:34.385343 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7d6ae1-08b1-4fb4-a0f6-84b7fb9de77c None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:34.396528 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:34.403192 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 443/904] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:17:34 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 02 03:17:34.403192 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d787409-c0ea-46c1-bf85-2302e73c1d4e None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:34.429987 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c6ebfb-4b41-49d4-8842-74fa21e74866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:34.431106 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6ebfb-4b41-49d4-8842-74fa21e74866 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:34.431564 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6ebfb-4b41-49d4-8842-74fa21e74866 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:34.431985 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6ebfb-4b41-49d4-8842-74fa21e74866 None admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:34.432922 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c6ebfb-4b41-49d4-8842-74fa21e74866 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:34.433394 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c6ebfb-4b41-49d4-8842-74fa21e74866 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:34.435014 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c6ebfb-4b41-49d4-8842-74fa21e74866 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:34.453226 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 462/905] 10.222.0.60 () {56 vars in 1148 bytes} [Sat Jul 2 03:17:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:34.453226 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c6ebfb-4b41-49d4-8842-74fa21e74866 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:34.455731 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:34.516032 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d787409-c0ea-46c1-bf85-2302e73c1d4e None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:34.553443 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7ec603-0974-456f-b9ac-000dedd0f12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:34.554256 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ec603-0974-456f-b9ac-000dedd0f12b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:34.554535 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ec603-0974-456f-b9ac-000dedd0f12b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:34.554807 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ec603-0974-456f-b9ac-000dedd0f12b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:34.555488 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7ec603-0974-456f-b9ac-000dedd0f12b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:34.555883 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c6ebfb-4b41-49d4-8842-74fa21e74866 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:34.557004 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7ec603-0974-456f-b9ac-000dedd0f12b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:34.569512 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-9b7ec603-0974-456f-b9ac-000dedd0f12b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 02 03:17:34.569512 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:34.569512 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 02 03:17:34.569512 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 02 03:17:34.569512 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 02 03:17:34.569512 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 02 03:17:34.569512 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 02 03:17:34.569512 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 03:17:34.569512 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 02 03:17:34.569512 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:34.569512 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 03:17:34.569512 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:34.569512 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:34.569512 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:34.569512 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:34.569512 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:34.570450 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:34.570450 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:34.570450 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:34.570450 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:34.570450 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:34.570450 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:34.570450 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:34.570450 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 02 03:17:34.570450 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 02 03:17:34.570450 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 02 03:17:34.570450 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 02 03:17:34.570450 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:34.570450 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:34.570450 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:34.570450 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:34.570450 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:34.571295 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:34.571295 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:34.571295 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:34.571295 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:34.571295 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:34.571295 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:34.571295 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:34.571295 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:34.571295 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:34.571295 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:34.571295 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:34.571295 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 02 03:17:34.571295 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 03:17:34.571295 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 02 03:17:34.571295 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:34.571295 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 444/906] 10.222.0.60 () {56 vars in 1132 bytes} [Sat Jul 2 03:17:34 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:34.572205 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7ec603-0974-456f-b9ac-000dedd0f12b None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:34.594500 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b97e3-9e8d-4324-a5f6-ce190e033a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:34.595230 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b97e3-9e8d-4324-a5f6-ce190e033a17 None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:34.595514 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b97e3-9e8d-4324-a5f6-ce190e033a17 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:34.595768 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b97e3-9e8d-4324-a5f6-ce190e033a17 None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:34.596497 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12b97e3-9e8d-4324-a5f6-ce190e033a17 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:34.597859 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12b97e3-9e8d-4324-a5f6-ce190e033a17 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:34.619354 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 463/907] 10.222.0.60 () {60 vars in 1141 bytes} [Sat Jul 2 03:17:34 2022] POST /identity/v3/services => generated 241 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:17:34.622502 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b97e3-9e8d-4324-a5f6-ce190e033a17 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:34.666040 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:34.698541 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7ec603-0974-456f-b9ac-000dedd0f12b None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:34.707365 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:34.747692 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd51dc54-5eb4-469c-bf03-58daade9c60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:34.748364 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51dc54-5eb4-469c-bf03-58daade9c60c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:34.748701 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51dc54-5eb4-469c-bf03-58daade9c60c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:34.748981 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51dc54-5eb4-469c-bf03-58daade9c60c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:34.749928 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd51dc54-5eb4-469c-bf03-58daade9c60c None admin] RBAC: Adding query filter params (role.id=fae86c59b548423babeca066992cd92d, scope.project.id=e09dc5d9d4904c2b89b0cabed237d55e, user.id=3333e7495b9546d882e2a2211ff8875c) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:34.750301 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd51dc54-5eb4-469c-bf03-58daade9c60c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:34.751971 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd51dc54-5eb4-469c-bf03-58daade9c60c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:34.762869 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 445/908] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Jul 2 03:17:34 2022] GET /identity/v3/role_assignments?user.id=3333e7495b9546d882e2a2211ff8875c&scope.project.id=e09dc5d9d4904c2b89b0cabed237d55e&role.id=fae86c59b548423babeca066992cd92d => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:34.773934 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b97e3-9e8d-4324-a5f6-ce190e033a17 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:34.812197 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1019a9d-07c4-44ae-b197-c26d40dd2ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:34.812909 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1019a9d-07c4-44ae-b197-c26d40dd2ba9 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:34.813166 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1019a9d-07c4-44ae-b197-c26d40dd2ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:34.813433 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1019a9d-07c4-44ae-b197-c26d40dd2ba9 None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:34.814175 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1019a9d-07c4-44ae-b197-c26d40dd2ba9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:34.814479 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1019a9d-07c4-44ae-b197-c26d40dd2ba9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:34.815929 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1019a9d-07c4-44ae-b197-c26d40dd2ba9 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:34.822085 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 464/909] 10.222.0.60 () {56 vars in 1126 bytes} [Sat Jul 2 03:17:34 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:34.828122 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd51dc54-5eb4-469c-bf03-58daade9c60c None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:34.944276 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd51dc54-5eb4-469c-bf03-58daade9c60c None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:34.980945 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa75d44-8924-4059-9cad-d32ef79df874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:34.981774 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa75d44-8924-4059-9cad-d32ef79df874 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:34.982151 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa75d44-8924-4059-9cad-d32ef79df874 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:34.982519 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa75d44-8924-4059-9cad-d32ef79df874 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:34.983365 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa75d44-8924-4059-9cad-d32ef79df874 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:34.983772 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa75d44-8924-4059-9cad-d32ef79df874 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:34.985264 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa75d44-8924-4059-9cad-d32ef79df874 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:34.990998 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 446/910] 10.222.0.60 () {56 vars in 1126 bytes} [Sat Jul 2 03:17:34 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:34.996754 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1019a9d-07c4-44ae-b197-c26d40dd2ba9 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:35.092648 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:35.101258 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1019a9d-07c4-44ae-b197-c26d40dd2ba9 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:35.137060 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad87d0dd-145e-48b9-9c10-f50ae8dbdfba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:35.137719 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad87d0dd-145e-48b9-9c10-f50ae8dbdfba None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:35.137993 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad87d0dd-145e-48b9-9c10-f50ae8dbdfba None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:35.138265 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad87d0dd-145e-48b9-9c10-f50ae8dbdfba None admin] PATH_INFO: `/v3/endpoints` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:35.139060 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad87d0dd-145e-48b9-9c10-f50ae8dbdfba None admin] RBAC: Adding query filter params (interface=public, service_id=2a892aa48903411897247d6075ae9b53, region_id=RegionOne) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:35.139401 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad87d0dd-145e-48b9-9c10-f50ae8dbdfba None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:35.140780 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad87d0dd-145e-48b9-9c10-f50ae8dbdfba None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:35.146412 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 465/911] 10.222.0.60 () {56 vars in 1251 bytes} [Sat Jul 2 03:17:34 2022] GET /identity/v3/endpoints?service_id=2a892aa48903411897247d6075ae9b53&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:35.152169 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa75d44-8924-4059-9cad-d32ef79df874 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:35.184635 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:35.256971 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa75d44-8924-4059-9cad-d32ef79df874 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:35.292748 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935e55bc-72bd-441c-9476-2f70f78557f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:35.293416 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e55bc-72bd-441c-9476-2f70f78557f4 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:35.293741 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e55bc-72bd-441c-9476-2f70f78557f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:35.294021 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e55bc-72bd-441c-9476-2f70f78557f4 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:35.294707 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935e55bc-72bd-441c-9476-2f70f78557f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:35.296120 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935e55bc-72bd-441c-9476-2f70f78557f4 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:35.302958 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 447/912] 10.222.0.60 () {56 vars in 1087 bytes} [Sat Jul 2 03:17:35 2022] GET /identity/v3/services => generated 1497 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:17:35.827475 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435286c9-d40d-48bf-ae0b-ce157a6c49ed None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:35.828010 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435286c9-d40d-48bf-ae0b-ce157a6c49ed None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:35.828010 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435286c9-d40d-48bf-ae0b-ce157a6c49ed None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:35.829692 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 466/913] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:17:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:17:35.835010 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a810d2-e6dc-4178-b279-a94fce137c22 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:35.835452 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a810d2-e6dc-4178-b279-a94fce137c22 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:35.835660 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a810d2-e6dc-4178-b279-a94fce137c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:35.852862 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-32a810d2-e6dc-4178-b279-a94fce137c22 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:17:35.854065 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-32a810d2-e6dc-4178-b279-a94fce137c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:17:35.930776 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 448/914] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:17:35 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 03:17:35.954142 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435286c9-d40d-48bf-ae0b-ce157a6c49ed None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:36.061631 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435286c9-d40d-48bf-ae0b-ce157a6c49ed None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:36.097414 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9666d51d-32ff-49f8-943a-96120cd83e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:36.098189 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666d51d-32ff-49f8-943a-96120cd83e3c None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:36.098474 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666d51d-32ff-49f8-943a-96120cd83e3c None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:36.098748 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666d51d-32ff-49f8-943a-96120cd83e3c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:36.099454 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9666d51d-32ff-49f8-943a-96120cd83e3c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:36.100829 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9666d51d-32ff-49f8-943a-96120cd83e3c None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:36.112843 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-9666d51d-32ff-49f8-943a-96120cd83e3c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 02 03:17:36.112843 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:36.112843 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 02 03:17:36.112843 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 02 03:17:36.112843 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 02 03:17:36.112843 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 02 03:17:36.112843 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 02 03:17:36.112843 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 03:17:36.112843 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 02 03:17:36.112843 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:36.112843 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 03:17:36.112843 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:36.112843 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:36.112843 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:36.112843 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:36.112843 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:36.112843 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:36.113820 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:36.113820 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:36.113820 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:36.113820 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:36.113820 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:36.113820 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:36.113820 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 02 03:17:36.113820 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 02 03:17:36.113820 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 02 03:17:36.113820 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 02 03:17:36.113820 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:36.113820 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:36.113820 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:36.113820 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:36.113820 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:36.113820 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:36.114685 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:36.114685 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:36.114685 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:36.114685 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:36.114685 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:36.114685 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:36.114685 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:36.114685 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:36.114685 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:36.114685 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:36.114685 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 02 03:17:36.114685 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 03:17:36.114685 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 02 03:17:36.114685 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:36.119141 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 467/915] 10.222.0.60 () {56 vars in 1114 bytes} [Sat Jul 2 03:17:35 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:36.120723 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a810d2-e6dc-4178-b279-a94fce137c22 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:36.145728 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:36.226404 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a810d2-e6dc-4178-b279-a94fce137c22 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:36.260481 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8039e25f-c77b-40e7-8efe-2639bc2c901f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:36.261248 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039e25f-c77b-40e7-8efe-2639bc2c901f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:36.261531 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039e25f-c77b-40e7-8efe-2639bc2c901f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:36.261805 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039e25f-c77b-40e7-8efe-2639bc2c901f None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:36.262507 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8039e25f-c77b-40e7-8efe-2639bc2c901f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:36.262812 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8039e25f-c77b-40e7-8efe-2639bc2c901f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:36.264291 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8039e25f-c77b-40e7-8efe-2639bc2c901f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:36.269461 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 449/916] 10.222.0.60 () {56 vars in 1114 bytes} [Sat Jul 2 03:17:36 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:36.275084 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9666d51d-32ff-49f8-943a-96120cd83e3c None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:36.298209 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:36.384294 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9666d51d-32ff-49f8-943a-96120cd83e3c None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:36.423735 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1618b8ee-48ba-4eae-884a-ddfce80b6b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:36.424403 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1618b8ee-48ba-4eae-884a-ddfce80b6b3d None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:36.424679 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1618b8ee-48ba-4eae-884a-ddfce80b6b3d None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:36.424949 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1618b8ee-48ba-4eae-884a-ddfce80b6b3d None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:36.425664 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1618b8ee-48ba-4eae-884a-ddfce80b6b3d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:36.425967 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1618b8ee-48ba-4eae-884a-ddfce80b6b3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:36.427350 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1618b8ee-48ba-4eae-884a-ddfce80b6b3d None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:36.432721 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 468/917] 10.222.0.60 () {56 vars in 1114 bytes} [Sat Jul 2 03:17:36 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:36.438257 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8039e25f-c77b-40e7-8efe-2639bc2c901f None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:36.534453 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:36.547172 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8039e25f-c77b-40e7-8efe-2639bc2c901f None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:36.583652 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b19976-f62e-435a-85bd-a12d98b269da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:36.584311 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b19976-f62e-435a-85bd-a12d98b269da None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:36.584587 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b19976-f62e-435a-85bd-a12d98b269da None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:36.584859 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b19976-f62e-435a-85bd-a12d98b269da None admin] PATH_INFO: `/v3/endpoints` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:36.585621 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b19976-f62e-435a-85bd-a12d98b269da None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:36.587004 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b19976-f62e-435a-85bd-a12d98b269da None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:36.609625 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 450/918] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Jul 2 03:17:36 2022] POST /identity/v3/endpoints => generated 346 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:17:36.798318 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5d0e3-e426-4a60-88ab-7736acd643bc None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:36.798721 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5d0e3-e426-4a60-88ab-7736acd643bc None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:36.798903 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5d0e3-e426-4a60-88ab-7736acd643bc None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:36.800415 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 469/919] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:17:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:17:36.805939 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6653f4a-8e04-4f39-842e-94e43c6c79c4 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:36.806236 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6653f4a-8e04-4f39-842e-94e43c6c79c4 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:36.806516 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6653f4a-8e04-4f39-842e-94e43c6c79c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:36.824297 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-c6653f4a-8e04-4f39-842e-94e43c6c79c4 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:17:36.825489 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c6653f4a-8e04-4f39-842e-94e43c6c79c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:17:36.857182 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da689c5f-f8ac-4575-9564-8f9c06cf13a9 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:36.857790 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da689c5f-f8ac-4575-9564-8f9c06cf13a9 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:36.857790 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da689c5f-f8ac-4575-9564-8f9c06cf13a9 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:36.859416 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 470/920] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:17:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 03:17:36.864461 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7b9ae-fa56-4ea0-bc2b-330c2ed321d7 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:36.864743 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7b9ae-fa56-4ea0-bc2b-330c2ed321d7 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:36.865021 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7b9ae-fa56-4ea0-bc2b-330c2ed321d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:36.884246 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-47a7b9ae-fa56-4ea0-bc2b-330c2ed321d7 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:17:36.885612 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-47a7b9ae-fa56-4ea0-bc2b-330c2ed321d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:17:36.903424 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 451/921] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:17:36 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 03:17:36.926378 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6653f4a-8e04-4f39-842e-94e43c6c79c4 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:36.971881 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 471/922] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:17:36 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 02 03:17:36.994999 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a7b9ae-fa56-4ea0-bc2b-330c2ed321d7 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:37.008630 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:37.012849 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:37.045028 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6653f4a-8e04-4f39-842e-94e43c6c79c4 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:37.082461 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb5d848-70c2-4b96-8d34-919954b2d243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:37.088420 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5d848-70c2-4b96-8d34-919954b2d243 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:37.088761 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5d848-70c2-4b96-8d34-919954b2d243 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:37.089042 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5d848-70c2-4b96-8d34-919954b2d243 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:37.089968 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb5d848-70c2-4b96-8d34-919954b2d243 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:37.092069 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb5d848-70c2-4b96-8d34-919954b2d243 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:37.106112 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-8eb5d848-70c2-4b96-8d34-919954b2d243 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 02 03:17:37.106112 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:37.106112 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 02 03:17:37.106112 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 02 03:17:37.106112 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 02 03:17:37.106112 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 02 03:17:37.106112 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 02 03:17:37.106112 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 03:17:37.106112 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 02 03:17:37.106112 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:37.106112 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 03:17:37.106112 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:37.106112 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:37.106112 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:37.106112 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:37.106112 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:37.106112 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:37.107200 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:37.107200 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:37.107200 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:37.107200 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:37.107200 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:37.107200 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:37.107200 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 02 03:17:37.107200 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 02 03:17:37.107200 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 02 03:17:37.107200 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 02 03:17:37.107200 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:37.107200 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:37.107200 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:37.107200 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:37.107200 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:37.107200 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:37.108038 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:37.108038 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:37.108038 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:37.108038 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:37.108038 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:37.108038 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:37.108038 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:37.108038 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:37.108038 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:37.108038 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:37.108038 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 02 03:17:37.108038 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 03:17:37.108038 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 02 03:17:37.108038 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:37.111202 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 452/923] 10.222.0.60 () {56 vars in 1126 bytes} [Sat Jul 2 03:17:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 03:17:37.113641 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb5d848-70c2-4b96-8d34-919954b2d243 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:37.127161 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a7b9ae-fa56-4ea0-bc2b-330c2ed321d7 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:37.176142 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb6909-9688-4978-9fe9-6e55b2a41077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:37.176996 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb6909-9688-4978-9fe9-6e55b2a41077 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:37.177280 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb6909-9688-4978-9fe9-6e55b2a41077 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:37.177557 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb6909-9688-4978-9fe9-6e55b2a41077 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:37.188689 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccb6909-9688-4978-9fe9-6e55b2a41077 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:17:37.197366 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-bccb6909-9688-4978-9fe9-6e55b2a41077 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 02 03:17:37.197366 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:37.197366 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:37.197366 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:37.197366 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:37.197366 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:37.197366 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:37.197366 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:37.197366 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:37.197366 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:37.197366 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:37.197366 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:37.197366 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:17:37.197366 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:17:37.197366 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:17:37.197366 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:17:37.198312 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:17:37.198312 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:17:37.198312 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:17:37.198312 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:17:37.198312 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:37.198312 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:37.198312 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:37.198312 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:37.198312 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:37.198312 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:37.198312 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:37.198312 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:37.198312 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:37.198312 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:37.198312 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:37.198312 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:37.199301 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:37.199301 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:37.199301 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:37.199301 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:37.199301 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:17:37.199301 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:17:37.199301 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:17:37.199301 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:17:37.199301 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:17:37.199301 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:17:37.199301 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 02 03:17:37.199301 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:37.203612 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 472/924] 10.222.0.60 () {56 vars in 1120 bytes} [Sat Jul 2 03:17:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 03:17:37.205003 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb6909-9688-4978-9fe9-6e55b2a41077 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:37.234662 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb5d848-70c2-4b96-8d34-919954b2d243 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:37.273648 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0d0ffb-372c-4ccd-abab-a6aaa4c3b87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:37.274883 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d0ffb-372c-4ccd-abab-a6aaa4c3b87e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:37.275885 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d0ffb-372c-4ccd-abab-a6aaa4c3b87e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:37.276339 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d0ffb-372c-4ccd-abab-a6aaa4c3b87e None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:37.277560 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0d0ffb-372c-4ccd-abab-a6aaa4c3b87e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:37.278044 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0d0ffb-372c-4ccd-abab-a6aaa4c3b87e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:37.280656 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0d0ffb-372c-4ccd-abab-a6aaa4c3b87e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:37.282072 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:37.286223 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:37.291647 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 453/925] 10.222.0.60 () {56 vars in 1122 bytes} [Sat Jul 2 03:17:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:37.295953 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0d0ffb-372c-4ccd-abab-a6aaa4c3b87e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:37.322182 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb6909-9688-4978-9fe9-6e55b2a41077 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:37.359335 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f9a481-c307-4c45-9cff-8d58a7f84fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:37.359925 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f9a481-c307-4c45-9cff-8d58a7f84fa4 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:37.360206 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f9a481-c307-4c45-9cff-8d58a7f84fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:37.360481 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f9a481-c307-4c45-9cff-8d58a7f84fa4 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:37.361331 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f9a481-c307-4c45-9cff-8d58a7f84fa4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:37.361640 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f9a481-c307-4c45-9cff-8d58a7f84fa4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:37.363106 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f9a481-c307-4c45-9cff-8d58a7f84fa4 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:37.389581 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 473/926] 10.222.0.60 () {56 vars in 1115 bytes} [Sat Jul 2 03:17:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:17:37.389926 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f9a481-c307-4c45-9cff-8d58a7f84fa4 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:37.427497 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0d0ffb-372c-4ccd-abab-a6aaa4c3b87e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:37.471437 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea35663c-d0c1-4496-8fa7-ce35f421c4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:37.472454 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea35663c-d0c1-4496-8fa7-ce35f421c4b4 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:37.472956 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea35663c-d0c1-4496-8fa7-ce35f421c4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:37.473444 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea35663c-d0c1-4496-8fa7-ce35f421c4b4 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:37.474827 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea35663c-d0c1-4496-8fa7-ce35f421c4b4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:37.475370 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea35663c-d0c1-4496-8fa7-ce35f421c4b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:37.477437 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea35663c-d0c1-4496-8fa7-ce35f421c4b4 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:37.484312 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 454/927] 10.222.0.60 () {56 vars in 1122 bytes} [Sat Jul 2 03:17:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:17:37.485845 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba19c398-b44a-4cc2-a5e8-58fad6121a3e None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:37.486319 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba19c398-b44a-4cc2-a5e8-58fad6121a3e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:37.486782 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba19c398-b44a-4cc2-a5e8-58fad6121a3e None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:37.488729 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 455/928] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:17:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:17:37.489657 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba19c398-b44a-4cc2-a5e8-58fad6121a3e None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:37.503281 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f9a481-c307-4c45-9cff-8d58a7f84fa4 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:37.538377 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d24240-2748-4da9-829f-b5311663beee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:37.539545 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d24240-2748-4da9-829f-b5311663beee None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:37.539828 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d24240-2748-4da9-829f-b5311663beee None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:37.540108 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d24240-2748-4da9-829f-b5311663beee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:37.543243 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:37.552226 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d24240-2748-4da9-829f-b5311663beee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:37.554349 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d24240-2748-4da9-829f-b5311663beee None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:37.559048 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:37.572583 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-97d24240-2748-4da9-829f-b5311663beee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:37.572583 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:37.572583 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:37.572583 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:37.572583 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:37.572583 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:37.572583 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:37.572583 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:37.572583 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:37.572583 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:37.572583 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:37.572583 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:37.572583 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:17:37.572583 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:17:37.572583 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:17:37.573560 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:17:37.573560 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:37.573560 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:37.573560 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:37.573560 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:37.573560 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:37.573560 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:37.573560 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:37.573560 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:37.573560 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:37.573560 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:37.573560 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:37.573560 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:37.573560 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:37.573560 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:37.573560 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:37.573560 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:37.574554 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:17:37.574554 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:17:37.574554 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:37.574554 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:37.578744 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 474/929] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:17:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:37.580153 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4544664-b065-467f-9874-ce3cf33ed9a4 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:37.580423 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4544664-b065-467f-9874-ce3cf33ed9a4 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:37.580704 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4544664-b065-467f-9874-ce3cf33ed9a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:37.598856 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-d4544664-b065-467f-9874-ce3cf33ed9a4 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:17:37.600264 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-d4544664-b065-467f-9874-ce3cf33ed9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:17:37.605516 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba19c398-b44a-4cc2-a5e8-58fad6121a3e None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:37.642081 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b0a40-53e1-4072-a362-75ee4623b75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:37.642648 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b0a40-53e1-4072-a362-75ee4623b75b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:37.642930 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b0a40-53e1-4072-a362-75ee4623b75b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:37.643229 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b0a40-53e1-4072-a362-75ee4623b75b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:37.644023 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7b0a40-53e1-4072-a362-75ee4623b75b None admin] RBAC: Adding query filter params (interface=public, service_id=8211932dc8e94c9aa35ed95fcf408c42, region_id=RegionOne) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:37.644529 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7b0a40-53e1-4072-a362-75ee4623b75b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:37.645728 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7b0a40-53e1-4072-a362-75ee4623b75b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:37.651680 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 456/930] 10.222.0.60 () {56 vars in 1251 bytes} [Sat Jul 2 03:17:37 2022] GET /identity/v3/endpoints?service_id=8211932dc8e94c9aa35ed95fcf408c42&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:37.656887 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b0a40-53e1-4072-a362-75ee4623b75b None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:37.671341 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 475/931] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:17:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 03:17:37.672727 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4544664-b065-467f-9874-ce3cf33ed9a4 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:37.761457 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b0a40-53e1-4072-a362-75ee4623b75b None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:37.783598 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4544664-b065-467f-9874-ce3cf33ed9a4 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:37.788543 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:37.801001 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e644beee-e109-4e03-9f32-4173280e8e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:37.801676 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644beee-e109-4e03-9f32-4173280e8e73 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:37.801961 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644beee-e109-4e03-9f32-4173280e8e73 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:37.802236 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644beee-e109-4e03-9f32-4173280e8e73 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:37.802977 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e644beee-e109-4e03-9f32-4173280e8e73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:37.803317 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e644beee-e109-4e03-9f32-4173280e8e73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:37.804771 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e644beee-e109-4e03-9f32-4173280e8e73 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:37.804957 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:37.818481 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 457/932] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:17:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:37.819616 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e644beee-e109-4e03-9f32-4173280e8e73 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:37.828612 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08b5ad1-01b8-491e-bb85-46075be6e680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:37.829347 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b5ad1-01b8-491e-bb85-46075be6e680 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:37.829625 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b5ad1-01b8-491e-bb85-46075be6e680 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:37.829951 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b5ad1-01b8-491e-bb85-46075be6e680 None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:37.830756 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08b5ad1-01b8-491e-bb85-46075be6e680 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:37.832335 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08b5ad1-01b8-491e-bb85-46075be6e680 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:37.839705 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 476/933] 10.222.0.60 () {56 vars in 1087 bytes} [Sat Jul 2 03:17:37 2022] GET /identity/v3/services => generated 1497 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:17:37.840572 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08b5ad1-01b8-491e-bb85-46075be6e680 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:37.961652 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e644beee-e109-4e03-9f32-4173280e8e73 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:37.968664 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08b5ad1-01b8-491e-bb85-46075be6e680 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:38.007837 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab8d2d7-8634-40f1-b46a-324bd1dab574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:38.009173 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8d2d7-8634-40f1-b46a-324bd1dab574 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:38.009650 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8d2d7-8634-40f1-b46a-324bd1dab574 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:38.010133 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8d2d7-8634-40f1-b46a-324bd1dab574 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:38.011506 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adef9fc6-2ba5-4d34-a6ed-225db35f3b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:38.012393 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef9fc6-2ba5-4d34-a6ed-225db35f3b21 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:38.013020 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef9fc6-2ba5-4d34-a6ed-225db35f3b21 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:38.013365 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef9fc6-2ba5-4d34-a6ed-225db35f3b21 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:38.014104 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adef9fc6-2ba5-4d34-a6ed-225db35f3b21 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:38.016289 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adef9fc6-2ba5-4d34-a6ed-225db35f3b21 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:38.020348 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab8d2d7-8634-40f1-b46a-324bd1dab574 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:38.021308 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab8d2d7-8634-40f1-b46a-324bd1dab574 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:38.030722 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-adef9fc6-2ba5-4d34-a6ed-225db35f3b21 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 02 03:17:38.030722 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:38.030722 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 02 03:17:38.030722 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 02 03:17:38.030722 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 02 03:17:38.030722 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 02 03:17:38.030722 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 02 03:17:38.030722 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 03:17:38.030722 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 02 03:17:38.030722 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:38.030722 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 03:17:38.030722 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:38.030722 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:38.030722 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:38.030722 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:38.030722 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:38.031827 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:38.031827 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:38.031827 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:38.031827 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:38.031827 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:38.031827 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:38.031827 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:38.031827 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 02 03:17:38.031827 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 02 03:17:38.031827 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 02 03:17:38.031827 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 02 03:17:38.031827 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:38.031827 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:38.031827 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:38.031827 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:38.031827 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:38.032729 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:38.032729 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:38.032729 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:38.032729 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:38.032729 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:38.032729 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:38.032729 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:38.032729 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:38.032729 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:38.032729 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:38.032729 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:38.032729 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 02 03:17:38.032729 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 03:17:38.032729 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 02 03:17:38.032729 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:38.032729 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 458/934] 10.222.0.60 () {56 vars in 1132 bytes} [Sat Jul 2 03:17:37 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:38.038009 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adef9fc6-2ba5-4d34-a6ed-225db35f3b21 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:38.042835 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-6ab8d2d7-8634-40f1-b46a-324bd1dab574 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 02 03:17:38.042835 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:38.042835 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:38.042835 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:38.042835 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:38.042835 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:38.042835 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:38.042835 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:38.042835 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:38.042835 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:38.042835 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:38.042835 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:38.042835 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 03:17:38.042835 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 03:17:38.042835 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 03:17:38.042835 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 03:17:38.043859 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:38.043859 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:38.043859 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 03:17:38.043859 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 03:17:38.043859 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 03:17:38.043859 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 03:17:38.043859 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:38.043859 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:38.043859 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:38.043859 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:38.043859 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:38.043859 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:38.043859 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:38.043859 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:38.043859 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:38.043859 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:38.043859 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:38.043859 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:38.044852 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:38.044852 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:38.044852 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 03:17:38.044852 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 03:17:38.044852 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 03:17:38.044852 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 03:17:38.044852 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 03:17:38.044852 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 03:17:38.044852 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 02 03:17:38.044852 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:38.044852 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 477/935] 10.222.0.60 () {56 vars in 1117 bytes} [Sat Jul 2 03:17:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:38.049117 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab8d2d7-8634-40f1-b46a-324bd1dab574 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:38.094790 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:38.106440 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:38.158216 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab8d2d7-8634-40f1-b46a-324bd1dab574 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:38.175989 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adef9fc6-2ba5-4d34-a6ed-225db35f3b21 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:38.193563 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd5071-cb2e-4243-976f-5b929ae681be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:38.194317 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd5071-cb2e-4243-976f-5b929ae681be None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:38.194658 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd5071-cb2e-4243-976f-5b929ae681be None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:38.194990 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd5071-cb2e-4243-976f-5b929ae681be None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:38.195925 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbd5071-cb2e-4243-976f-5b929ae681be None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:38.196289 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbd5071-cb2e-4243-976f-5b929ae681be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:38.197899 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbd5071-cb2e-4243-976f-5b929ae681be None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:38.212746 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564edc41-9695-44a8-9687-aba79f580378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:38.213341 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564edc41-9695-44a8-9687-aba79f580378 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:38.213621 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564edc41-9695-44a8-9687-aba79f580378 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:38.213896 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564edc41-9695-44a8-9687-aba79f580378 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:38.214609 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564edc41-9695-44a8-9687-aba79f580378 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:38.214917 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564edc41-9695-44a8-9687-aba79f580378 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:38.216337 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564edc41-9695-44a8-9687-aba79f580378 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:38.220989 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 478/936] 10.222.0.60 () {56 vars in 1149 bytes} [Sat Jul 2 03:17:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:17:38.222004 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 459/937] 10.222.0.60 () {56 vars in 1126 bytes} [Sat Jul 2 03:17:38 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:38.222130 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd5071-cb2e-4243-976f-5b929ae681be None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:38.227512 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564edc41-9695-44a8-9687-aba79f580378 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:38.335564 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:38.340130 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd5071-cb2e-4243-976f-5b929ae681be None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:38.345096 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564edc41-9695-44a8-9687-aba79f580378 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:38.359244 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:38.384853 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d7bb8d-a2ae-4f39-a57c-ec3d60fcdf0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:38.385826 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d7bb8d-a2ae-4f39-a57c-ec3d60fcdf0d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:38.386104 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d7bb8d-a2ae-4f39-a57c-ec3d60fcdf0d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:38.386374 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d7bb8d-a2ae-4f39-a57c-ec3d60fcdf0d None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:38.387210 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d7bb8d-a2ae-4f39-a57c-ec3d60fcdf0d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:38.387539 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d7bb8d-a2ae-4f39-a57c-ec3d60fcdf0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:38.389695 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d7bb8d-a2ae-4f39-a57c-ec3d60fcdf0d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:38.396827 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19751914-14af-471b-aba7-e3ee4887d160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:38.397193 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 460/938] 10.222.0.60 () {56 vars in 1126 bytes} [Sat Jul 2 03:17:38 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:38.400071 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19751914-14af-471b-aba7-e3ee4887d160 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:38.400349 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19751914-14af-471b-aba7-e3ee4887d160 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:38.400726 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19751914-14af-471b-aba7-e3ee4887d160 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:38.402660 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d7bb8d-a2ae-4f39-a57c-ec3d60fcdf0d None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:38.416473 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19751914-14af-471b-aba7-e3ee4887d160 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:38.418783 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19751914-14af-471b-aba7-e3ee4887d160 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:38.443752 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-19751914-14af-471b-aba7-e3ee4887d160 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:38.443752 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:38.443752 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:38.443752 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:38.443752 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:38.443752 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:38.443752 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:38.443752 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:38.443752 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:38.443752 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:38.443752 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:38.443752 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:38.443752 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:17:38.443752 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:17:38.443752 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:17:38.444724 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:17:38.444724 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:38.444724 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:38.444724 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:38.444724 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:38.444724 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:38.444724 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:38.444724 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:38.444724 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:38.444724 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:38.444724 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:38.444724 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:38.444724 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:38.444724 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:38.444724 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:38.444724 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:38.444724 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:38.445628 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:17:38.445628 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:17:38.445628 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:38.445628 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:38.447220 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 479/939] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:17:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:38.452128 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19751914-14af-471b-aba7-e3ee4887d160 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:38.523593 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d7bb8d-a2ae-4f39-a57c-ec3d60fcdf0d None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:38.557113 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19751914-14af-471b-aba7-e3ee4887d160 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:38.560490 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb4c262-a87b-4060-b0d8-076beefece3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:38.561456 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4c262-a87b-4060-b0d8-076beefece3c None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:38.561968 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4c262-a87b-4060-b0d8-076beefece3c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:38.562549 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4c262-a87b-4060-b0d8-076beefece3c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:38.563514 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb4c262-a87b-4060-b0d8-076beefece3c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:38.565106 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb4c262-a87b-4060-b0d8-076beefece3c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:38.589939 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 461/940] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Jul 2 03:17:38 2022] POST /identity/v3/endpoints => generated 347 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 03:17:38.616917 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58bfb01-dbbb-4dd2-9866-b0d86014c022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:38.618031 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58bfb01-dbbb-4dd2-9866-b0d86014c022 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:38.618586 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58bfb01-dbbb-4dd2-9866-b0d86014c022 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:38.620990 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58bfb01-dbbb-4dd2-9866-b0d86014c022 None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:38.622550 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58bfb01-dbbb-4dd2-9866-b0d86014c022 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:38.623540 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58bfb01-dbbb-4dd2-9866-b0d86014c022 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:38.625644 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58bfb01-dbbb-4dd2-9866-b0d86014c022 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:38.645505 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 480/941] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:17:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:38.652731 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb4c262-a87b-4060-b0d8-076beefece3c None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:38.703663 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:38.769175 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e376136-dab6-433d-874d-6e7854c9710a None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:38.769447 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e376136-dab6-433d-874d-6e7854c9710a None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:38.769771 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e376136-dab6-433d-874d-6e7854c9710a None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:38.771364 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 481/942] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:17:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 03:17:38.776117 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac651ce-803a-402b-b2f4-43044dcf3bb1 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:38.776347 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac651ce-803a-402b-b2f4-43044dcf3bb1 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:38.776605 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac651ce-803a-402b-b2f4-43044dcf3bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:38.800166 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-6ac651ce-803a-402b-b2f4-43044dcf3bb1 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:17:38.803078 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb4c262-a87b-4060-b0d8-076beefece3c None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:38.805069 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-6ac651ce-803a-402b-b2f4-43044dcf3bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:17:38.808189 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:38.842486 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070fe092-a2f3-4778-9f9b-c4aa796e230b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:38.843441 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070fe092-a2f3-4778-9f9b-c4aa796e230b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:38.843741 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070fe092-a2f3-4778-9f9b-c4aa796e230b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:38.844097 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070fe092-a2f3-4778-9f9b-c4aa796e230b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:38.851642 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070fe092-a2f3-4778-9f9b-c4aa796e230b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:38.852640 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070fe092-a2f3-4778-9f9b-c4aa796e230b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:38.866603 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-070fe092-a2f3-4778-9f9b-c4aa796e230b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 03:17:38.866603 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:38.866603 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:38.866603 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:38.866603 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:38.866603 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:38.866603 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:38.866603 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:38.866603 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:38.866603 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:38.866603 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:38.866603 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:38.866603 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 03:17:38.866603 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 03:17:38.866603 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 03:17:38.867720 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 03:17:38.867720 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:38.867720 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:38.867720 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:38.867720 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:38.867720 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:38.867720 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:38.867720 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:38.867720 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:38.867720 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:38.867720 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:38.867720 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:38.867720 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:38.867720 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:38.867720 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:38.867720 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:38.867720 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:38.868715 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 03:17:38.868715 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 03:17:38.868715 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 03:17:38.868715 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 03:17:38.868715 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 03:17:38.868715 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 03:17:38.868715 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 03:17:38.868715 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:38.869147 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 462/943] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Jul 2 03:17:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:38.874952 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070fe092-a2f3-4778-9f9b-c4aa796e230b None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:38.889779 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 482/944] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:17:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 02 03:17:38.914472 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac651ce-803a-402b-b2f4-43044dcf3bb1 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:38.983734 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:38.990547 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070fe092-a2f3-4778-9f9b-c4aa796e230b None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:39.026277 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd1bae-f43e-47e9-8ada-0cb04acd660c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:39.026861 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd1bae-f43e-47e9-8ada-0cb04acd660c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:39.027150 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd1bae-f43e-47e9-8ada-0cb04acd660c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:39.027623 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd1bae-f43e-47e9-8ada-0cb04acd660c None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:39.028334 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac651ce-803a-402b-b2f4-43044dcf3bb1 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:39.028784 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cd1bae-f43e-47e9-8ada-0cb04acd660c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:39.028784 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cd1bae-f43e-47e9-8ada-0cb04acd660c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:39.030666 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cd1bae-f43e-47e9-8ada-0cb04acd660c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:39.045888 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 463/945] 10.222.0.60 () {56 vars in 1148 bytes} [Sat Jul 2 03:17:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:39.052217 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd1bae-f43e-47e9-8ada-0cb04acd660c None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:39.075756 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec2874-59f5-4c32-bec8-2b4bc6af93a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:39.076814 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec2874-59f5-4c32-bec8-2b4bc6af93a3 None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:39.077332 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec2874-59f5-4c32-bec8-2b4bc6af93a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:39.077805 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec2874-59f5-4c32-bec8-2b4bc6af93a3 None admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:39.078713 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ec2874-59f5-4c32-bec8-2b4bc6af93a3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:39.080405 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ec2874-59f5-4c32-bec8-2b4bc6af93a3 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:39.082017 dv-cinder-846842-9-smb devstack@keystone.service[80233]: WARNING keystone.server.flask.common [None req-82ec2874-59f5-4c32-bec8-2b4bc6af93a3 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 02 03:17:39.093826 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:39.105246 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.sql.core [None req-82ec2874-59f5-4c32-bec8-2b4bc6af93a3 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 02 03:17:39.105246 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 02 03:17:39.105246 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [parameters: {'id': '05c238c361db4ef188bb25b387ac28cd', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 02 03:17:39.105246 dv-cinder-846842-9-smb devstack@keystone.service[80233]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80233) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 02 03:17:39.114189 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-82ec2874-59f5-4c32-bec8-2b4bc6af93a3 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 05c238c361db4ef188bb25b387ac28cd.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 05c238c361db4ef188bb25b387ac28cd. Jul 02 03:17:39.114189 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:39.114189 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 02 03:17:39.114189 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 02 03:17:39.114189 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 02 03:17:39.114189 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 02 03:17:39.114189 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 02 03:17:39.114189 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application result = self._query(query) Jul 02 03:17:39.114189 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 02 03:17:39.114189 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application conn.query(q) Jul 02 03:17:39.114189 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 02 03:17:39.114189 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 02 03:17:39.114189 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 02 03:17:39.115083 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application result.read() Jul 02 03:17:39.115083 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 02 03:17:39.115083 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 02 03:17:39.115083 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 02 03:17:39.115083 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 02 03:17:39.115083 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 02 03:17:39.115083 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 02 03:17:39.115083 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 02 03:17:39.115083 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 02 03:17:39.115083 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 02 03:17:39.115083 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:39.115083 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 02 03:17:39.115083 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:39.115083 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:39.115083 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 02 03:17:39.115083 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 02 03:17:39.115083 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 02 03:17:39.115083 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 02 03:17:39.116081 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 02 03:17:39.116081 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application next(self.gen) Jul 02 03:17:39.116081 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 02 03:17:39.116081 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application yield resource Jul 02 03:17:39.116081 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 02 03:17:39.116081 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application next(self.gen) Jul 02 03:17:39.116081 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 02 03:17:39.116081 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self.session.rollback() Jul 02 03:17:39.116081 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 02 03:17:39.116081 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self.force_reraise() Jul 02 03:17:39.116081 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 02 03:17:39.116081 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise self.value Jul 02 03:17:39.116081 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 02 03:17:39.116081 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 02 03:17:39.116081 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 02 03:17:39.116081 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application session.commit() Jul 02 03:17:39.116081 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 02 03:17:39.117016 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 02 03:17:39.117016 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 02 03:17:39.117016 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._prepare_impl() Jul 02 03:17:39.117016 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 02 03:17:39.117016 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self.session.flush() Jul 02 03:17:39.117016 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 02 03:17:39.117016 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._flush(objects) Jul 02 03:17:39.117016 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 02 03:17:39.117016 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 02 03:17:39.117016 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 02 03:17:39.117016 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application compat.raise_( Jul 02 03:17:39.117016 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 02 03:17:39.117016 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception Jul 02 03:17:39.117016 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 02 03:17:39.117016 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application flush_context.execute() Jul 02 03:17:39.117016 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 02 03:17:39.117016 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rec.execute(self) Jul 02 03:17:39.117933 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 02 03:17:39.117933 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 02 03:17:39.117933 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 02 03:17:39.117933 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 02 03:17:39.117933 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 02 03:17:39.117933 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 02 03:17:39.117933 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 02 03:17:39.117933 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 02 03:17:39.117933 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 02 03:17:39.117933 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 02 03:17:39.117933 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 02 03:17:39.117933 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 02 03:17:39.117933 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 02 03:17:39.117933 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 02 03:17:39.117933 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 02 03:17:39.118943 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 02 03:17:39.118943 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 02 03:17:39.118943 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception Jul 02 03:17:39.118943 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 02 03:17:39.118943 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 02 03:17:39.118943 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 02 03:17:39.118943 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 02 03:17:39.118943 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 02 03:17:39.118943 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application result = self._query(query) Jul 02 03:17:39.118943 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 02 03:17:39.118943 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application conn.query(q) Jul 02 03:17:39.118943 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 02 03:17:39.118943 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 02 03:17:39.118943 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 02 03:17:39.118943 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application result.read() Jul 02 03:17:39.118943 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 02 03:17:39.118943 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 02 03:17:39.121857 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 02 03:17:39.121857 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 02 03:17:39.121857 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 02 03:17:39.121857 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 02 03:17:39.121857 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 02 03:17:39.121857 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 02 03:17:39.121857 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 02 03:17:39.121857 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 02 03:17:39.121857 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [parameters: {'id': '05c238c361db4ef188bb25b387ac28cd', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 02 03:17:39.121857 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 02 03:17:39.121857 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:39.121857 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 03:17:39.121857 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:39.121857 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:39.121857 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 02 03:17:39.123912 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 02 03:17:39.123912 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 02 03:17:39.123912 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 02 03:17:39.123912 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 02 03:17:39.123912 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:39.123912 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 03:17:39.123912 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:39.123912 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:39.123912 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:39.123912 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:39.123912 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:39.123912 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:39.123912 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:39.123912 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:39.123912 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:39.123912 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:39.123912 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:39.126182 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:39.126182 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 02 03:17:39.126182 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 02 03:17:39.126182 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:39.126182 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:39.126182 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 02 03:17:39.126182 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 02 03:17:39.126182 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 05c238c361db4ef188bb25b387ac28cd. Jul 02 03:17:39.126182 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:39.129394 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 483/946] 10.222.0.60 () {60 vars in 1140 bytes} [Sat Jul 2 03:17:38 2022] POST /identity/v3/projects => generated 262 bytes in 216 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 02 03:17:39.135045 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec2874-59f5-4c32-bec8-2b4bc6af93a3 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:39.199495 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd1bae-f43e-47e9-8ada-0cb04acd660c None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:39.248183 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edde8f4-e955-4ba6-a6d1-9478cd6ab9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:39.249956 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edde8f4-e955-4ba6-a6d1-9478cd6ab9d3 None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:39.250461 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edde8f4-e955-4ba6-a6d1-9478cd6ab9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:39.251334 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edde8f4-e955-4ba6-a6d1-9478cd6ab9d3 None admin] PATH_INFO: `/v3/projects/e09dc5d9d4904c2b89b0cabed237d55e/users/3333e7495b9546d882e2a2211ff8875c/roles/fae86c59b548423babeca066992cd92d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:39.254759 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edde8f4-e955-4ba6-a6d1-9478cd6ab9d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=e09dc5d9d4904c2b89b0cabed237d55e, user_id=3333e7495b9546d882e2a2211ff8875c, role_id=fae86c59b548423babeca066992cd92d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:39.254932 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec2874-59f5-4c32-bec8-2b4bc6af93a3 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:39.256596 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edde8f4-e955-4ba6-a6d1-9478cd6ab9d3 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:39.287278 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 464/947] 10.222.0.60 () {58 vars in 1439 bytes} [Sat Jul 2 03:17:39 2022] PUT /identity/v3/projects/e09dc5d9d4904c2b89b0cabed237d55e/users/3333e7495b9546d882e2a2211ff8875c/roles/fae86c59b548423babeca066992cd92d => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:17:39.309652 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d66c40-5081-47b4-8542-24869194206c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:39.310473 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d66c40-5081-47b4-8542-24869194206c None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:39.310745 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d66c40-5081-47b4-8542-24869194206c None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:39.311006 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d66c40-5081-47b4-8542-24869194206c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:39.320386 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d66c40-5081-47b4-8542-24869194206c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:39.322330 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d66c40-5081-47b4-8542-24869194206c None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:39.338634 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-74d66c40-5081-47b4-8542-24869194206c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 03:17:39.338634 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:39.338634 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:39.338634 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:39.338634 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:39.338634 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:39.338634 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:39.338634 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:39.338634 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:39.338634 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:39.338634 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:39.338634 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:39.338634 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 03:17:39.338634 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 03:17:39.338634 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 03:17:39.339782 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 03:17:39.339782 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:39.339782 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:39.339782 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:39.339782 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:39.339782 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:39.339782 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:39.339782 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:39.339782 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:39.339782 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:39.339782 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:39.339782 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:39.339782 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:39.339782 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:39.339782 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:39.339782 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:39.339782 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:39.340868 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 03:17:39.340868 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 03:17:39.340868 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 03:17:39.340868 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 03:17:39.340868 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 03:17:39.340868 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 03:17:39.340868 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 03:17:39.340868 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:39.340868 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 484/948] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Jul 2 03:17:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 03:17:39.346603 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edde8f4-e955-4ba6-a6d1-9478cd6ab9d3 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:39.366561 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:39.467673 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edde8f4-e955-4ba6-a6d1-9478cd6ab9d3 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:39.504354 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d100a322-b262-4040-962d-0a1c93480d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:39.505107 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100a322-b262-4040-962d-0a1c93480d86 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:39.505442 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100a322-b262-4040-962d-0a1c93480d86 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:39.505769 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100a322-b262-4040-962d-0a1c93480d86 None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:39.506622 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d100a322-b262-4040-962d-0a1c93480d86 None admin] RBAC: Adding query filter params (name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:39.506988 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d100a322-b262-4040-962d-0a1c93480d86 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:39.508511 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d100a322-b262-4040-962d-0a1c93480d86 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:39.527804 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 465/949] 10.222.0.60 () {56 vars in 1112 bytes} [Sat Jul 2 03:17:39 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:39.980130 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a947ea8-fa1e-46d2-bab8-45f4fe03b915 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:39.980461 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a947ea8-fa1e-46d2-bab8-45f4fe03b915 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:39.980737 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a947ea8-fa1e-46d2-bab8-45f4fe03b915 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:39.985150 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 485/950] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:17:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:17:39.990514 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bcbdc3-0d34-44d5-bcec-add0ba1e4377 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:39.990995 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bcbdc3-0d34-44d5-bcec-add0ba1e4377 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:39.991080 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bcbdc3-0d34-44d5-bcec-add0ba1e4377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:40.007986 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-76bcbdc3-0d34-44d5-bcec-add0ba1e4377 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:17:40.009239 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-76bcbdc3-0d34-44d5-bcec-add0ba1e4377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:17:40.083230 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 466/951] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:17:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 03:17:40.101643 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a947ea8-fa1e-46d2-bab8-45f4fe03b915 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:40.160523 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:40.208879 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a947ea8-fa1e-46d2-bab8-45f4fe03b915 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:40.242410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6120216-f553-432f-ac48-a8fb6dbc2cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:40.243269 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6120216-f553-432f-ac48-a8fb6dbc2cc3 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:40.243543 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6120216-f553-432f-ac48-a8fb6dbc2cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:40.243809 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6120216-f553-432f-ac48-a8fb6dbc2cc3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:40.244457 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6120216-f553-432f-ac48-a8fb6dbc2cc3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:40.245811 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6120216-f553-432f-ac48-a8fb6dbc2cc3 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:40.257734 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-c6120216-f553-432f-ac48-a8fb6dbc2cc3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 02 03:17:40.257734 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:40.257734 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 02 03:17:40.257734 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 02 03:17:40.257734 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 02 03:17:40.257734 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 02 03:17:40.257734 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 02 03:17:40.257734 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 03:17:40.257734 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 02 03:17:40.257734 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:40.257734 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 03:17:40.257734 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:40.257734 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:40.257734 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:40.257734 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:40.257734 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:40.257734 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:40.258929 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:40.258929 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:40.258929 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:40.258929 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:40.258929 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:40.258929 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:40.258929 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 02 03:17:40.258929 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 02 03:17:40.258929 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 02 03:17:40.258929 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 02 03:17:40.258929 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:40.258929 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:40.258929 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:40.258929 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:40.258929 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:40.258929 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:40.259879 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:40.259879 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:40.259879 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:40.259879 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:40.259879 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:40.259879 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:40.259879 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:40.259879 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:40.259879 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:40.259879 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:40.259879 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 02 03:17:40.259879 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 03:17:40.259879 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 02 03:17:40.259879 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:40.259879 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 486/952] 10.222.0.60 () {56 vars in 1126 bytes} [Sat Jul 2 03:17:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:40.265639 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bcbdc3-0d34-44d5-bcec-add0ba1e4377 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:40.295519 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:40.365523 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bcbdc3-0d34-44d5-bcec-add0ba1e4377 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:40.410800 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c26f1c-fef5-4036-9c6c-5627ccf0954f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:40.411811 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c26f1c-fef5-4036-9c6c-5627ccf0954f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:40.412293 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c26f1c-fef5-4036-9c6c-5627ccf0954f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:40.412755 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c26f1c-fef5-4036-9c6c-5627ccf0954f None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:40.414074 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c26f1c-fef5-4036-9c6c-5627ccf0954f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:40.414580 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c26f1c-fef5-4036-9c6c-5627ccf0954f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:40.416212 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c26f1c-fef5-4036-9c6c-5627ccf0954f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:40.421729 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 467/953] 10.222.0.60 () {56 vars in 1122 bytes} [Sat Jul 2 03:17:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:40.427410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6120216-f553-432f-ac48-a8fb6dbc2cc3 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:40.530221 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6120216-f553-432f-ac48-a8fb6dbc2cc3 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:40.549623 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:40.569411 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66abb0b-7dda-47b0-ad33-a906a468488f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:40.570431 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66abb0b-7dda-47b0-ad33-a906a468488f None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:40.570905 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66abb0b-7dda-47b0-ad33-a906a468488f None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:40.571426 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66abb0b-7dda-47b0-ad33-a906a468488f None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:40.572344 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66abb0b-7dda-47b0-ad33-a906a468488f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:40.572841 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66abb0b-7dda-47b0-ad33-a906a468488f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:40.574404 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66abb0b-7dda-47b0-ad33-a906a468488f None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:40.580022 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 487/954] 10.222.0.60 () {56 vars in 1122 bytes} [Sat Jul 2 03:17:40 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:40.591155 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c26f1c-fef5-4036-9c6c-5627ccf0954f None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:40.658768 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:40.694340 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c26f1c-fef5-4036-9c6c-5627ccf0954f None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:40.729471 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4ed5a1-6ada-43d7-abc5-6c75a49cefa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:40.730123 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ed5a1-6ada-43d7-abc5-6c75a49cefa2 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:40.730397 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ed5a1-6ada-43d7-abc5-6c75a49cefa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:40.730664 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ed5a1-6ada-43d7-abc5-6c75a49cefa2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:40.731439 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4ed5a1-6ada-43d7-abc5-6c75a49cefa2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:40.732806 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4ed5a1-6ada-43d7-abc5-6c75a49cefa2 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:40.753555 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 468/955] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Jul 2 03:17:40 2022] POST /identity/v3/endpoints => generated 349 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:17:40.794029 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca81d5-6ee1-4a51-8bed-9d95ad5140f5 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:40.794313 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca81d5-6ee1-4a51-8bed-9d95ad5140f5 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:40.794554 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca81d5-6ee1-4a51-8bed-9d95ad5140f5 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:40.796155 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 488/956] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:17:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:17:40.801793 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1d253-9c59-4596-aecd-84a8d914b4ae None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:40.802083 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1d253-9c59-4596-aecd-84a8d914b4ae None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:40.802367 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1d253-9c59-4596-aecd-84a8d914b4ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:40.821523 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-31d1d253-9c59-4596-aecd-84a8d914b4ae None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:17:40.822801 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-31d1d253-9c59-4596-aecd-84a8d914b4ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:17:40.903845 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 469/957] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:17:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 03:17:40.926119 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ca81d5-6ee1-4a51-8bed-9d95ad5140f5 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:41.037037 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ca81d5-6ee1-4a51-8bed-9d95ad5140f5 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:41.072779 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1ffb03-8ef8-4cbd-8ebb-9d3ee0a6d2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:41.073917 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1ffb03-8ef8-4cbd-8ebb-9d3ee0a6d2a1 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:41.074382 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1ffb03-8ef8-4cbd-8ebb-9d3ee0a6d2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:41.074823 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1ffb03-8ef8-4cbd-8ebb-9d3ee0a6d2a1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:41.075701 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1ffb03-8ef8-4cbd-8ebb-9d3ee0a6d2a1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:41.077311 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1ffb03-8ef8-4cbd-8ebb-9d3ee0a6d2a1 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:41.089995 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-fc1ffb03-8ef8-4cbd-8ebb-9d3ee0a6d2a1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 02 03:17:41.089995 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:41.089995 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 02 03:17:41.089995 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 02 03:17:41.089995 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 02 03:17:41.089995 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 02 03:17:41.089995 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 02 03:17:41.089995 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 03:17:41.089995 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 02 03:17:41.089995 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:41.089995 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 03:17:41.089995 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:41.089995 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:41.089995 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:41.089995 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:41.089995 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:41.089995 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:41.091028 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:41.091028 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:41.091028 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:41.091028 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:41.091028 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:41.091028 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:41.091028 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 02 03:17:41.091028 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 02 03:17:41.091028 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 02 03:17:41.091028 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 02 03:17:41.091028 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:41.091028 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:41.091028 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:41.091028 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:41.091028 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:41.091028 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:41.091928 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:41.091928 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:41.091928 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:41.091928 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:41.091928 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:41.091928 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:41.091928 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:41.091928 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:41.091928 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:41.091928 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:41.091928 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 02 03:17:41.091928 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 03:17:41.091928 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 02 03:17:41.091928 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:41.094480 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 489/958] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Jul 2 03:17:40 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:41.100568 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1d253-9c59-4596-aecd-84a8d914b4ae None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:41.153359 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:41.206911 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1d253-9c59-4596-aecd-84a8d914b4ae None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:41.246755 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d1c349-76a7-4109-a7d4-d8ac8c4399e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:41.247871 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1c349-76a7-4109-a7d4-d8ac8c4399e3 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:41.248349 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1c349-76a7-4109-a7d4-d8ac8c4399e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:41.248828 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1c349-76a7-4109-a7d4-d8ac8c4399e3 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:41.249746 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d1c349-76a7-4109-a7d4-d8ac8c4399e3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:41.250251 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d1c349-76a7-4109-a7d4-d8ac8c4399e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:41.251869 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d1c349-76a7-4109-a7d4-d8ac8c4399e3 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:41.261504 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 470/959] 10.222.0.60 () {56 vars in 1112 bytes} [Sat Jul 2 03:17:41 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:41.263466 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1ffb03-8ef8-4cbd-8ebb-9d3ee0a6d2a1 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:41.314244 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:41.370066 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1ffb03-8ef8-4cbd-8ebb-9d3ee0a6d2a1 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:41.404932 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52508930-c4af-4af9-81c5-7ce4455bfdb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:41.405594 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52508930-c4af-4af9-81c5-7ce4455bfdb3 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:41.405871 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52508930-c4af-4af9-81c5-7ce4455bfdb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:41.406139 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52508930-c4af-4af9-81c5-7ce4455bfdb3 None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:41.406847 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52508930-c4af-4af9-81c5-7ce4455bfdb3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:41.407162 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52508930-c4af-4af9-81c5-7ce4455bfdb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:41.408659 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52508930-c4af-4af9-81c5-7ce4455bfdb3 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:41.414101 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 490/960] 10.222.0.60 () {56 vars in 1112 bytes} [Sat Jul 2 03:17:41 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:41.534559 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e00dff-5794-46a6-995f-ccd71a0fae77 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:41.534900 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e00dff-5794-46a6-995f-ccd71a0fae77 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:41.535150 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e00dff-5794-46a6-995f-ccd71a0fae77 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:41.536843 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 471/961] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:17:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:17:41.542986 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff99d1ef-139e-4155-9e3e-cba8b2f2809a None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:41.543327 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff99d1ef-139e-4155-9e3e-cba8b2f2809a None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:41.543589 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff99d1ef-139e-4155-9e3e-cba8b2f2809a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:41.561750 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-ff99d1ef-139e-4155-9e3e-cba8b2f2809a None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:17:41.563309 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-ff99d1ef-139e-4155-9e3e-cba8b2f2809a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:17:41.633534 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 491/962] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:17:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 03:17:41.657405 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e00dff-5794-46a6-995f-ccd71a0fae77 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:41.662456 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d91003-8a2c-4ac2-b80c-f88f532b4b6f None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:41.662999 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d91003-8a2c-4ac2-b80c-f88f532b4b6f None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:41.663532 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d91003-8a2c-4ac2-b80c-f88f532b4b6f None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:41.665810 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 492/963] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:17:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 03:17:41.672184 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddcc99f-b946-4404-be50-e4ba6b58adfc None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:41.672740 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddcc99f-b946-4404-be50-e4ba6b58adfc None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:41.673916 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddcc99f-b946-4404-be50-e4ba6b58adfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:41.691902 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-8ddcc99f-b946-4404-be50-e4ba6b58adfc None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:17:41.693522 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-8ddcc99f-b946-4404-be50-e4ba6b58adfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:17:41.738079 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:41.773053 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e00dff-5794-46a6-995f-ccd71a0fae77 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:41.791219 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 493/964] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:17:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 03:17:41.795111 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:41.810298 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddcc99f-b946-4404-be50-e4ba6b58adfc None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:41.816870 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59553408-20e6-43d5-ae89-f6cf18826f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:41.817701 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59553408-20e6-43d5-ae89-f6cf18826f53 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:41.817981 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59553408-20e6-43d5-ae89-f6cf18826f53 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:41.818254 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59553408-20e6-43d5-ae89-f6cf18826f53 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:41.829142 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59553408-20e6-43d5-ae89-f6cf18826f53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:17:41.837423 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-59553408-20e6-43d5-ae89-f6cf18826f53 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 02 03:17:41.837423 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:41.837423 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:41.837423 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:41.837423 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:41.837423 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:41.837423 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:41.837423 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:41.837423 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:41.837423 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:41.837423 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:41.837423 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:41.837423 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:17:41.837423 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:17:41.837423 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:17:41.837423 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:17:41.838393 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:17:41.838393 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:17:41.838393 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:17:41.838393 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:17:41.838393 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:41.838393 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:41.838393 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:41.838393 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:41.838393 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:41.838393 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:41.838393 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:41.838393 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:41.838393 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:41.838393 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:41.838393 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:41.838393 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:41.839682 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:41.839682 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:41.839682 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:41.839682 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:41.839682 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:17:41.839682 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:17:41.839682 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:17:41.839682 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:17:41.839682 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:17:41.839682 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:17:41.839682 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 02 03:17:41.839682 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:41.839682 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 472/965] 10.222.0.60 () {56 vars in 1120 bytes} [Sat Jul 2 03:17:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:41.844698 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59553408-20e6-43d5-ae89-f6cf18826f53 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:41.920415 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddcc99f-b946-4404-be50-e4ba6b58adfc None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:41.948980 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59553408-20e6-43d5-ae89-f6cf18826f53 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:41.957260 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1351fcca-a865-4305-a08c-a7eb37b5db21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:41.958351 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351fcca-a865-4305-a08c-a7eb37b5db21 None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:41.958859 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351fcca-a865-4305-a08c-a7eb37b5db21 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:41.959405 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351fcca-a865-4305-a08c-a7eb37b5db21 None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:41.960356 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1351fcca-a865-4305-a08c-a7eb37b5db21 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:41.962315 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1351fcca-a865-4305-a08c-a7eb37b5db21 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:41.977762 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.sql.core [None req-1351fcca-a865-4305-a08c-a7eb37b5db21 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 02 03:17:41.977762 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 02 03:17:41.977762 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [parameters: {'user_id': 'd6e0926c5dbd4f00a9ddb05637a0b59b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 02 03:17:41.977762 dv-cinder-846842-9-smb devstack@keystone.service[80233]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80233) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 02 03:17:41.986476 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-1351fcca-a865-4305-a08c-a7eb37b5db21 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 02 03:17:41.986476 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:41.986476 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 02 03:17:41.986476 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 02 03:17:41.986476 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 02 03:17:41.986476 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 02 03:17:41.986476 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 02 03:17:41.986476 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application result = self._query(query) Jul 02 03:17:41.986476 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 02 03:17:41.986476 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application conn.query(q) Jul 02 03:17:41.986476 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 02 03:17:41.986476 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 02 03:17:41.986476 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 02 03:17:41.986476 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application result.read() Jul 02 03:17:41.986476 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 02 03:17:41.987416 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 02 03:17:41.987416 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 02 03:17:41.987416 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 02 03:17:41.987416 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 02 03:17:41.987416 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 02 03:17:41.987416 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 02 03:17:41.987416 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 02 03:17:41.987416 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 02 03:17:41.987416 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:41.987416 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 02 03:17:41.987416 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:41.987416 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:41.987416 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 02 03:17:41.987416 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 02 03:17:41.987416 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 02 03:17:41.987416 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 02 03:17:41.987416 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 02 03:17:41.987416 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application next(self.gen) Jul 02 03:17:41.988410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 02 03:17:41.988410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application yield resource Jul 02 03:17:41.988410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 02 03:17:41.988410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application next(self.gen) Jul 02 03:17:41.988410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 02 03:17:41.988410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self.session.rollback() Jul 02 03:17:41.988410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 02 03:17:41.988410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self.force_reraise() Jul 02 03:17:41.988410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 02 03:17:41.988410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise self.value Jul 02 03:17:41.988410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 02 03:17:41.988410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 02 03:17:41.988410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 02 03:17:41.988410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application session.commit() Jul 02 03:17:41.988410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 02 03:17:41.988410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 02 03:17:41.988410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 02 03:17:41.989327 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._prepare_impl() Jul 02 03:17:41.989327 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 02 03:17:41.989327 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self.session.flush() Jul 02 03:17:41.989327 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 02 03:17:41.989327 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._flush(objects) Jul 02 03:17:41.989327 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 02 03:17:41.989327 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 02 03:17:41.989327 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 02 03:17:41.989327 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application compat.raise_( Jul 02 03:17:41.989327 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 02 03:17:41.989327 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception Jul 02 03:17:41.989327 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 02 03:17:41.989327 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application flush_context.execute() Jul 02 03:17:41.989327 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 02 03:17:41.989327 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rec.execute(self) Jul 02 03:17:41.989327 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 02 03:17:41.989327 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 02 03:17:41.990345 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 02 03:17:41.990345 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 02 03:17:41.990345 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 02 03:17:41.990345 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 02 03:17:41.990345 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 02 03:17:41.990345 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 02 03:17:41.990345 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 02 03:17:41.990345 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 02 03:17:41.990345 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 02 03:17:41.990345 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 02 03:17:41.990345 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 02 03:17:41.990345 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 02 03:17:41.990345 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 02 03:17:41.990345 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 02 03:17:41.990345 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 02 03:17:41.990345 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception Jul 02 03:17:41.992410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 02 03:17:41.992410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 02 03:17:41.992410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 02 03:17:41.992410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 02 03:17:41.992410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 02 03:17:41.992410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application result = self._query(query) Jul 02 03:17:41.992410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 02 03:17:41.992410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application conn.query(q) Jul 02 03:17:41.992410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 02 03:17:41.992410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 02 03:17:41.992410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 02 03:17:41.992410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application result.read() Jul 02 03:17:41.992410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 02 03:17:41.992410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 02 03:17:41.992410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 02 03:17:41.992410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 02 03:17:41.994540 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 02 03:17:41.994540 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 02 03:17:41.994540 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 02 03:17:41.994540 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 02 03:17:41.994540 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 02 03:17:41.994540 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 02 03:17:41.994540 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [parameters: {'user_id': 'd6e0926c5dbd4f00a9ddb05637a0b59b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 02 03:17:41.994540 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 02 03:17:41.994540 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:41.994540 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 03:17:41.994540 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:41.994540 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:41.994540 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:41.994540 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:41.994540 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:41.996584 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:41.996584 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:41.996584 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:41.996584 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:41.996584 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:41.996584 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:41.996584 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:41.996584 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 02 03:17:41.996584 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 02 03:17:41.996584 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:41.996584 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:41.996584 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 03:17:41.996584 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 03:17:41.996584 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 03:17:41.996584 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 03:17:41.996584 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 02 03:17:41.996584 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 02 03:17:41.998791 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 02 03:17:41.998791 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 02 03:17:41.998791 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 02 03:17:41.998791 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 02 03:17:41.998791 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 02 03:17:41.998791 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:42.000593 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815ad06-53d0-4064-9052-341536abf4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:42.000593 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815ad06-53d0-4064-9052-341536abf4c0 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:42.000593 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815ad06-53d0-4064-9052-341536abf4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:42.000593 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815ad06-53d0-4064-9052-341536abf4c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:42.001237 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a815ad06-53d0-4064-9052-341536abf4c0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:42.001237 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a815ad06-53d0-4064-9052-341536abf4c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:42.001237 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a815ad06-53d0-4064-9052-341536abf4c0 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:42.007443 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 473/967] 10.222.0.60 () {56 vars in 1115 bytes} [Sat Jul 2 03:17:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:17:42.007443 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815ad06-53d0-4064-9052-341536abf4c0 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:42.008004 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 494/967] 10.222.0.60 () {60 vars in 1131 bytes} [Sat Jul 2 03:17:41 2022] POST /identity/v3/users => generated 160 bytes in 194 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 02 03:17:42.009696 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1351fcca-a865-4305-a08c-a7eb37b5db21 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:42.040806 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:42.044720 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:42.114611 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815ad06-53d0-4064-9052-341536abf4c0 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:42.121481 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1351fcca-a865-4305-a08c-a7eb37b5db21 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:42.150712 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0059af-df04-4b0b-a920-9ddacb79b4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:42.151613 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0059af-df04-4b0b-a920-9ddacb79b4e5 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:42.151877 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0059af-df04-4b0b-a920-9ddacb79b4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:42.152170 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0059af-df04-4b0b-a920-9ddacb79b4e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:42.159262 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3fe15a-f3b6-4462-9c29-a5a6d1835d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:42.160351 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fe15a-f3b6-4462-9c29-a5a6d1835d08 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:42.160843 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fe15a-f3b6-4462-9c29-a5a6d1835d08 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:42.161314 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fe15a-f3b6-4462-9c29-a5a6d1835d08 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:42.162977 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0059af-df04-4b0b-a920-9ddacb79b4e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:42.165418 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0059af-df04-4b0b-a920-9ddacb79b4e5 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:42.170088 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3fe15a-f3b6-4462-9c29-a5a6d1835d08 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:42.172041 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3fe15a-f3b6-4462-9c29-a5a6d1835d08 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:42.186942 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-5b0059af-df04-4b0b-a920-9ddacb79b4e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:42.186942 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:42.186942 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:42.186942 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:42.186942 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:42.186942 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:42.186942 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:42.186942 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:42.186942 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:42.186942 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:42.186942 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:42.186942 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:42.186942 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:17:42.186942 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:17:42.186942 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:17:42.187913 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:17:42.187913 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:42.187913 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:42.187913 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:42.187913 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:42.187913 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:42.187913 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:42.187913 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:42.187913 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:42.187913 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:42.187913 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:42.187913 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:42.187913 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:42.187913 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:42.187913 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:42.187913 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:42.187913 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:42.189208 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:17:42.189208 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:17:42.189208 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:42.189208 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:42.189208 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 474/968] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:17:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:42.189890 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-1c3fe15a-f3b6-4462-9c29-a5a6d1835d08 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 02 03:17:42.189890 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:42.189890 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:42.189890 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:42.189890 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:42.189890 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:42.189890 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:42.189890 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:42.189890 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:42.189890 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:42.189890 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:42.189890 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:42.189890 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 03:17:42.189890 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 03:17:42.189890 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 03:17:42.189890 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 03:17:42.190824 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:42.190824 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:42.190824 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 03:17:42.190824 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 03:17:42.190824 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 03:17:42.190824 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 03:17:42.190824 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:42.190824 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:42.190824 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:42.190824 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:42.190824 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:42.190824 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:42.190824 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:42.190824 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:42.190824 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:42.190824 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:42.190824 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:42.190824 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:42.191818 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:42.191818 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:42.191818 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 03:17:42.191818 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 03:17:42.191818 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 03:17:42.191818 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 03:17:42.191818 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 03:17:42.191818 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 03:17:42.191818 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 02 03:17:42.191818 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:42.192835 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 495/969] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Jul 2 03:17:42 2022] GET /identity/v3/users/cinder => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 03:17:42.193813 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0059af-df04-4b0b-a920-9ddacb79b4e5 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:42.198871 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3fe15a-f3b6-4462-9c29-a5a6d1835d08 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:42.302156 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:42.307294 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:42.319363 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0059af-df04-4b0b-a920-9ddacb79b4e5 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:42.320284 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3fe15a-f3b6-4462-9c29-a5a6d1835d08 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:42.360223 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874c1aa3-1549-422a-8376-0178ea690669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:42.361029 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c1aa3-1549-422a-8376-0178ea690669 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:42.361405 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c1aa3-1549-422a-8376-0178ea690669 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:42.361773 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c1aa3-1549-422a-8376-0178ea690669 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:42.362587 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874c1aa3-1549-422a-8376-0178ea690669 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:42.362826 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b938ba-102d-4fcb-9126-b4cb1f245512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:42.363087 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874c1aa3-1549-422a-8376-0178ea690669 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:42.363852 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b938ba-102d-4fcb-9126-b4cb1f245512 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:42.364276 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b938ba-102d-4fcb-9126-b4cb1f245512 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:42.364705 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b938ba-102d-4fcb-9126-b4cb1f245512 None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:42.364830 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874c1aa3-1549-422a-8376-0178ea690669 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:42.365777 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b938ba-102d-4fcb-9126-b4cb1f245512 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:42.366227 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b938ba-102d-4fcb-9126-b4cb1f245512 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:42.368967 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b938ba-102d-4fcb-9126-b4cb1f245512 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:42.378002 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 475/970] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:17:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:42.383187 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874c1aa3-1549-422a-8376-0178ea690669 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:42.427322 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 496/971] 10.222.0.60 () {56 vars in 1101 bytes} [Sat Jul 2 03:17:42 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:42.505971 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874c1aa3-1549-422a-8376-0178ea690669 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:42.548562 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee21197-3d72-4c9e-bc5b-ed541864856d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:42.549403 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee21197-3d72-4c9e-bc5b-ed541864856d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:42.549681 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee21197-3d72-4c9e-bc5b-ed541864856d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:42.549952 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee21197-3d72-4c9e-bc5b-ed541864856d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:42.558390 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee21197-3d72-4c9e-bc5b-ed541864856d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:42.559909 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee21197-3d72-4c9e-bc5b-ed541864856d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:42.576707 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-bee21197-3d72-4c9e-bc5b-ed541864856d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 02 03:17:42.576707 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:42.576707 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:42.576707 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:42.576707 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:42.576707 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:42.576707 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:42.576707 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:42.576707 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:42.576707 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:42.576707 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:42.576707 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:42.576707 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 03:17:42.576707 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 03:17:42.576707 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 03:17:42.576707 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 03:17:42.577745 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:42.577745 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:42.577745 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 03:17:42.577745 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 03:17:42.577745 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 03:17:42.577745 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 03:17:42.577745 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:42.577745 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:42.577745 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:42.577745 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:42.577745 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:42.577745 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:42.577745 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:42.577745 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:42.577745 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:42.577745 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:42.577745 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:42.577745 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:42.578879 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:42.578879 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:42.578879 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 03:17:42.578879 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 03:17:42.578879 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 03:17:42.578879 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 03:17:42.578879 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 03:17:42.578879 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 03:17:42.578879 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 02 03:17:42.578879 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:42.578879 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 476/972] 10.222.0.60 () {56 vars in 1117 bytes} [Sat Jul 2 03:17:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:42.584054 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b938ba-102d-4fcb-9126-b4cb1f245512 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:42.695463 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b938ba-102d-4fcb-9126-b4cb1f245512 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:42.732491 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74541f67-25d2-46d9-bb43-9625473ee4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:42.733275 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74541f67-25d2-46d9-bb43-9625473ee4a9 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:42.733621 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74541f67-25d2-46d9-bb43-9625473ee4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:42.733975 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74541f67-25d2-46d9-bb43-9625473ee4a9 None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:42.734890 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74541f67-25d2-46d9-bb43-9625473ee4a9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:42.735365 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74541f67-25d2-46d9-bb43-9625473ee4a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:42.736869 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74541f67-25d2-46d9-bb43-9625473ee4a9 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:42.755170 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 497/973] 10.222.0.60 () {56 vars in 1149 bytes} [Sat Jul 2 03:17:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:42.760426 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee21197-3d72-4c9e-bc5b-ed541864856d None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:42.771216 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:42.864092 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee21197-3d72-4c9e-bc5b-ed541864856d None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:42.898750 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba175b0-3a96-435b-bc9c-0311e176e377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:42.899669 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba175b0-3a96-435b-bc9c-0311e176e377 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:42.900067 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba175b0-3a96-435b-bc9c-0311e176e377 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:42.900437 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba175b0-3a96-435b-bc9c-0311e176e377 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:42.921021 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e81a52-4243-4b61-a697-7762ffbc4b5e None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:42.921438 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e81a52-4243-4b61-a697-7762ffbc4b5e None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:42.921805 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e81a52-4243-4b61-a697-7762ffbc4b5e None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:42.923446 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 498/974] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:17:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 03:17:42.928326 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a547040-3bea-423e-985f-e235d31cadc8 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:42.928697 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a547040-3bea-423e-985f-e235d31cadc8 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:42.929087 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a547040-3bea-423e-985f-e235d31cadc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:42.946019 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-4a547040-3bea-423e-985f-e235d31cadc8 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:17:42.947521 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-4a547040-3bea-423e-985f-e235d31cadc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:17:42.949556 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:42.970039 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba175b0-3a96-435b-bc9c-0311e176e377 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:42.971532 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba175b0-3a96-435b-bc9c-0311e176e377 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:42.981482 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:43.019986 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 499/975] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:17:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 03:17:43.042865 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a547040-3bea-423e-985f-e235d31cadc8 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:43.082836 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 477/976] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Jul 2 03:17:42 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 02 03:17:43.088704 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba175b0-3a96-435b-bc9c-0311e176e377 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:43.143828 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a547040-3bea-423e-985f-e235d31cadc8 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:43.181272 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c61dd-0e0a-4bc5-84ed-6496664abbc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:43.182489 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c61dd-0e0a-4bc5-84ed-6496664abbc8 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:43.182947 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c61dd-0e0a-4bc5-84ed-6496664abbc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:43.183422 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c61dd-0e0a-4bc5-84ed-6496664abbc8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:43.184291 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2c61dd-0e0a-4bc5-84ed-6496664abbc8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:43.186007 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2c61dd-0e0a-4bc5-84ed-6496664abbc8 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:43.196534 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba175b0-3a96-435b-bc9c-0311e176e377 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:43.199662 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-2b2c61dd-0e0a-4bc5-84ed-6496664abbc8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 02 03:17:43.199662 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:43.199662 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 02 03:17:43.199662 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 02 03:17:43.199662 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 02 03:17:43.199662 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 02 03:17:43.199662 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 02 03:17:43.199662 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 03:17:43.199662 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 02 03:17:43.199662 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:43.199662 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 03:17:43.199662 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:43.199662 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:43.199662 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:43.199662 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:43.199662 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:43.199662 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:43.200651 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:43.200651 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:43.200651 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:43.200651 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:43.200651 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:43.200651 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:43.200651 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 02 03:17:43.200651 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 02 03:17:43.200651 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 02 03:17:43.200651 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 02 03:17:43.200651 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:43.200651 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:43.200651 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:43.200651 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:43.200651 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:43.200651 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:43.206555 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:43.206555 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:43.206555 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:43.206555 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:43.206555 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:43.206555 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:43.206555 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:43.206555 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:43.206555 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:43.206555 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:43.206555 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 02 03:17:43.206555 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 03:17:43.206555 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 02 03:17:43.206555 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:43.206555 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 500/977] 10.222.0.60 () {56 vars in 1126 bytes} [Sat Jul 2 03:17:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 03:17:43.207782 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c61dd-0e0a-4bc5-84ed-6496664abbc8 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:43.209558 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:43.210300 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:43.237032 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22679989-5c17-4239-b4fc-c5a5bbb812e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:43.237825 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22679989-5c17-4239-b4fc-c5a5bbb812e5 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:43.238107 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22679989-5c17-4239-b4fc-c5a5bbb812e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:43.238379 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22679989-5c17-4239-b4fc-c5a5bbb812e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:43.248638 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22679989-5c17-4239-b4fc-c5a5bbb812e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:43.250074 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22679989-5c17-4239-b4fc-c5a5bbb812e5 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:43.267222 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-22679989-5c17-4239-b4fc-c5a5bbb812e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:43.267222 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:43.267222 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:43.267222 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:43.267222 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:43.267222 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:43.267222 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:43.267222 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:43.267222 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:43.267222 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:43.267222 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:43.267222 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:43.267222 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:17:43.267222 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:17:43.267222 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:17:43.268262 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:17:43.268262 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:43.268262 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:43.268262 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:43.268262 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:43.268262 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:43.268262 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:43.268262 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:43.268262 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:43.268262 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:43.268262 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:43.268262 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:43.268262 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:43.268262 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:43.268262 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:43.268262 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:43.268262 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:43.269302 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:17:43.269302 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:17:43.269302 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:43.269302 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:43.273024 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 478/978] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:17:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 03:17:43.273826 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22679989-5c17-4239-b4fc-c5a5bbb812e5 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:43.317958 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c61dd-0e0a-4bc5-84ed-6496664abbc8 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:43.355537 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc95b68f-7545-4bfa-a228-ff96f6d4772f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:43.356215 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc95b68f-7545-4bfa-a228-ff96f6d4772f None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:43.356511 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc95b68f-7545-4bfa-a228-ff96f6d4772f None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:43.356782 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc95b68f-7545-4bfa-a228-ff96f6d4772f None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:43.357496 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc95b68f-7545-4bfa-a228-ff96f6d4772f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:43.357789 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc95b68f-7545-4bfa-a228-ff96f6d4772f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:43.359260 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc95b68f-7545-4bfa-a228-ff96f6d4772f None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:43.364333 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 501/979] 10.222.0.60 () {56 vars in 1122 bytes} [Sat Jul 2 03:17:43 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:43.370004 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc95b68f-7545-4bfa-a228-ff96f6d4772f None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:43.388812 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22679989-5c17-4239-b4fc-c5a5bbb812e5 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:43.424384 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37b4441-4186-4435-b43d-7d9fb1bf1ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:43.425033 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b4441-4186-4435-b43d-7d9fb1bf1ea3 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:43.425307 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b4441-4186-4435-b43d-7d9fb1bf1ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:43.425576 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b4441-4186-4435-b43d-7d9fb1bf1ea3 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:43.426592 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37b4441-4186-4435-b43d-7d9fb1bf1ea3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:43.426592 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37b4441-4186-4435-b43d-7d9fb1bf1ea3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:43.427976 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37b4441-4186-4435-b43d-7d9fb1bf1ea3 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:43.439437 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:43.440415 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 479/980] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:17:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:43.446048 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37b4441-4186-4435-b43d-7d9fb1bf1ea3 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:43.467972 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:43.481913 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc95b68f-7545-4bfa-a228-ff96f6d4772f None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:43.516421 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2920174f-2787-427e-a0a1-3aed6aff9fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:43.517088 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2920174f-2787-427e-a0a1-3aed6aff9fdc None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:43.517375 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2920174f-2787-427e-a0a1-3aed6aff9fdc None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:43.517655 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2920174f-2787-427e-a0a1-3aed6aff9fdc None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:43.518354 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2920174f-2787-427e-a0a1-3aed6aff9fdc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:43.518679 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2920174f-2787-427e-a0a1-3aed6aff9fdc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:43.520069 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2920174f-2787-427e-a0a1-3aed6aff9fdc None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:43.524921 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 502/981] 10.222.0.60 () {56 vars in 1122 bytes} [Sat Jul 2 03:17:43 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:43.526119 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f9d48-2d95-4c66-af6b-42e54872168e None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:43.526408 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f9d48-2d95-4c66-af6b-42e54872168e None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:43.526682 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f9d48-2d95-4c66-af6b-42e54872168e None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:43.528226 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 503/982] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:17:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:17:43.530529 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f9d48-2d95-4c66-af6b-42e54872168e None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:43.553850 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37b4441-4186-4435-b43d-7d9fb1bf1ea3 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:43.588306 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bbb05c-cdc2-4b77-9757-dc4dabcab9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:43.589103 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bbb05c-cdc2-4b77-9757-dc4dabcab9c7 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:43.589383 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bbb05c-cdc2-4b77-9757-dc4dabcab9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:43.589647 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bbb05c-cdc2-4b77-9757-dc4dabcab9c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:43.596197 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bbb05c-cdc2-4b77-9757-dc4dabcab9c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:43.597654 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bbb05c-cdc2-4b77-9757-dc4dabcab9c7 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:43.613270 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-83bbb05c-cdc2-4b77-9757-dc4dabcab9c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 03:17:43.613270 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:43.613270 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:43.613270 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:43.613270 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:43.613270 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:43.613270 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:43.613270 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:43.613270 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:43.613270 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:43.613270 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:43.613270 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:43.613270 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 03:17:43.613270 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 03:17:43.613270 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 03:17:43.614205 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 03:17:43.614205 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:43.614205 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:43.614205 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:43.614205 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:43.614205 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:43.614205 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:43.614205 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:43.614205 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:43.614205 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:43.614205 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:43.614205 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:43.614205 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:43.614205 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:43.614205 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:43.614205 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:43.614205 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:43.615081 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 03:17:43.615081 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 03:17:43.615081 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 03:17:43.615081 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 03:17:43.615081 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 03:17:43.615081 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 03:17:43.615081 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 03:17:43.615081 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:43.615081 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 480/983] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Jul 2 03:17:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 03:17:43.616073 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3759fb1-2ff9-4c6b-ad06-8a44e74316ff None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:43.616073 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3759fb1-2ff9-4c6b-ad06-8a44e74316ff None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:43.616327 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3759fb1-2ff9-4c6b-ad06-8a44e74316ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:43.631340 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f9d48-2d95-4c66-af6b-42e54872168e None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:43.632239 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-d3759fb1-2ff9-4c6b-ad06-8a44e74316ff None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:17:43.633419 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d3759fb1-2ff9-4c6b-ad06-8a44e74316ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:17:43.659801 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:43.666651 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedd0a5e-fa65-4411-821e-ec911e04af5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:43.667419 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedd0a5e-fa65-4411-821e-ec911e04af5c None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:43.667701 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedd0a5e-fa65-4411-821e-ec911e04af5c None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:43.667972 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedd0a5e-fa65-4411-821e-ec911e04af5c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:43.668778 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedd0a5e-fa65-4411-821e-ec911e04af5c None admin] RBAC: Adding query filter params (interface=admin, service_id=8211932dc8e94c9aa35ed95fcf408c42, region_id=RegionOne) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:43.669087 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedd0a5e-fa65-4411-821e-ec911e04af5c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:43.670455 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedd0a5e-fa65-4411-821e-ec911e04af5c None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:43.675651 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 504/984] 10.222.0.60 () {56 vars in 1249 bytes} [Sat Jul 2 03:17:43 2022] GET /identity/v3/endpoints?service_id=8211932dc8e94c9aa35ed95fcf408c42&interface=admin®ion_id=RegionOne => generated 193 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:17:43.676418 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedd0a5e-fa65-4411-821e-ec911e04af5c None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:43.705139 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 481/985] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:17:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 03:17:43.705986 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3759fb1-2ff9-4c6b-ad06-8a44e74316ff None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:43.721788 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:43.774752 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedd0a5e-fa65-4411-821e-ec911e04af5c None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:43.804929 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3759fb1-2ff9-4c6b-ad06-8a44e74316ff None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:43.810861 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2568708-ee5a-4c54-9199-20503c6e005d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:43.811553 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2568708-ee5a-4c54-9199-20503c6e005d None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:43.811837 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2568708-ee5a-4c54-9199-20503c6e005d None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:43.812113 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2568708-ee5a-4c54-9199-20503c6e005d None admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:43.812909 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2568708-ee5a-4c54-9199-20503c6e005d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:43.813218 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2568708-ee5a-4c54-9199-20503c6e005d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:43.814659 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2568708-ee5a-4c54-9199-20503c6e005d None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:43.826919 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 505/986] 10.222.0.60 () {56 vars in 1148 bytes} [Sat Jul 2 03:17:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:43.827905 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2568708-ee5a-4c54-9199-20503c6e005d None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:43.843792 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d577344-70cb-47a8-ae80-08d52767f714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:43.844464 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d577344-70cb-47a8-ae80-08d52767f714 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:43.844746 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d577344-70cb-47a8-ae80-08d52767f714 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:43.845025 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d577344-70cb-47a8-ae80-08d52767f714 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:43.845711 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d577344-70cb-47a8-ae80-08d52767f714 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:43.847089 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d577344-70cb-47a8-ae80-08d52767f714 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:43.853115 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 482/987] 10.222.0.60 () {56 vars in 1087 bytes} [Sat Jul 2 03:17:43 2022] GET /identity/v3/services => generated 1497 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:17:43.853878 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d577344-70cb-47a8-ae80-08d52767f714 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:43.885985 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:43.938144 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:43.942408 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2568708-ee5a-4c54-9199-20503c6e005d None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:43.969560 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d577344-70cb-47a8-ae80-08d52767f714 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:43.979493 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc91e88-5aad-4e37-b307-c07656d9ffbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:43.980453 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc91e88-5aad-4e37-b307-c07656d9ffbd None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:43.980879 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc91e88-5aad-4e37-b307-c07656d9ffbd None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:43.981294 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc91e88-5aad-4e37-b307-c07656d9ffbd None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:43.982174 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc91e88-5aad-4e37-b307-c07656d9ffbd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:43.983776 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc91e88-5aad-4e37-b307-c07656d9ffbd None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:43.999977 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 506/988] 10.222.0.60 () {60 vars in 1141 bytes} [Sat Jul 2 03:17:43 2022] POST /identity/v3/services => generated 242 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:17:44.015892 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe8ba4-185a-448d-b52d-c13f2eacf8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:44.016581 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe8ba4-185a-448d-b52d-c13f2eacf8d3 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:44.016864 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe8ba4-185a-448d-b52d-c13f2eacf8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:44.017158 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe8ba4-185a-448d-b52d-c13f2eacf8d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:44.018010 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fe8ba4-185a-448d-b52d-c13f2eacf8d3 None admin] RBAC: Adding query filter params (role.id=fae86c59b548423babeca066992cd92d, scope.project.id=e09dc5d9d4904c2b89b0cabed237d55e, user.id=3333e7495b9546d882e2a2211ff8875c) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:44.018320 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fe8ba4-185a-448d-b52d-c13f2eacf8d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:44.019889 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fe8ba4-185a-448d-b52d-c13f2eacf8d3 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:44.027092 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 483/989] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Jul 2 03:17:43 2022] GET /identity/v3/role_assignments?user.id=3333e7495b9546d882e2a2211ff8875c&scope.project.id=e09dc5d9d4904c2b89b0cabed237d55e&role.id=fae86c59b548423babeca066992cd92d => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:45.902492 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c257b025-afcc-40a6-9d5b-659c39c4457f None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:45.903051 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c257b025-afcc-40a6-9d5b-659c39c4457f None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:45.903051 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c257b025-afcc-40a6-9d5b-659c39c4457f None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:45.904442 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 507/990] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:17:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:17:45.910065 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90bfaf-67f1-4598-bb1c-d3a5333ba8fb None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:45.910511 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90bfaf-67f1-4598-bb1c-d3a5333ba8fb None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:45.910585 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90bfaf-67f1-4598-bb1c-d3a5333ba8fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:45.928601 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-1a90bfaf-67f1-4598-bb1c-d3a5333ba8fb None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:17:45.929793 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1a90bfaf-67f1-4598-bb1c-d3a5333ba8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:17:45.999176 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 484/991] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:17:45 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 03:17:46.022617 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c257b025-afcc-40a6-9d5b-659c39c4457f None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:46.057074 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27b96e-6528-4a80-bc97-5d533e3b20cd None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:46.057315 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27b96e-6528-4a80-bc97-5d533e3b20cd None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:46.057590 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27b96e-6528-4a80-bc97-5d533e3b20cd None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:46.059072 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 485/992] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:17:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:17:46.064003 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f370e-d6b9-403f-bcda-b4b18f95794e None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:46.064467 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f370e-d6b9-403f-bcda-b4b18f95794e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:46.064950 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f370e-d6b9-403f-bcda-b4b18f95794e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:46.081673 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-216f370e-d6b9-403f-bcda-b4b18f95794e None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:17:46.082892 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-216f370e-d6b9-403f-bcda-b4b18f95794e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:17:46.130883 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c257b025-afcc-40a6-9d5b-659c39c4457f None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:46.143331 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:46.144534 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:46.152751 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 486/993] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:17:46 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 02 03:17:46.154072 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7a371-602a-4635-8363-4a45535e9eaa None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:46.154335 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7a371-602a-4635-8363-4a45535e9eaa None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:46.154609 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7a371-602a-4635-8363-4a45535e9eaa None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:46.156024 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 487/994] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:17:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:17:46.161193 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84dadf-23bb-4090-b1b2-163115b164dc None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:46.161478 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84dadf-23bb-4090-b1b2-163115b164dc None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:46.161751 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84dadf-23bb-4090-b1b2-163115b164dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:46.168614 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da1d9af-ed7a-4ede-9c53-8400fbf60c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:46.169631 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da1d9af-ed7a-4ede-9c53-8400fbf60c43 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:46.170082 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da1d9af-ed7a-4ede-9c53-8400fbf60c43 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:46.170524 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da1d9af-ed7a-4ede-9c53-8400fbf60c43 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:46.171369 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da1d9af-ed7a-4ede-9c53-8400fbf60c43 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:46.172928 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da1d9af-ed7a-4ede-9c53-8400fbf60c43 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:46.178561 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-dc84dadf-23bb-4090-b1b2-163115b164dc None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:17:46.179773 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-dc84dadf-23bb-4090-b1b2-163115b164dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:17:46.185352 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-3da1d9af-ed7a-4ede-9c53-8400fbf60c43 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 02 03:17:46.185352 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:46.185352 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 02 03:17:46.185352 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 02 03:17:46.185352 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 02 03:17:46.185352 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 02 03:17:46.185352 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 02 03:17:46.185352 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 03:17:46.185352 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 02 03:17:46.185352 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:46.185352 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 03:17:46.185352 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:46.185352 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:46.185352 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:46.185352 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:46.185352 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:46.185352 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:46.186596 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:46.186596 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:46.186596 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:46.186596 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:46.186596 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:46.186596 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:46.186596 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 02 03:17:46.186596 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 02 03:17:46.186596 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 02 03:17:46.186596 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 02 03:17:46.186596 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:46.186596 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:46.186596 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:46.186596 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:46.186596 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:46.186596 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:46.187812 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:46.187812 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:46.187812 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:46.187812 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:46.187812 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:46.187812 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:46.187812 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:46.187812 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:46.187812 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:46.187812 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:46.187812 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 02 03:17:46.187812 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 03:17:46.187812 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 02 03:17:46.187812 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:46.187812 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 508/995] 10.222.0.60 () {56 vars in 1126 bytes} [Sat Jul 2 03:17:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:46.188684 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da1d9af-ed7a-4ede-9c53-8400fbf60c43 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:46.250839 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 488/996] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:17:46 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 02 03:17:46.251706 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc84dadf-23bb-4090-b1b2-163115b164dc None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:46.291597 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da1d9af-ed7a-4ede-9c53-8400fbf60c43 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:46.324723 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ff8e65-4bc9-47e3-ae7c-d4952bfcbae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:46.325601 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff8e65-4bc9-47e3-ae7c-d4952bfcbae4 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:46.325882 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff8e65-4bc9-47e3-ae7c-d4952bfcbae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:46.326155 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff8e65-4bc9-47e3-ae7c-d4952bfcbae4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:46.326781 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ff8e65-4bc9-47e3-ae7c-d4952bfcbae4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:46.328196 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ff8e65-4bc9-47e3-ae7c-d4952bfcbae4 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:46.340121 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-b7ff8e65-4bc9-47e3-ae7c-d4952bfcbae4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 02 03:17:46.340121 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:46.340121 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 02 03:17:46.340121 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 02 03:17:46.340121 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 02 03:17:46.340121 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 02 03:17:46.340121 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 02 03:17:46.340121 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 03:17:46.340121 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 02 03:17:46.340121 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:46.340121 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 03:17:46.340121 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:46.340121 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:46.340121 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:46.340121 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:46.340121 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:46.340121 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:46.341146 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:46.341146 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:46.341146 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:46.341146 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:46.341146 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:46.341146 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:46.341146 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 02 03:17:46.341146 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 02 03:17:46.341146 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 02 03:17:46.341146 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 02 03:17:46.341146 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:46.341146 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:46.341146 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:46.341146 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:46.341146 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:46.341146 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:46.342017 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:46.342017 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:46.342017 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:46.342017 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:46.342017 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:46.342017 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:46.342017 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:46.342017 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:46.342017 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:46.342017 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:46.342017 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 02 03:17:46.342017 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 03:17:46.342017 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 02 03:17:46.342017 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:46.342017 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 509/997] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Jul 2 03:17:46 2022] GET /identity/v3/services/compute => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:46.342812 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ff8e65-4bc9-47e3-ae7c-d4952bfcbae4 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:46.352140 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc84dadf-23bb-4090-b1b2-163115b164dc None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:46.375402 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:46.387821 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03da5dd-cf36-40e6-b5c5-4a593138c546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:46.388495 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03da5dd-cf36-40e6-b5c5-4a593138c546 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:46.388775 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03da5dd-cf36-40e6-b5c5-4a593138c546 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:46.389040 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03da5dd-cf36-40e6-b5c5-4a593138c546 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:46.389744 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03da5dd-cf36-40e6-b5c5-4a593138c546 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:46.390040 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03da5dd-cf36-40e6-b5c5-4a593138c546 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:46.390532 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:46.391538 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03da5dd-cf36-40e6-b5c5-4a593138c546 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:46.396783 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 489/998] 10.222.0.60 () {56 vars in 1122 bytes} [Sat Jul 2 03:17:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:46.402429 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03da5dd-cf36-40e6-b5c5-4a593138c546 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:46.452359 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ff8e65-4bc9-47e3-ae7c-d4952bfcbae4 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:46.485706 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d822c47f-ca14-4a31-90b8-5494cadb4aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:46.486495 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d822c47f-ca14-4a31-90b8-5494cadb4aa0 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:46.486773 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d822c47f-ca14-4a31-90b8-5494cadb4aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:46.487138 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d822c47f-ca14-4a31-90b8-5494cadb4aa0 None admin] PATH_INFO: `/v3/services/image` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:46.488289 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d822c47f-ca14-4a31-90b8-5494cadb4aa0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:46.489807 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d822c47f-ca14-4a31-90b8-5494cadb4aa0 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:46.502177 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-d822c47f-ca14-4a31-90b8-5494cadb4aa0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 02 03:17:46.502177 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:46.502177 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 02 03:17:46.502177 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 02 03:17:46.502177 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 02 03:17:46.502177 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 02 03:17:46.502177 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 02 03:17:46.502177 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 03:17:46.502177 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 02 03:17:46.502177 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:46.502177 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 03:17:46.502177 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:46.502177 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:46.502177 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:46.502177 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:46.502177 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:46.502177 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:46.503223 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:46.503223 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:46.503223 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:46.503223 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:46.503223 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:46.503223 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:46.503223 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 02 03:17:46.503223 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 02 03:17:46.503223 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 02 03:17:46.503223 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 02 03:17:46.503223 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:46.503223 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:46.503223 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:46.503223 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:46.503223 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:46.503223 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:46.504045 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:46.504045 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:46.504045 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:46.504045 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:46.504045 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:46.504045 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:46.504045 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:46.504045 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:46.504045 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:46.504045 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:46.504045 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 02 03:17:46.504045 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 03:17:46.504045 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 02 03:17:46.504045 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:46.504045 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 510/999] 10.222.0.60 () {56 vars in 1105 bytes} [Sat Jul 2 03:17:46 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:46.504833 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03da5dd-cf36-40e6-b5c5-4a593138c546 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:46.504914 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d822c47f-ca14-4a31-90b8-5494cadb4aa0 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:46.540917 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaffb75-d31c-4145-be2f-18ac9511f0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:46.541573 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaffb75-d31c-4145-be2f-18ac9511f0a8 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:46.541848 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaffb75-d31c-4145-be2f-18ac9511f0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:46.542146 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaffb75-d31c-4145-be2f-18ac9511f0a8 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:46.542811 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaffb75-d31c-4145-be2f-18ac9511f0a8 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:46.543106 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaffb75-d31c-4145-be2f-18ac9511f0a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:46.544495 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaffb75-d31c-4145-be2f-18ac9511f0a8 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:46.549131 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 490/1000] 10.222.0.60 () {56 vars in 1112 bytes} [Sat Jul 2 03:17:46 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:46.549906 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaffb75-d31c-4145-be2f-18ac9511f0a8 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:46.604883 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:46.605347 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d822c47f-ca14-4a31-90b8-5494cadb4aa0 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:46.612154 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:46.640760 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d3202a-a4e3-4348-afea-86d8dc6b8767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:46.641427 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d3202a-a4e3-4348-afea-86d8dc6b8767 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:46.641708 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d3202a-a4e3-4348-afea-86d8dc6b8767 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:46.641978 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d3202a-a4e3-4348-afea-86d8dc6b8767 None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:46.642695 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d3202a-a4e3-4348-afea-86d8dc6b8767 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:46.642998 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d3202a-a4e3-4348-afea-86d8dc6b8767 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:46.644376 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d3202a-a4e3-4348-afea-86d8dc6b8767 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:46.649769 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 511/1001] 10.222.0.60 () {56 vars in 1122 bytes} [Sat Jul 2 03:17:46 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:46.650541 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d3202a-a4e3-4348-afea-86d8dc6b8767 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:46.657628 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaffb75-d31c-4145-be2f-18ac9511f0a8 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:46.693973 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7099f38b-e801-43fa-95ce-669e33674e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:46.694652 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7099f38b-e801-43fa-95ce-669e33674e9a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:46.694922 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7099f38b-e801-43fa-95ce-669e33674e9a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:46.695225 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7099f38b-e801-43fa-95ce-669e33674e9a None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:46.695933 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7099f38b-e801-43fa-95ce-669e33674e9a None admin] RBAC: Adding query filter params (name=image) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:46.696440 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7099f38b-e801-43fa-95ce-669e33674e9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:46.698318 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7099f38b-e801-43fa-95ce-669e33674e9a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:46.703351 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 491/1002] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:17:46 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:46.704033 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7099f38b-e801-43fa-95ce-669e33674e9a None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:46.750561 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d3202a-a4e3-4348-afea-86d8dc6b8767 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:46.784266 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34048f40-278b-40c8-85da-2abec26d8a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:46.784918 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34048f40-278b-40c8-85da-2abec26d8a6b None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:46.785194 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34048f40-278b-40c8-85da-2abec26d8a6b None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:46.785487 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34048f40-278b-40c8-85da-2abec26d8a6b None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:46.786199 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34048f40-278b-40c8-85da-2abec26d8a6b None admin] RBAC: Adding query filter params (type=compute) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:46.786518 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34048f40-278b-40c8-85da-2abec26d8a6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:46.787925 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34048f40-278b-40c8-85da-2abec26d8a6b None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:46.793375 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 512/1003] 10.222.0.60 () {56 vars in 1112 bytes} [Sat Jul 2 03:17:46 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:46.794058 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34048f40-278b-40c8-85da-2abec26d8a6b None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:46.800635 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7099f38b-e801-43fa-95ce-669e33674e9a None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:46.816470 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:46.829927 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:46.835940 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6110aa3c-10f4-4d67-a7b3-e5691bb0b01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:46.836596 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6110aa3c-10f4-4d67-a7b3-e5691bb0b01e None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:46.836876 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6110aa3c-10f4-4d67-a7b3-e5691bb0b01e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:46.837149 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6110aa3c-10f4-4d67-a7b3-e5691bb0b01e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:46.837881 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6110aa3c-10f4-4d67-a7b3-e5691bb0b01e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:46.839286 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6110aa3c-10f4-4d67-a7b3-e5691bb0b01e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:46.855644 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 492/1004] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Jul 2 03:17:46 2022] POST /identity/v3/endpoints => generated 325 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:17:46.856437 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6110aa3c-10f4-4d67-a7b3-e5691bb0b01e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:46.917074 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34048f40-278b-40c8-85da-2abec26d8a6b None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:46.960205 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05700bbf-d1bf-4c40-8074-f3d6f3bc33d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:46.960788 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05700bbf-d1bf-4c40-8074-f3d6f3bc33d0 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:46.961064 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05700bbf-d1bf-4c40-8074-f3d6f3bc33d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:46.961330 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05700bbf-d1bf-4c40-8074-f3d6f3bc33d0 None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:46.962104 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05700bbf-d1bf-4c40-8074-f3d6f3bc33d0 None admin] RBAC: Adding query filter params (type=image) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:46.962391 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05700bbf-d1bf-4c40-8074-f3d6f3bc33d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:46.963791 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05700bbf-d1bf-4c40-8074-f3d6f3bc33d0 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:46.968854 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 513/1005] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:17:46 2022] GET /identity/v3/services?type=image => generated 122 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:46.992119 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6110aa3c-10f4-4d67-a7b3-e5691bb0b01e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:47.033028 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3131796e-7c03-4346-82b8-5a76a3cd7600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:47.033976 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131796e-7c03-4346-82b8-5a76a3cd7600 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:47.034401 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131796e-7c03-4346-82b8-5a76a3cd7600 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:47.034814 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131796e-7c03-4346-82b8-5a76a3cd7600 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:47.035823 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3131796e-7c03-4346-82b8-5a76a3cd7600 None admin] RBAC: Adding query filter params (interface=public, service_id=bcfb1af5c6eb4a7aa0cdd85541dd24ea, region_id=RegionOne) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:47.036311 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3131796e-7c03-4346-82b8-5a76a3cd7600 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:47.037867 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3131796e-7c03-4346-82b8-5a76a3cd7600 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:47.044877 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 493/1006] 10.222.0.60 () {56 vars in 1251 bytes} [Sat Jul 2 03:17:46 2022] GET /identity/v3/endpoints?service_id=bcfb1af5c6eb4a7aa0cdd85541dd24ea&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:47.050445 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05700bbf-d1bf-4c40-8074-f3d6f3bc33d0 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:47.155084 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:47.162325 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05700bbf-d1bf-4c40-8074-f3d6f3bc33d0 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:47.197151 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661ec0c4-7f18-4017-a02d-f879c70c33cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:47.197827 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ec0c4-7f18-4017-a02d-f879c70c33cd None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:47.198108 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ec0c4-7f18-4017-a02d-f879c70c33cd None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:47.198384 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ec0c4-7f18-4017-a02d-f879c70c33cd None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:47.199072 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661ec0c4-7f18-4017-a02d-f879c70c33cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:47.200489 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661ec0c4-7f18-4017-a02d-f879c70c33cd None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:47.207394 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 514/1007] 10.222.0.60 () {56 vars in 1087 bytes} [Sat Jul 2 03:17:47 2022] GET /identity/v3/services => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 03:17:48.899622 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d6e49-2820-456b-bb37-a70a793afd3d None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:48.900208 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d6e49-2820-456b-bb37-a70a793afd3d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:48.900208 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d6e49-2820-456b-bb37-a70a793afd3d None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:48.901519 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 494/1008] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:17:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:17:48.907070 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f279cd-f99e-4517-98e1-e70b3a520b15 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:48.907510 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f279cd-f99e-4517-98e1-e70b3a520b15 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:48.907608 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f279cd-f99e-4517-98e1-e70b3a520b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:48.924957 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-c3f279cd-f99e-4517-98e1-e70b3a520b15 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:17:48.926136 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-c3f279cd-f99e-4517-98e1-e70b3a520b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:17:48.974096 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fae814-4d85-4e1f-856c-37a7b2922b67 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:48.974727 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fae814-4d85-4e1f-856c-37a7b2922b67 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:48.975370 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fae814-4d85-4e1f-856c-37a7b2922b67 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:48.977921 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 495/1009] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:17:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:17:48.982592 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca43c0-71a1-404a-b95a-422419d37668 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:48.982878 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca43c0-71a1-404a-b95a-422419d37668 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:48.983165 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca43c0-71a1-404a-b95a-422419d37668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:48.996052 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 515/1010] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:17:48 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 03:17:49.001133 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-98ca43c0-71a1-404a-b95a-422419d37668 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:17:49.002327 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-98ca43c0-71a1-404a-b95a-422419d37668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:17:49.019012 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f279cd-f99e-4517-98e1-e70b3a520b15 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:49.037681 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:49.077212 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 496/1011] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:17:48 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 02 03:17:49.100451 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca43c0-71a1-404a-b95a-422419d37668 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:49.109125 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:49.122822 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f279cd-f99e-4517-98e1-e70b3a520b15 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:49.158058 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5afe21-966a-41b2-a2a0-04dd3522da98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:49.158771 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5afe21-966a-41b2-a2a0-04dd3522da98 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:49.159045 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5afe21-966a-41b2-a2a0-04dd3522da98 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:49.159341 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5afe21-966a-41b2-a2a0-04dd3522da98 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:49.160507 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5afe21-966a-41b2-a2a0-04dd3522da98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:49.161935 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5afe21-966a-41b2-a2a0-04dd3522da98 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:49.164134 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 516/1012] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:17:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:49.169643 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5afe21-966a-41b2-a2a0-04dd3522da98 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:49.200554 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca43c0-71a1-404a-b95a-422419d37668 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:49.235289 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc7ba29-a9b3-43ac-b1b1-124b2135bce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:49.235959 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7ba29-a9b3-43ac-b1b1-124b2135bce5 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:49.236236 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7ba29-a9b3-43ac-b1b1-124b2135bce5 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:49.236503 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7ba29-a9b3-43ac-b1b1-124b2135bce5 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:49.237237 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc7ba29-a9b3-43ac-b1b1-124b2135bce5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:49.238666 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc7ba29-a9b3-43ac-b1b1-124b2135bce5 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:49.253166 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 497/1013] 10.222.0.60 () {60 vars in 1141 bytes} [Sat Jul 2 03:17:49 2022] POST /identity/v3/services => generated 242 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:17:49.254434 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38313099-edd5-47f7-a33c-df929af1d25d None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:49.254748 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38313099-edd5-47f7-a33c-df929af1d25d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:49.254991 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38313099-edd5-47f7-a33c-df929af1d25d None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:49.259164 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 498/1014] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:17:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:17:49.262371 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc15e8-c990-4b60-8033-ad85a1b98b39 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:49.263091 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc15e8-c990-4b60-8033-ad85a1b98b39 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:49.263552 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc15e8-c990-4b60-8033-ad85a1b98b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:49.274551 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5afe21-966a-41b2-a2a0-04dd3522da98 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:49.284710 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-09fc15e8-c990-4b60-8033-ad85a1b98b39 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:17:49.286313 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-09fc15e8-c990-4b60-8033-ad85a1b98b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:17:49.314922 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:49.320719 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534ab79f-d5f3-42e3-ac58-7316c4c46a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:49.321575 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ab79f-d5f3-42e3-ac58-7316c4c46a6e None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:49.321803 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ab79f-d5f3-42e3-ac58-7316c4c46a6e None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:49.322038 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ab79f-d5f3-42e3-ac58-7316c4c46a6e None admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:49.322758 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534ab79f-d5f3-42e3-ac58-7316c4c46a6e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:49.324292 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534ab79f-d5f3-42e3-ac58-7316c4c46a6e None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:49.363151 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 517/1015] 10.222.0.60 () {60 vars in 1141 bytes} [Sat Jul 2 03:17:49 2022] POST /identity/v3/projects => generated 311 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 03:17:49.383628 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 499/1016] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:17:49 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 03:17:49.396311 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534ab79f-d5f3-42e3-ac58-7316c4c46a6e None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:49.402003 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:49.515689 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534ab79f-d5f3-42e3-ac58-7316c4c46a6e None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:49.554937 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdd622e-b2b0-4a38-86f6-5d75d1f1360b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:49.555853 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd622e-b2b0-4a38-86f6-5d75d1f1360b None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:49.556138 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd622e-b2b0-4a38-86f6-5d75d1f1360b None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:49.556418 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd622e-b2b0-4a38-86f6-5d75d1f1360b None admin] PATH_INFO: `/v3/services/compute` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:49.557091 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdd622e-b2b0-4a38-86f6-5d75d1f1360b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:49.558467 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdd622e-b2b0-4a38-86f6-5d75d1f1360b None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:49.570756 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-3fdd622e-b2b0-4a38-86f6-5d75d1f1360b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 02 03:17:49.570756 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:49.570756 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 02 03:17:49.570756 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 02 03:17:49.570756 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 02 03:17:49.570756 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 02 03:17:49.570756 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 02 03:17:49.570756 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 03:17:49.570756 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 02 03:17:49.570756 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:49.570756 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 03:17:49.570756 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:49.570756 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:49.570756 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:49.570756 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:49.570756 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:49.570756 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:49.572059 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:49.572059 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:49.572059 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:49.572059 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:49.572059 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:49.572059 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:49.572059 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 02 03:17:49.572059 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 02 03:17:49.572059 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 02 03:17:49.572059 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 02 03:17:49.572059 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:49.572059 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:49.572059 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:49.572059 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:49.572059 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:49.572059 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:49.573013 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:49.573013 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:49.573013 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:49.573013 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:49.573013 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:49.573013 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:49.573013 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:49.573013 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:49.573013 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:49.573013 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:49.573013 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 02 03:17:49.573013 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 03:17:49.573013 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 02 03:17:49.573013 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:49.573013 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 518/1017] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Jul 2 03:17:49 2022] GET /identity/v3/services/compute => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:49.578062 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fc15e8-c990-4b60-8033-ad85a1b98b39 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:49.681982 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fc15e8-c990-4b60-8033-ad85a1b98b39 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:49.717767 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9388c1a-4e37-4572-8787-a24464c4f89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:49.718692 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9388c1a-4e37-4572-8787-a24464c4f89d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:49.719176 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9388c1a-4e37-4572-8787-a24464c4f89d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:49.719592 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9388c1a-4e37-4572-8787-a24464c4f89d None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:49.720548 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9388c1a-4e37-4572-8787-a24464c4f89d None admin] RBAC: Adding query filter params (name=compute) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:49.720868 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9388c1a-4e37-4572-8787-a24464c4f89d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:49.722269 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9388c1a-4e37-4572-8787-a24464c4f89d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:49.727956 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 500/1018] 10.222.0.60 () {56 vars in 1112 bytes} [Sat Jul 2 03:17:49 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:49.733481 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdd622e-b2b0-4a38-86f6-5d75d1f1360b None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:49.806292 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:49.842464 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdd622e-b2b0-4a38-86f6-5d75d1f1360b None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:49.878615 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24763c3-a462-48d8-bf44-c28fa8b88ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:49.879306 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24763c3-a462-48d8-bf44-c28fa8b88ed5 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:49.879590 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24763c3-a462-48d8-bf44-c28fa8b88ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:49.879870 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24763c3-a462-48d8-bf44-c28fa8b88ed5 None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:49.880585 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24763c3-a462-48d8-bf44-c28fa8b88ed5 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:49.880890 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24763c3-a462-48d8-bf44-c28fa8b88ed5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:49.882260 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24763c3-a462-48d8-bf44-c28fa8b88ed5 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:49.887683 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 519/1019] 10.222.0.60 () {56 vars in 1112 bytes} [Sat Jul 2 03:17:49 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:49.893534 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9388c1a-4e37-4572-8787-a24464c4f89d None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:49.920386 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:49.997259 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9388c1a-4e37-4572-8787-a24464c4f89d None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:50.031353 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae267f8b-84a3-4b8d-ba71-478c019037e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:50.032019 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae267f8b-84a3-4b8d-ba71-478c019037e5 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:50.032301 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae267f8b-84a3-4b8d-ba71-478c019037e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:50.032575 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae267f8b-84a3-4b8d-ba71-478c019037e5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:50.033333 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae267f8b-84a3-4b8d-ba71-478c019037e5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:50.034715 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae267f8b-84a3-4b8d-ba71-478c019037e5 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:50.055560 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 501/1020] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Jul 2 03:17:49 2022] POST /identity/v3/endpoints => generated 334 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:17:51.311978 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3778f847-6503-49a0-af8c-e74a304a821e None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:51.312533 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3778f847-6503-49a0-af8c-e74a304a821e None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:51.312533 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3778f847-6503-49a0-af8c-e74a304a821e None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:51.314173 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 520/1021] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:17:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:17:51.319722 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b934b2c-6303-47cb-b3f3-3ee7624ff6b5 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:51.320136 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b934b2c-6303-47cb-b3f3-3ee7624ff6b5 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:51.320312 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b934b2c-6303-47cb-b3f3-3ee7624ff6b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:51.337880 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-8b934b2c-6303-47cb-b3f3-3ee7624ff6b5 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:17:51.339091 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8b934b2c-6303-47cb-b3f3-3ee7624ff6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:17:51.421118 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 502/1022] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:17:51 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 03:17:51.429614 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ccdb6-b200-48f2-ad61-104ee6ebe660 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:51.429978 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ccdb6-b200-48f2-ad61-104ee6ebe660 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:51.430214 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ccdb6-b200-48f2-ad61-104ee6ebe660 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:51.435159 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 521/1023] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:17:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:17:51.436957 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a095d8-f09b-44ea-8ce5-7202ad5da4f9 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:51.437246 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a095d8-f09b-44ea-8ce5-7202ad5da4f9 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:51.437523 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a095d8-f09b-44ea-8ce5-7202ad5da4f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:51.443580 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90ccdb6-b200-48f2-ad61-104ee6ebe660 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:51.448845 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:51.455003 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-59a095d8-f09b-44ea-8ce5-7202ad5da4f9 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:17:51.457063 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-59a095d8-f09b-44ea-8ce5-7202ad5da4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:17:51.526258 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 503/1024] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:17:51 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 02 03:17:51.550361 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90ccdb6-b200-48f2-ad61-104ee6ebe660 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:51.551845 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a095d8-f09b-44ea-8ce5-7202ad5da4f9 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:51.581139 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:51.586482 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4d8910-278d-4cdb-a11b-59538b4094f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:51.587319 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4d8910-278d-4cdb-a11b-59538b4094f7 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:51.587600 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4d8910-278d-4cdb-a11b-59538b4094f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:51.588566 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4d8910-278d-4cdb-a11b-59538b4094f7 None admin] PATH_INFO: `/v3/services/image` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:51.588566 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4d8910-278d-4cdb-a11b-59538b4094f7 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:51.589896 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4d8910-278d-4cdb-a11b-59538b4094f7 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:51.601730 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-5b4d8910-278d-4cdb-a11b-59538b4094f7 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 02 03:17:51.601730 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:51.601730 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 02 03:17:51.601730 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 02 03:17:51.601730 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 02 03:17:51.601730 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 02 03:17:51.601730 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 02 03:17:51.601730 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 03:17:51.601730 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 02 03:17:51.601730 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:51.601730 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 03:17:51.601730 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:51.601730 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:51.601730 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:51.601730 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:51.601730 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:51.601730 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:51.602885 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:51.602885 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:51.602885 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:51.602885 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:51.602885 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:51.602885 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:51.602885 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 02 03:17:51.602885 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 02 03:17:51.602885 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 02 03:17:51.602885 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 02 03:17:51.602885 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:51.602885 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:51.602885 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:51.602885 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:51.602885 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:51.602885 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:51.603863 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:51.603863 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:51.603863 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:51.603863 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:51.603863 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:51.603863 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:51.603863 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:51.603863 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:51.603863 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:51.603863 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:51.603863 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 02 03:17:51.603863 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 03:17:51.603863 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 02 03:17:51.603863 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:51.603863 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 522/1025] 10.222.0.60 () {56 vars in 1105 bytes} [Sat Jul 2 03:17:51 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 03:17:51.610587 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4d8910-278d-4cdb-a11b-59538b4094f7 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:51.661900 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a095d8-f09b-44ea-8ce5-7202ad5da4f9 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:51.698325 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bb4cae-e26a-4af7-8b19-b4d960e6310f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:51.699439 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb4cae-e26a-4af7-8b19-b4d960e6310f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:51.699727 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb4cae-e26a-4af7-8b19-b4d960e6310f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:51.699991 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb4cae-e26a-4af7-8b19-b4d960e6310f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:51.701174 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bb4cae-e26a-4af7-8b19-b4d960e6310f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:51.703044 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bb4cae-e26a-4af7-8b19-b4d960e6310f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:51.704795 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 504/1026] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:17:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:17:51.710465 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bb4cae-e26a-4af7-8b19-b4d960e6310f None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:51.713686 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4d8910-278d-4cdb-a11b-59538b4094f7 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:51.715980 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:51.748935 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b21e30c-0759-425c-8b05-97e7b5418865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:51.749604 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b21e30c-0759-425c-8b05-97e7b5418865 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:51.749888 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b21e30c-0759-425c-8b05-97e7b5418865 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:51.750161 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b21e30c-0759-425c-8b05-97e7b5418865 None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:51.750872 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b21e30c-0759-425c-8b05-97e7b5418865 None admin] RBAC: Adding query filter params (name=image) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:51.751205 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b21e30c-0759-425c-8b05-97e7b5418865 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:51.752573 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b21e30c-0759-425c-8b05-97e7b5418865 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:51.757660 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 523/1027] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:17:51 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:51.763224 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b21e30c-0759-425c-8b05-97e7b5418865 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:51.820951 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bb4cae-e26a-4af7-8b19-b4d960e6310f None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:51.825750 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:51.856791 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68831ef6-3334-4a58-bd6f-3a9430e5847f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:51.857391 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68831ef6-3334-4a58-bd6f-3a9430e5847f None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:51.857733 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68831ef6-3334-4a58-bd6f-3a9430e5847f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:51.858012 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68831ef6-3334-4a58-bd6f-3a9430e5847f None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:51.858756 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68831ef6-3334-4a58-bd6f-3a9430e5847f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:51.860237 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68831ef6-3334-4a58-bd6f-3a9430e5847f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:51.875337 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b21e30c-0759-425c-8b05-97e7b5418865 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:51.883085 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 505/1028] 10.222.0.60 () {60 vars in 1132 bytes} [Sat Jul 2 03:17:51 2022] POST /identity/v3/users => generated 285 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 03:17:51.913187 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4258f036-8d99-4f39-b2f5-e587a08eac7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:51.914268 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258f036-8d99-4f39-b2f5-e587a08eac7c None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:51.914612 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258f036-8d99-4f39-b2f5-e587a08eac7c None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:51.914877 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258f036-8d99-4f39-b2f5-e587a08eac7c None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:51.915647 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4258f036-8d99-4f39-b2f5-e587a08eac7c None admin] RBAC: Adding query filter params (type=image) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:51.915959 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4258f036-8d99-4f39-b2f5-e587a08eac7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:51.917424 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4258f036-8d99-4f39-b2f5-e587a08eac7c None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:51.928557 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 524/1029] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:17:51 2022] GET /identity/v3/services?type=image => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:51.929516 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68831ef6-3334-4a58-bd6f-3a9430e5847f None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:51.998079 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:52.048488 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68831ef6-3334-4a58-bd6f-3a9430e5847f None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:52.084354 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfccc2a-8c5a-4d4a-b53e-d57fbf8250b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:52.085027 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfccc2a-8c5a-4d4a-b53e-d57fbf8250b8 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:52.085311 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfccc2a-8c5a-4d4a-b53e-d57fbf8250b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:52.085578 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfccc2a-8c5a-4d4a-b53e-d57fbf8250b8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:52.086379 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfccc2a-8c5a-4d4a-b53e-d57fbf8250b8 None admin] RBAC: Adding query filter params (interface=public, service_id=a170582a16834bf5bbc0332d48f80045, region_id=RegionOne) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:52.086686 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfccc2a-8c5a-4d4a-b53e-d57fbf8250b8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:52.088418 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfccc2a-8c5a-4d4a-b53e-d57fbf8250b8 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:52.095945 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 506/1030] 10.222.0.60 () {56 vars in 1251 bytes} [Sat Jul 2 03:17:51 2022] GET /identity/v3/endpoints?service_id=a170582a16834bf5bbc0332d48f80045&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:17:52.100599 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4258f036-8d99-4f39-b2f5-e587a08eac7c None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:52.173554 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9666d0-976e-496a-812c-1ddb747ac0a1 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:52.173744 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9666d0-976e-496a-812c-1ddb747ac0a1 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:52.173968 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9666d0-976e-496a-812c-1ddb747ac0a1 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:52.175569 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 507/1031] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:17:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 03:17:52.184799 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83e6d9-5e19-47e3-bc20-a29439537580 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:52.185082 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83e6d9-5e19-47e3-bc20-a29439537580 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:52.185348 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83e6d9-5e19-47e3-bc20-a29439537580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:52.202394 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-2d83e6d9-5e19-47e3-bc20-a29439537580 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:17:52.203613 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2d83e6d9-5e19-47e3-bc20-a29439537580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:17:52.210236 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4258f036-8d99-4f39-b2f5-e587a08eac7c None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:52.235305 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:52.250534 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc3f4de-cb28-4186-b909-52bc88073ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:52.251232 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3f4de-cb28-4186-b909-52bc88073ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:52.252052 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3f4de-cb28-4186-b909-52bc88073ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:52.252340 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3f4de-cb28-4186-b909-52bc88073ea5 None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:52.253036 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc3f4de-cb28-4186-b909-52bc88073ea5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:52.254888 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc3f4de-cb28-4186-b909-52bc88073ea5 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:52.263170 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 525/1032] 10.222.0.60 () {56 vars in 1087 bytes} [Sat Jul 2 03:17:52 2022] GET /identity/v3/services => generated 1957 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 03:17:52.280797 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 508/1033] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:17:52 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 02 03:17:52.304845 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc3f4de-cb28-4186-b909-52bc88073ea5 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:52.426393 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc3f4de-cb28-4186-b909-52bc88073ea5 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:52.464740 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4276e0d-06ff-4b04-8572-39e646dfe238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:52.465559 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4276e0d-06ff-4b04-8572-39e646dfe238 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:52.465841 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4276e0d-06ff-4b04-8572-39e646dfe238 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:52.466118 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4276e0d-06ff-4b04-8572-39e646dfe238 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:52.476781 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4276e0d-06ff-4b04-8572-39e646dfe238 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:17:52.484993 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-e4276e0d-06ff-4b04-8572-39e646dfe238 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 02 03:17:52.484993 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:52.484993 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:52.484993 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:52.484993 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:52.484993 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:52.484993 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:52.484993 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:52.484993 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:52.484993 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:52.484993 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:52.484993 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:52.484993 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:17:52.484993 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:17:52.484993 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:17:52.484993 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:17:52.485916 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:17:52.485916 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:17:52.485916 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:17:52.485916 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:17:52.485916 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:52.485916 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:52.485916 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:52.485916 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:52.485916 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:52.485916 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:52.485916 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:52.485916 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:52.485916 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:52.485916 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:52.485916 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:52.485916 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:52.486798 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:52.486798 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:52.486798 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:52.486798 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:52.486798 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:17:52.486798 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:17:52.486798 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:17:52.486798 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:17:52.486798 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:17:52.486798 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:17:52.486798 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 02 03:17:52.486798 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:52.486798 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 526/1034] 10.222.0.60 () {56 vars in 1120 bytes} [Sat Jul 2 03:17:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:52.494043 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d83e6d9-5e19-47e3-bc20-a29439537580 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:52.551933 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:52.598804 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d83e6d9-5e19-47e3-bc20-a29439537580 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:52.633668 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99009b5-5c02-4cd6-8432-a0a84e3700a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:52.634339 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99009b5-5c02-4cd6-8432-a0a84e3700a9 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:52.634621 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99009b5-5c02-4cd6-8432-a0a84e3700a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:52.634896 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99009b5-5c02-4cd6-8432-a0a84e3700a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:52.635690 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99009b5-5c02-4cd6-8432-a0a84e3700a9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:52.635997 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99009b5-5c02-4cd6-8432-a0a84e3700a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:52.637379 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99009b5-5c02-4cd6-8432-a0a84e3700a9 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:52.646185 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 509/1035] 10.222.0.60 () {56 vars in 1115 bytes} [Sat Jul 2 03:17:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:52.651860 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4276e0d-06ff-4b04-8572-39e646dfe238 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:52.706439 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:52.760246 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4276e0d-06ff-4b04-8572-39e646dfe238 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:52.794162 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0a6149-a141-406a-b249-697924b20436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:52.794953 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a6149-a141-406a-b249-697924b20436 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:52.795255 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a6149-a141-406a-b249-697924b20436 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:52.795530 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a6149-a141-406a-b249-697924b20436 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:52.806150 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0a6149-a141-406a-b249-697924b20436 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:52.807623 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0a6149-a141-406a-b249-697924b20436 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:52.824319 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-4c0a6149-a141-406a-b249-697924b20436 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:52.824319 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:52.824319 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:52.824319 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:52.824319 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:52.824319 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:52.824319 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:52.824319 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:52.824319 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:52.824319 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:52.824319 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:52.824319 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:52.824319 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:17:52.824319 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:17:52.824319 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:17:52.825240 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:17:52.825240 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:52.825240 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:52.825240 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:52.825240 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:52.825240 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:52.825240 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:52.825240 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:52.825240 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:52.825240 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:52.825240 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:52.825240 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:52.825240 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:52.825240 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:52.825240 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:52.825240 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:52.825240 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:52.831403 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:17:52.831403 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:17:52.831403 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:52.831403 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:52.831403 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 527/1036] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:17:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:52.833072 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99009b5-5c02-4cd6-8432-a0a84e3700a9 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:52.937906 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99009b5-5c02-4cd6-8432-a0a84e3700a9 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:52.954252 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:52.973538 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8988e3-ba5d-4a1b-88c0-0b5779433010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:52.974127 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8988e3-ba5d-4a1b-88c0-0b5779433010 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:52.974404 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8988e3-ba5d-4a1b-88c0-0b5779433010 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:52.974678 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8988e3-ba5d-4a1b-88c0-0b5779433010 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:52.975433 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8988e3-ba5d-4a1b-88c0-0b5779433010 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:52.975754 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8988e3-ba5d-4a1b-88c0-0b5779433010 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:52.977249 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8988e3-ba5d-4a1b-88c0-0b5779433010 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:52.989230 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 510/1037] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:17:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:52.994772 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0a6149-a141-406a-b249-697924b20436 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:53.094044 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:53.097300 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0a6149-a141-406a-b249-697924b20436 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:53.131784 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a2b46c-1c04-424b-8ff0-ccb6830f68dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:53.132580 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a2b46c-1c04-424b-8ff0-ccb6830f68dd None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:53.132858 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a2b46c-1c04-424b-8ff0-ccb6830f68dd None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:53.133177 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a2b46c-1c04-424b-8ff0-ccb6830f68dd None admin] PATH_INFO: `/v3/users/nova` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:53.140645 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a2b46c-1c04-424b-8ff0-ccb6830f68dd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:53.142063 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a2b46c-1c04-424b-8ff0-ccb6830f68dd None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:53.155858 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-40a2b46c-1c04-424b-8ff0-ccb6830f68dd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 02 03:17:53.155858 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:53.155858 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:53.155858 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:53.155858 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:53.155858 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:53.155858 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:53.155858 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:53.155858 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:53.155858 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:53.155858 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:53.155858 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:53.155858 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 03:17:53.155858 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 03:17:53.155858 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 03:17:53.155858 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 03:17:53.156758 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:53.156758 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:53.156758 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 03:17:53.156758 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 03:17:53.156758 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 03:17:53.156758 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 03:17:53.156758 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:53.156758 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:53.156758 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:53.156758 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:53.156758 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:53.156758 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:53.156758 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:53.156758 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:53.156758 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:53.156758 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:53.156758 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:53.156758 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:53.157687 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:53.157687 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:53.157687 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 03:17:53.157687 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 03:17:53.157687 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 03:17:53.157687 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 03:17:53.157687 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 03:17:53.157687 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 03:17:53.157687 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 02 03:17:53.157687 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:53.158824 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 528/1038] 10.222.0.60 () {56 vars in 1093 bytes} [Sat Jul 2 03:17:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:53.162850 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8988e3-ba5d-4a1b-88c0-0b5779433010 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:53.264906 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8988e3-ba5d-4a1b-88c0-0b5779433010 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:53.298366 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da03b6f-34b1-4729-89c1-d5d26eb7dc07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:53.299039 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da03b6f-34b1-4729-89c1-d5d26eb7dc07 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:53.299352 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da03b6f-34b1-4729-89c1-d5d26eb7dc07 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:53.299607 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da03b6f-34b1-4729-89c1-d5d26eb7dc07 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:53.300436 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da03b6f-34b1-4729-89c1-d5d26eb7dc07 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:53.300739 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da03b6f-34b1-4729-89c1-d5d26eb7dc07 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:53.302294 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da03b6f-34b1-4729-89c1-d5d26eb7dc07 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:53.324141 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 511/1039] 10.222.0.60 () {56 vars in 1133 bytes} [Sat Jul 2 03:17:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:53.325498 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a2b46c-1c04-424b-8ff0-ccb6830f68dd None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:53.442043 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a2b46c-1c04-424b-8ff0-ccb6830f68dd None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:53.477662 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee5a2e-452a-4cd9-9669-eca8217e492a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:53.478312 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee5a2e-452a-4cd9-9669-eca8217e492a None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:53.478590 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee5a2e-452a-4cd9-9669-eca8217e492a None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:53.478862 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee5a2e-452a-4cd9-9669-eca8217e492a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:53.506447 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:53.551109 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aee5a2e-452a-4cd9-9669-eca8217e492a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:53.553547 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aee5a2e-452a-4cd9-9669-eca8217e492a None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:53.654880 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 529/1040] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Jul 2 03:17:53 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 02 03:17:53.660548 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da03b6f-34b1-4729-89c1-d5d26eb7dc07 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:53.695259 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:53.762065 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da03b6f-34b1-4729-89c1-d5d26eb7dc07 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:53.797022 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e136db-6697-413f-a5a3-4476a432d86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:53.797825 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e136db-6697-413f-a5a3-4476a432d86c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:53.798098 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e136db-6697-413f-a5a3-4476a432d86c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:53.798367 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e136db-6697-413f-a5a3-4476a432d86c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:53.808803 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e136db-6697-413f-a5a3-4476a432d86c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:53.810197 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e136db-6697-413f-a5a3-4476a432d86c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:53.827742 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-d1e136db-6697-413f-a5a3-4476a432d86c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:53.827742 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:53.827742 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:53.827742 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:53.827742 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:53.827742 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:53.827742 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:53.827742 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:53.827742 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:53.827742 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:53.827742 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:53.827742 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:53.827742 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:17:53.827742 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:17:53.827742 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:17:53.828674 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:17:53.828674 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:53.828674 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:53.828674 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:53.828674 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:53.828674 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:53.828674 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:53.828674 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:53.828674 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:53.828674 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:53.828674 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:53.828674 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:53.828674 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:53.828674 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:53.828674 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:53.828674 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:53.828674 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:53.829556 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:17:53.829556 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:17:53.829556 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:53.829556 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:53.831505 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 512/1041] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:17:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:53.834783 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee5a2e-452a-4cd9-9669-eca8217e492a None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:53.902217 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:53.946119 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee5a2e-452a-4cd9-9669-eca8217e492a None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:53.962930 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45131c-5fcb-4851-b07a-74c2045629e3 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:53.963245 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45131c-5fcb-4851-b07a-74c2045629e3 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:53.963520 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45131c-5fcb-4851-b07a-74c2045629e3 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:53.965030 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 513/1042] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:17:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:17:53.970494 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93612e-3d75-4436-a9d0-361b6f98d767 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:53.970801 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93612e-3d75-4436-a9d0-361b6f98d767 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:53.971077 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93612e-3d75-4436-a9d0-361b6f98d767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:53.982753 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59caaacc-9a55-4b68-bda7-d74c4ce1b1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:53.983466 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59caaacc-9a55-4b68-bda7-d74c4ce1b1c8 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:53.983737 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59caaacc-9a55-4b68-bda7-d74c4ce1b1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:53.984017 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59caaacc-9a55-4b68-bda7-d74c4ce1b1c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:53.984749 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59caaacc-9a55-4b68-bda7-d74c4ce1b1c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:53.985054 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59caaacc-9a55-4b68-bda7-d74c4ce1b1c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:53.986426 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59caaacc-9a55-4b68-bda7-d74c4ce1b1c8 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:53.988569 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-bf93612e-3d75-4436-a9d0-361b6f98d767 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:17:53.989938 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-bf93612e-3d75-4436-a9d0-361b6f98d767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:17:53.999025 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 530/1043] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:17:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:54.005130 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59caaacc-9a55-4b68-bda7-d74c4ce1b1c8 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:54.066503 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 514/1044] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:17:53 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 02 03:17:54.090431 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf93612e-3d75-4436-a9d0-361b6f98d767 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:54.107906 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:54.112585 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59caaacc-9a55-4b68-bda7-d74c4ce1b1c8 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:54.133956 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:54.148676 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be04c1a8-1869-4e5c-af98-443bca5fa8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:54.149558 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be04c1a8-1869-4e5c-af98-443bca5fa8bc None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:54.149881 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be04c1a8-1869-4e5c-af98-443bca5fa8bc None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:54.150105 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be04c1a8-1869-4e5c-af98-443bca5fa8bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:54.157511 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be04c1a8-1869-4e5c-af98-443bca5fa8bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:54.158959 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be04c1a8-1869-4e5c-af98-443bca5fa8bc None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:54.174490 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-be04c1a8-1869-4e5c-af98-443bca5fa8bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 03:17:54.174490 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:54.174490 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:54.174490 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:54.174490 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:54.174490 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:54.174490 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:54.174490 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:54.174490 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:54.174490 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:54.174490 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:54.174490 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:54.174490 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 03:17:54.174490 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 03:17:54.174490 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 03:17:54.175459 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 03:17:54.175459 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:54.175459 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:54.175459 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:54.175459 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:54.175459 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:54.175459 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:54.175459 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:54.175459 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:54.175459 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:54.175459 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:54.175459 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:54.175459 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:54.175459 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:54.175459 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:54.175459 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:54.175459 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:54.176343 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 03:17:54.176343 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 03:17:54.176343 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 03:17:54.176343 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 03:17:54.176343 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 03:17:54.176343 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 03:17:54.176343 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 03:17:54.176343 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:54.176343 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 531/1045] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Jul 2 03:17:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 03:17:54.181510 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be04c1a8-1869-4e5c-af98-443bca5fa8bc None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:54.198576 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf93612e-3d75-4436-a9d0-361b6f98d767 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:54.234612 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f777c16-6566-4345-b554-1db17ebb0a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:54.235442 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f777c16-6566-4345-b554-1db17ebb0a04 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:54.235768 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f777c16-6566-4345-b554-1db17ebb0a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:54.236006 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f777c16-6566-4345-b554-1db17ebb0a04 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:54.247941 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f777c16-6566-4345-b554-1db17ebb0a04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:17:54.255605 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-6f777c16-6566-4345-b554-1db17ebb0a04 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 03:17:54.255605 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:54.255605 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:54.255605 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:54.255605 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:54.255605 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:54.255605 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:54.255605 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:54.255605 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:54.255605 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:54.255605 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:54.255605 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:54.255605 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:17:54.255605 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:17:54.255605 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:17:54.255605 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:17:54.256541 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:17:54.256541 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:17:54.256541 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:17:54.256541 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:17:54.256541 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:54.256541 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:54.256541 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:54.256541 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:54.256541 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:54.256541 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:54.256541 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:54.256541 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:54.256541 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:54.256541 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:54.256541 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:54.256541 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:54.257395 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:54.257395 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:54.257395 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:54.257395 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:54.257395 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:17:54.257395 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:17:54.257395 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:17:54.257395 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:17:54.257395 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:17:54.257395 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:17:54.257395 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 03:17:54.257395 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:54.257395 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 515/1046] 10.222.0.60 () {56 vars in 1096 bytes} [Sat Jul 2 03:17:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:54.262728 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f777c16-6566-4345-b554-1db17ebb0a04 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:54.296201 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be04c1a8-1869-4e5c-af98-443bca5fa8bc None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:54.332665 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb650b-7ecf-470f-830d-8e4660fa7be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:54.333337 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb650b-7ecf-470f-830d-8e4660fa7be7 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:54.333530 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb650b-7ecf-470f-830d-8e4660fa7be7 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:54.333806 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb650b-7ecf-470f-830d-8e4660fa7be7 None admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:54.334610 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeb650b-7ecf-470f-830d-8e4660fa7be7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:54.334906 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeb650b-7ecf-470f-830d-8e4660fa7be7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:54.336471 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeb650b-7ecf-470f-830d-8e4660fa7be7 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:54.344851 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:54.349892 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 532/1047] 10.222.0.60 () {56 vars in 1148 bytes} [Sat Jul 2 03:17:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:17:54.349892 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406dcb6-37bd-4acd-8430-b074afbaa811 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:54.349892 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406dcb6-37bd-4acd-8430-b074afbaa811 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:54.349892 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406dcb6-37bd-4acd-8430-b074afbaa811 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:54.349892 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 533/1048] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:17:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:17:54.355904 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406dcb6-37bd-4acd-8430-b074afbaa811 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:54.373914 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f777c16-6566-4345-b554-1db17ebb0a04 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:54.399217 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:54.408111 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74752be-46ac-4c79-824b-98ccbc379bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:54.408784 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74752be-46ac-4c79-824b-98ccbc379bb8 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:54.409065 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74752be-46ac-4c79-824b-98ccbc379bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:54.409336 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74752be-46ac-4c79-824b-98ccbc379bb8 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:54.410083 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74752be-46ac-4c79-824b-98ccbc379bb8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:54.410390 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74752be-46ac-4c79-824b-98ccbc379bb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:54.411818 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74752be-46ac-4c79-824b-98ccbc379bb8 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:54.420271 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 516/1049] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Jul 2 03:17:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:17:54.421631 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93868d7e-8358-492d-bccb-082a55825671 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:54.421920 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93868d7e-8358-492d-bccb-082a55825671 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:54.422206 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93868d7e-8358-492d-bccb-082a55825671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:54.437994 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-93868d7e-8358-492d-bccb-082a55825671 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:17:54.439227 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-93868d7e-8358-492d-bccb-082a55825671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:17:54.461041 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406dcb6-37bd-4acd-8430-b074afbaa811 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:54.494437 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b5cb21-aacb-4b31-8304-6fdf0a7a5f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:54.495090 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5cb21-aacb-4b31-8304-6fdf0a7a5f60 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:54.495408 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5cb21-aacb-4b31-8304-6fdf0a7a5f60 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:54.495697 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5cb21-aacb-4b31-8304-6fdf0a7a5f60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:54.496532 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b5cb21-aacb-4b31-8304-6fdf0a7a5f60 None admin] RBAC: Adding query filter params (role.id=fae86c59b548423babeca066992cd92d, scope.project.id=e09dc5d9d4904c2b89b0cabed237d55e, user.id=13530240e2d446b6bf26a431d001362a) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:54.496841 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b5cb21-aacb-4b31-8304-6fdf0a7a5f60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:54.498290 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b5cb21-aacb-4b31-8304-6fdf0a7a5f60 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:54.503722 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 534/1050] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Jul 2 03:17:54 2022] GET /identity/v3/role_assignments?user.id=13530240e2d446b6bf26a431d001362a&scope.project.id=e09dc5d9d4904c2b89b0cabed237d55e&role.id=fae86c59b548423babeca066992cd92d => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:54.505440 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b5cb21-aacb-4b31-8304-6fdf0a7a5f60 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:54.506921 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 517/1051] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:17:54 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 03:17:54.530490 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93868d7e-8358-492d-bccb-082a55825671 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:54.615362 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:54.643340 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b5cb21-aacb-4b31-8304-6fdf0a7a5f60 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:54.646025 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:54.656248 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93868d7e-8358-492d-bccb-082a55825671 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:54.685627 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872bc94-8a4e-4c91-9d66-ca263f038758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:54.686620 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872bc94-8a4e-4c91-9d66-ca263f038758 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:54.686904 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872bc94-8a4e-4c91-9d66-ca263f038758 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:54.687305 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872bc94-8a4e-4c91-9d66-ca263f038758 None admin] PATH_INFO: `/v3/users/5e767065dd2d4661b02d245ca63134b9` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:54.694603 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bdbabf-047f-403e-9a8e-f69e4d10bf44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:54.695888 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bdbabf-047f-403e-9a8e-f69e4d10bf44 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:54.696187 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bdbabf-047f-403e-9a8e-f69e4d10bf44 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:54.696462 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bdbabf-047f-403e-9a8e-f69e4d10bf44 None admin] PATH_INFO: `/v3/services/image` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:54.697130 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bdbabf-047f-403e-9a8e-f69e4d10bf44 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:54.698515 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bdbabf-047f-403e-9a8e-f69e4d10bf44 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:54.701462 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7872bc94-8a4e-4c91-9d66-ca263f038758 None admin] RBAC: Authorizing `identity:get_user(user_id=5e767065dd2d4661b02d245ca63134b9)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:54.702893 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7872bc94-8a4e-4c91-9d66-ca263f038758 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:54.709376 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 535/1052] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Jul 2 03:17:54 2022] GET /identity/v3/users/5e767065dd2d4661b02d245ca63134b9 => generated 285 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:54.710302 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872bc94-8a4e-4c91-9d66-ca263f038758 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:54.710434 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-27bdbabf-047f-403e-9a8e-f69e4d10bf44 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 02 03:17:54.710434 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:54.710434 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 02 03:17:54.710434 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 02 03:17:54.710434 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 02 03:17:54.710434 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 02 03:17:54.710434 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 02 03:17:54.710434 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 03:17:54.710434 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 02 03:17:54.710434 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:54.710434 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 03:17:54.710434 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:54.710434 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:54.710434 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:54.710434 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:54.710434 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:54.710434 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:54.711467 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:54.711467 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:54.711467 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:54.711467 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:54.711467 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:54.711467 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:54.711467 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 02 03:17:54.711467 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 02 03:17:54.711467 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 02 03:17:54.711467 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 02 03:17:54.711467 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:54.711467 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:54.711467 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:54.711467 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:54.711467 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:54.711467 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:54.712329 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:54.712329 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:54.712329 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:54.712329 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:54.712329 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:54.712329 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:54.712329 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:54.712329 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:54.712329 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:54.712329 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:54.712329 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 02 03:17:54.712329 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 03:17:54.712329 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 02 03:17:54.712329 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:54.715291 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 518/1053] 10.222.0.60 () {56 vars in 1105 bytes} [Sat Jul 2 03:17:54 2022] GET /identity/v3/services/image => generated 86 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 03:17:54.717252 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bdbabf-047f-403e-9a8e-f69e4d10bf44 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:54.819064 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872bc94-8a4e-4c91-9d66-ca263f038758 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:54.822206 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bdbabf-047f-403e-9a8e-f69e4d10bf44 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:54.852535 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:54.855780 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb58b35f-aa6f-4816-ba73-904ce871bf88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:54.856517 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb58b35f-aa6f-4816-ba73-904ce871bf88 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:54.856873 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb58b35f-aa6f-4816-ba73-904ce871bf88 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:54.857179 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb58b35f-aa6f-4816-ba73-904ce871bf88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:54.858631 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc7706f-8348-45f0-a496-e60180edc505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:54.859486 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7706f-8348-45f0-a496-e60180edc505 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:54.860026 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7706f-8348-45f0-a496-e60180edc505 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:54.860489 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7706f-8348-45f0-a496-e60180edc505 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:54.861383 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc7706f-8348-45f0-a496-e60180edc505 None admin] RBAC: Adding query filter params (name=image) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:54.861836 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc7706f-8348-45f0-a496-e60180edc505 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:54.863392 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc7706f-8348-45f0-a496-e60180edc505 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:54.868918 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 519/1054] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:17:54 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:17:54.874483 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc7706f-8348-45f0-a496-e60180edc505 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:54.890841 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:54.932096 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb58b35f-aa6f-4816-ba73-904ce871bf88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:54.933549 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb58b35f-aa6f-4816-ba73-904ce871bf88 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:54.981895 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc7706f-8348-45f0-a496-e60180edc505 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:55.016422 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93d376e-2d32-41ec-a137-1e3c6af32dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:55.017076 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d376e-2d32-41ec-a137-1e3c6af32dd9 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:55.017347 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d376e-2d32-41ec-a137-1e3c6af32dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:55.017634 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d376e-2d32-41ec-a137-1e3c6af32dd9 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:55.018326 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93d376e-2d32-41ec-a137-1e3c6af32dd9 None admin] RBAC: Adding query filter params (type=image) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:55.018630 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93d376e-2d32-41ec-a137-1e3c6af32dd9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:55.020052 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93d376e-2d32-41ec-a137-1e3c6af32dd9 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:55.025092 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 520/1055] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:17:54 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:17:55.030728 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93d376e-2d32-41ec-a137-1e3c6af32dd9 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:55.045688 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 536/1056] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Jul 2 03:17:54 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 02 03:17:55.046989 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb58b35f-aa6f-4816-ba73-904ce871bf88 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:55.092953 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:55.109743 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:55.136731 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93d376e-2d32-41ec-a137-1e3c6af32dd9 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:55.151073 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb58b35f-aa6f-4816-ba73-904ce871bf88 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:55.172189 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac967781-aad3-4f07-93de-7c37e8bb57cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:55.173165 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac967781-aad3-4f07-93de-7c37e8bb57cc None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:55.173447 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac967781-aad3-4f07-93de-7c37e8bb57cc None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:55.173727 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac967781-aad3-4f07-93de-7c37e8bb57cc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:55.174470 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac967781-aad3-4f07-93de-7c37e8bb57cc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:55.175888 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac967781-aad3-4f07-93de-7c37e8bb57cc None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:55.186900 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c2534-9b94-45ca-ae92-b39ebddeaf8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:55.187861 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c2534-9b94-45ca-ae92-b39ebddeaf8a None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:55.188140 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c2534-9b94-45ca-ae92-b39ebddeaf8a None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:55.188448 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c2534-9b94-45ca-ae92-b39ebddeaf8a None admin] PATH_INFO: `/v3/projects/3cd89109c1a34a5aa9013c1cd91dd2d1` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:55.189680 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483c2534-9b94-45ca-ae92-b39ebddeaf8a None admin] RBAC: Authorizing `identity:get_project(project_id=3cd89109c1a34a5aa9013c1cd91dd2d1)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:55.191161 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483c2534-9b94-45ca-ae92-b39ebddeaf8a None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:55.198013 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 537/1057] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Jul 2 03:17:55 2022] GET /identity/v3/projects/3cd89109c1a34a5aa9013c1cd91dd2d1 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:55.198158 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 521/1058] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Jul 2 03:17:55 2022] POST /identity/v3/endpoints => generated 327 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 03:17:55.204307 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c2534-9b94-45ca-ae92-b39ebddeaf8a None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:55.315781 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c2534-9b94-45ca-ae92-b39ebddeaf8a None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:55.346824 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:55.360801 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1271f3-c01b-4301-8a8d-7f236be16398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:55.361468 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1271f3-c01b-4301-8a8d-7f236be16398 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:55.361746 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1271f3-c01b-4301-8a8d-7f236be16398 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:55.362016 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1271f3-c01b-4301-8a8d-7f236be16398 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:55.362879 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1271f3-c01b-4301-8a8d-7f236be16398 None admin] RBAC: Adding query filter params (role.id=5dcd130cda6c490595e862dc2348e83d, scope.project.id=3cd89109c1a34a5aa9013c1cd91dd2d1, user.id=5e767065dd2d4661b02d245ca63134b9) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:55.363185 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1271f3-c01b-4301-8a8d-7f236be16398 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:55.364660 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1271f3-c01b-4301-8a8d-7f236be16398 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:55.374928 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 538/1059] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Jul 2 03:17:55 2022] GET /identity/v3/role_assignments?user.id=5e767065dd2d4661b02d245ca63134b9&scope.project.id=3cd89109c1a34a5aa9013c1cd91dd2d1&role.id=5dcd130cda6c490595e862dc2348e83d => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:56.500882 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616d906-b32f-49cc-8d8d-bae1eee4820f None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:56.501406 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616d906-b32f-49cc-8d8d-bae1eee4820f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:56.501482 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616d906-b32f-49cc-8d8d-bae1eee4820f None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:56.502845 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 522/1060] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:17:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:17:56.508252 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ac0bb-129d-4b35-9e80-468f5748c042 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:56.508695 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ac0bb-129d-4b35-9e80-468f5748c042 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:56.508774 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ac0bb-129d-4b35-9e80-468f5748c042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:56.526258 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-895ac0bb-129d-4b35-9e80-468f5748c042 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:17:56.527512 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-895ac0bb-129d-4b35-9e80-468f5748c042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:17:56.604510 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 539/1061] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:17:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 03:17:56.623019 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8616d906-b32f-49cc-8d8d-bae1eee4820f None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:56.731335 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8616d906-b32f-49cc-8d8d-bae1eee4820f None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:56.747708 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:56.768278 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10b8e08-620f-4d8e-83d8-5dfba0fc5278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:56.769097 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b8e08-620f-4d8e-83d8-5dfba0fc5278 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:56.769373 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b8e08-620f-4d8e-83d8-5dfba0fc5278 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:56.769641 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b8e08-620f-4d8e-83d8-5dfba0fc5278 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:56.779849 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10b8e08-620f-4d8e-83d8-5dfba0fc5278 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:17:56.788015 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-f10b8e08-620f-4d8e-83d8-5dfba0fc5278 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 02 03:17:56.788015 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:56.788015 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:56.788015 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:56.788015 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:56.788015 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:56.788015 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:56.788015 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:56.788015 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:56.788015 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:56.788015 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:56.788015 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:56.788015 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:17:56.788015 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:17:56.788015 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:17:56.788015 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:17:56.789471 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:17:56.789471 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:17:56.789471 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:17:56.789471 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:17:56.789471 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:56.789471 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:56.789471 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:56.789471 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:56.789471 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:56.789471 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:56.789471 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:56.789471 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:56.789471 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:56.789471 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:56.789471 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:56.789471 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:56.790299 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:56.790299 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:56.790299 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:56.790299 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:56.790299 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:17:56.790299 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:17:56.790299 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:17:56.790299 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:17:56.790299 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:17:56.790299 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:17:56.790299 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 02 03:17:56.790299 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:56.794971 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 523/1062] 10.222.0.60 () {56 vars in 1120 bytes} [Sat Jul 2 03:17:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:56.795876 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895ac0bb-129d-4b35-9e80-468f5748c042 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:56.897445 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895ac0bb-129d-4b35-9e80-468f5748c042 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:56.918514 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:56.934691 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a70fad-d555-49cd-9c67-d8e36bfe52f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:56.935562 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a70fad-d555-49cd-9c67-d8e36bfe52f4 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:56.935905 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a70fad-d555-49cd-9c67-d8e36bfe52f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:56.936249 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a70fad-d555-49cd-9c67-d8e36bfe52f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:56.937074 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a70fad-d555-49cd-9c67-d8e36bfe52f4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:56.937432 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a70fad-d555-49cd-9c67-d8e36bfe52f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:56.938886 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a70fad-d555-49cd-9c67-d8e36bfe52f4 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:56.948434 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 540/1063] 10.222.0.60 () {56 vars in 1115 bytes} [Sat Jul 2 03:17:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:17:56.954155 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10b8e08-620f-4d8e-83d8-5dfba0fc5278 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:57.057513 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10b8e08-620f-4d8e-83d8-5dfba0fc5278 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:57.091835 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64de5793-b6ce-4417-8528-5e7151d9827b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:57.092635 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de5793-b6ce-4417-8528-5e7151d9827b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:57.092913 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de5793-b6ce-4417-8528-5e7151d9827b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:57.093182 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de5793-b6ce-4417-8528-5e7151d9827b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:57.103975 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64de5793-b6ce-4417-8528-5e7151d9827b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:57.105422 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64de5793-b6ce-4417-8528-5e7151d9827b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:57.122393 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-64de5793-b6ce-4417-8528-5e7151d9827b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:57.122393 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:57.122393 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:57.122393 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:57.122393 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:57.122393 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:57.122393 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:57.122393 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:57.122393 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:57.122393 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:57.122393 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:57.122393 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:57.122393 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:17:57.122393 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:17:57.122393 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:17:57.123338 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:17:57.123338 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:57.123338 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:57.123338 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:57.123338 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:57.123338 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:57.123338 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:57.123338 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:57.123338 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:57.123338 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:57.123338 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:57.123338 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:57.123338 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:57.123338 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:57.123338 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:57.123338 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:57.123338 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:57.124227 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:17:57.124227 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:17:57.124227 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:57.124227 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:57.127449 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 524/1064] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:17:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:57.129422 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a70fad-d555-49cd-9c67-d8e36bfe52f4 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:57.230217 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a70fad-d555-49cd-9c67-d8e36bfe52f4 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:57.264303 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7c9b2e-5246-463d-9843-16ca5406830a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:57.264636 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb938219-8b0f-4b91-a485-ed117c8cd438 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:57.264835 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb938219-8b0f-4b91-a485-ed117c8cd438 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:57.264960 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7c9b2e-5246-463d-9843-16ca5406830a None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:57.265132 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb938219-8b0f-4b91-a485-ed117c8cd438 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:57.265240 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7c9b2e-5246-463d-9843-16ca5406830a None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:57.265478 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7c9b2e-5246-463d-9843-16ca5406830a None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:57.266201 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7c9b2e-5246-463d-9843-16ca5406830a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:57.266623 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 525/1065] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:17:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 03:17:57.266736 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7c9b2e-5246-463d-9843-16ca5406830a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:57.267871 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7c9b2e-5246-463d-9843-16ca5406830a None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:57.271779 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3779b6-64c0-43f5-a443-cc3f399ba8a3 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:57.272054 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3779b6-64c0-43f5-a443-cc3f399ba8a3 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:57.272332 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3779b6-64c0-43f5-a443-cc3f399ba8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:57.280347 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 541/1066] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:17:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:57.285741 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7c9b2e-5246-463d-9843-16ca5406830a None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:57.290759 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-af3779b6-64c0-43f5-a443-cc3f399ba8a3 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:17:57.291975 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-af3779b6-64c0-43f5-a443-cc3f399ba8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:17:57.317274 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:57.334681 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:57.368282 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 526/1067] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:17:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 03:17:57.380705 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010aa46-babe-4efa-a9ff-a85eb470a0d2 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:57.381033 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010aa46-babe-4efa-a9ff-a85eb470a0d2 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:57.381272 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010aa46-babe-4efa-a9ff-a85eb470a0d2 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:57.386620 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 527/1068] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:17:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:17:57.387918 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f8c06-9faa-4f2e-a351-f716db9f023d None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:57.388198 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f8c06-9faa-4f2e-a351-f716db9f023d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:57.388470 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f8c06-9faa-4f2e-a351-f716db9f023d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:57.404888 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7c9b2e-5246-463d-9843-16ca5406830a None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:57.405286 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-b15f8c06-9faa-4f2e-a351-f716db9f023d None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:17:57.406475 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b15f8c06-9faa-4f2e-a351-f716db9f023d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:17:57.441350 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d321d2-76c0-4dd6-bf28-d83b8cbce337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:57.442183 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d321d2-76c0-4dd6-bf28-d83b8cbce337 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:57.442461 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d321d2-76c0-4dd6-bf28-d83b8cbce337 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:57.442730 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d321d2-76c0-4dd6-bf28-d83b8cbce337 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:57.450174 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d321d2-76c0-4dd6-bf28-d83b8cbce337 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:57.451668 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d321d2-76c0-4dd6-bf28-d83b8cbce337 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:57.466579 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-68d321d2-76c0-4dd6-bf28-d83b8cbce337 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 02 03:17:57.466579 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:57.466579 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:57.466579 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:57.466579 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:57.466579 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:57.466579 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:57.466579 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:57.466579 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:57.466579 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:57.466579 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:57.466579 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:57.466579 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 03:17:57.466579 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 03:17:57.466579 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 03:17:57.466579 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 03:17:57.467739 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:57.467739 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:57.467739 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 03:17:57.467739 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 03:17:57.467739 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 03:17:57.467739 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 03:17:57.467739 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:57.467739 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:57.467739 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:57.467739 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:57.467739 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:57.467739 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:57.467739 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:57.467739 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:57.467739 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:57.467739 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:57.467739 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:57.467739 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:57.468693 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:57.468693 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:57.468693 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 03:17:57.468693 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 03:17:57.468693 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 03:17:57.468693 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 03:17:57.468693 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 03:17:57.468693 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 03:17:57.468693 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 02 03:17:57.468693 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:57.468693 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 542/1069] 10.222.0.60 () {56 vars in 1093 bytes} [Sat Jul 2 03:17:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 03:17:57.468693 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d321d2-76c0-4dd6-bf28-d83b8cbce337 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:57.476995 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 528/1070] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:17:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 02 03:17:57.477814 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f8c06-9faa-4f2e-a351-f716db9f023d None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:57.567654 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:57.570090 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d321d2-76c0-4dd6-bf28-d83b8cbce337 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:57.571633 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:57.583527 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f8c06-9faa-4f2e-a351-f716db9f023d None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:57.604525 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179ba806-682e-4d04-9eed-6f9136b40a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:57.605156 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ba806-682e-4d04-9eed-6f9136b40a71 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:57.605435 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ba806-682e-4d04-9eed-6f9136b40a71 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:57.605707 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ba806-682e-4d04-9eed-6f9136b40a71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:57.618451 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a6784-60ec-419c-846b-86d687c872ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:57.619140 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a6784-60ec-419c-846b-86d687c872ff None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:57.619423 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a6784-60ec-419c-846b-86d687c872ff None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:57.619695 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a6784-60ec-419c-846b-86d687c872ff None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:57.620531 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48a6784-60ec-419c-846b-86d687c872ff None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:57.620837 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48a6784-60ec-419c-846b-86d687c872ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:57.622280 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48a6784-60ec-419c-846b-86d687c872ff None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:57.639953 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 529/1071] 10.222.0.60 () {56 vars in 1133 bytes} [Sat Jul 2 03:17:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:57.640717 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a6784-60ec-419c-846b-86d687c872ff None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:57.680842 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179ba806-682e-4d04-9eed-6f9136b40a71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:57.682289 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179ba806-682e-4d04-9eed-6f9136b40a71 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:57.739130 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a6784-60ec-419c-846b-86d687c872ff None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:57.772231 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3892362-5719-4286-82f8-58826a29555f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:57.772994 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3892362-5719-4286-82f8-58826a29555f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:57.773274 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3892362-5719-4286-82f8-58826a29555f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:57.773592 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3892362-5719-4286-82f8-58826a29555f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:57.778655 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 543/1072] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Jul 2 03:17:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 02 03:17:57.779522 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179ba806-682e-4d04-9eed-6f9136b40a71 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:57.781675 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:57.787048 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3892362-5719-4286-82f8-58826a29555f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:17:57.795196 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-e3892362-5719-4286-82f8-58826a29555f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 03:17:57.795196 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:57.795196 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:57.795196 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:57.795196 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:57.795196 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:57.795196 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:57.795196 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:57.795196 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:57.795196 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:57.795196 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:57.795196 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:57.795196 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:17:57.795196 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:17:57.795196 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:17:57.795196 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:17:57.796140 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:17:57.796140 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:17:57.796140 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:17:57.796140 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:17:57.796140 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:57.796140 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:57.796140 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:57.796140 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:57.796140 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:57.796140 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:57.796140 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:57.796140 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:57.796140 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:57.796140 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:57.796140 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:57.796140 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:57.796978 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:57.796978 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:57.796978 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:57.796978 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:57.796978 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:17:57.796978 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:17:57.796978 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:17:57.796978 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:17:57.796978 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:17:57.796978 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:17:57.796978 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 03:17:57.796978 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:57.796978 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 530/1073] 10.222.0.60 () {56 vars in 1096 bytes} [Sat Jul 2 03:17:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:57.797669 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3892362-5719-4286-82f8-58826a29555f None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:57.807575 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:57.883066 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179ba806-682e-4d04-9eed-6f9136b40a71 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:57.898333 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3892362-5719-4286-82f8-58826a29555f None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:57.918481 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8449b688-6b81-454c-b2bd-de35293e911d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:57.919309 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8449b688-6b81-454c-b2bd-de35293e911d None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:57.919595 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8449b688-6b81-454c-b2bd-de35293e911d None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:57.919868 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8449b688-6b81-454c-b2bd-de35293e911d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:57.930605 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8449b688-6b81-454c-b2bd-de35293e911d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:57.931536 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff6924-7f5f-49c8-bd58-dae33fb3f95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:57.932106 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8449b688-6b81-454c-b2bd-de35293e911d None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:57.932327 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff6924-7f5f-49c8-bd58-dae33fb3f95e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:57.932607 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff6924-7f5f-49c8-bd58-dae33fb3f95e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:57.932877 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff6924-7f5f-49c8-bd58-dae33fb3f95e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:57.943404 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ff6924-7f5f-49c8-bd58-dae33fb3f95e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:57.944852 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ff6924-7f5f-49c8-bd58-dae33fb3f95e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:57.949957 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-8449b688-6b81-454c-b2bd-de35293e911d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:57.949957 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:57.949957 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:57.949957 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:57.949957 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:57.949957 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:57.949957 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:57.949957 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:57.949957 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:57.949957 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:57.949957 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:57.949957 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:57.949957 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:17:57.949957 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:17:57.949957 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:17:57.950901 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:17:57.950901 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:57.950901 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:57.950901 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:57.950901 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:57.950901 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:57.950901 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:57.950901 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:57.950901 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:57.950901 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:57.950901 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:57.950901 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:57.950901 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:57.950901 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:57.950901 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:57.950901 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:57.950901 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:57.951826 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:17:57.951826 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:17:57.951826 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:57.951826 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:17:57.951826 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 544/1074] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:17:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:57.952569 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8449b688-6b81-454c-b2bd-de35293e911d None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:57.963063 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-f2ff6924-7f5f-49c8-bd58-dae33fb3f95e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:57.963063 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:57.963063 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:57.963063 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:57.963063 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:57.963063 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:57.963063 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:57.963063 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:57.963063 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:57.963063 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:57.963063 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:57.963063 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:57.963063 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:17:57.963063 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:17:57.963063 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:17:57.963993 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:17:57.963993 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:57.963993 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:57.963993 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:57.963993 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:57.963993 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:57.963993 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:57.963993 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:57.963993 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:57.963993 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:57.963993 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:57.963993 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:57.963993 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:57.963993 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:57.963993 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:57.963993 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:57.963993 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:57.964858 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:17:57.964858 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:17:57.964858 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:17:57.964858 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:57.964858 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 531/1075] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:17:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:57.965142 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff6924-7f5f-49c8-bd58-dae33fb3f95e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:58.008992 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:58.022996 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:58.054017 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8449b688-6b81-454c-b2bd-de35293e911d None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:58.065506 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff6924-7f5f-49c8-bd58-dae33fb3f95e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:58.088454 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d213f700-0361-41dd-bc40-2cff4f26380e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:58.089113 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213f700-0361-41dd-bc40-2cff4f26380e None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:58.089422 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213f700-0361-41dd-bc40-2cff4f26380e None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:58.089720 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213f700-0361-41dd-bc40-2cff4f26380e None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:58.090543 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d213f700-0361-41dd-bc40-2cff4f26380e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:58.090849 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d213f700-0361-41dd-bc40-2cff4f26380e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:58.092351 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d213f700-0361-41dd-bc40-2cff4f26380e None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:58.098838 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d08635f-8fcf-432b-a79b-c489c6300ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:58.099533 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d08635f-8fcf-432b-a79b-c489c6300ee1 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:58.099815 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d08635f-8fcf-432b-a79b-c489c6300ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:58.100090 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d08635f-8fcf-432b-a79b-c489c6300ee1 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:58.100479 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 545/1076] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Jul 2 03:17:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:58.100813 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d08635f-8fcf-432b-a79b-c489c6300ee1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:58.101119 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d08635f-8fcf-432b-a79b-c489c6300ee1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:58.101280 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d213f700-0361-41dd-bc40-2cff4f26380e None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:58.102682 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d08635f-8fcf-432b-a79b-c489c6300ee1 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:58.115035 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 532/1077] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:17:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:58.115930 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d08635f-8fcf-432b-a79b-c489c6300ee1 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:58.208369 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d213f700-0361-41dd-bc40-2cff4f26380e None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:58.218880 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d08635f-8fcf-432b-a79b-c489c6300ee1 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:58.224250 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:58.236053 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:58.244935 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa3947-4886-4cd9-a08a-166b68fe4753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:58.245603 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa3947-4886-4cd9-a08a-166b68fe4753 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:58.245882 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa3947-4886-4cd9-a08a-166b68fe4753 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:58.246160 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa3947-4886-4cd9-a08a-166b68fe4753 None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:58.246888 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaa3947-4886-4cd9-a08a-166b68fe4753 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:58.247218 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaa3947-4886-4cd9-a08a-166b68fe4753 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:58.248589 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaa3947-4886-4cd9-a08a-166b68fe4753 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:58.253517 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb01b3d-46b8-4ce3-b415-394fb0c999eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:58.254387 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb01b3d-46b8-4ce3-b415-394fb0c999eb None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:58.254668 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb01b3d-46b8-4ce3-b415-394fb0c999eb None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:58.254940 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb01b3d-46b8-4ce3-b415-394fb0c999eb None admin] PATH_INFO: `/v3/users/5e767065dd2d4661b02d245ca63134b9` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:58.256148 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb01b3d-46b8-4ce3-b415-394fb0c999eb None admin] RBAC: Authorizing `identity:get_user(user_id=5e767065dd2d4661b02d245ca63134b9)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:58.257577 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb01b3d-46b8-4ce3-b415-394fb0c999eb None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:58.259317 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 533/1078] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Jul 2 03:17:58 2022] GET /identity/v3/users/5e767065dd2d4661b02d245ca63134b9 => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:58.260074 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb01b3d-46b8-4ce3-b415-394fb0c999eb None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:58.268289 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 546/1079] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:17:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:58.268289 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa3947-4886-4cd9-a08a-166b68fe4753 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:58.394586 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa3947-4886-4cd9-a08a-166b68fe4753 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:58.401258 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb01b3d-46b8-4ce3-b415-394fb0c999eb None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:58.448468 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad316b45-0529-47c9-918b-430d283a2513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:58.448687 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c809f6-b6a8-4494-96c3-69584a36e66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:58.449292 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad316b45-0529-47c9-918b-430d283a2513 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:58.449572 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad316b45-0529-47c9-918b-430d283a2513 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:58.450505 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad316b45-0529-47c9-918b-430d283a2513 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:58.450612 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c809f6-b6a8-4494-96c3-69584a36e66d None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:58.450612 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c809f6-b6a8-4494-96c3-69584a36e66d None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:58.450612 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c809f6-b6a8-4494-96c3-69584a36e66d None admin] PATH_INFO: `/v3/projects/3cd89109c1a34a5aa9013c1cd91dd2d1` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:58.451745 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c809f6-b6a8-4494-96c3-69584a36e66d None admin] RBAC: Authorizing `identity:get_project(project_id=3cd89109c1a34a5aa9013c1cd91dd2d1)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:58.453303 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c809f6-b6a8-4494-96c3-69584a36e66d None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:58.455049 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 547/1080] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Jul 2 03:17:58 2022] GET /identity/v3/projects/3cd89109c1a34a5aa9013c1cd91dd2d1 => generated 311 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:17:58.458335 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad316b45-0529-47c9-918b-430d283a2513 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:58.459881 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad316b45-0529-47c9-918b-430d283a2513 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:58.461107 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c809f6-b6a8-4494-96c3-69584a36e66d None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:58.475022 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-ad316b45-0529-47c9-918b-430d283a2513 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 03:17:58.475022 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:17:58.475022 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:17:58.475022 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:17:58.475022 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:17:58.475022 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:17:58.475022 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:17:58.475022 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:17:58.475022 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:17:58.475022 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:17:58.475022 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:17:58.475022 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:17:58.475022 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 03:17:58.475022 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 03:17:58.475022 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 03:17:58.476158 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 03:17:58.476158 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:17:58.476158 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:17:58.476158 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:17:58.476158 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:17:58.476158 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:17:58.476158 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:17:58.476158 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:17:58.476158 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:17:58.476158 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:17:58.476158 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:17:58.476158 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:17:58.476158 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:17:58.476158 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:17:58.476158 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:17:58.476158 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:17:58.476158 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:17:58.477257 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 03:17:58.477257 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 03:17:58.477257 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 03:17:58.477257 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 03:17:58.477257 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 03:17:58.477257 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 03:17:58.477257 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 03:17:58.477257 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:17:58.477257 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 534/1081] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Jul 2 03:17:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:17:58.482714 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad316b45-0529-47c9-918b-430d283a2513 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:58.518395 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:58.539376 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:58.578667 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c809f6-b6a8-4494-96c3-69584a36e66d None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:58.600117 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad316b45-0529-47c9-918b-430d283a2513 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:58.612487 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae1a471-4e7e-47ce-a8f1-bac698524c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:58.613370 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae1a471-4e7e-47ce-a8f1-bac698524c48 None admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:58.613645 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae1a471-4e7e-47ce-a8f1-bac698524c48 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:58.613912 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae1a471-4e7e-47ce-a8f1-bac698524c48 None admin] PATH_INFO: `/v3/projects/3cd89109c1a34a5aa9013c1cd91dd2d1/users/5e767065dd2d4661b02d245ca63134b9/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:58.615844 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae1a471-4e7e-47ce-a8f1-bac698524c48 None admin] RBAC: Authorizing `identity:create_grant(project_id=3cd89109c1a34a5aa9013c1cd91dd2d1, user_id=5e767065dd2d4661b02d245ca63134b9, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:58.617328 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae1a471-4e7e-47ce-a8f1-bac698524c48 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:58.630792 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 548/1082] 10.222.0.60 () {58 vars in 1439 bytes} [Sat Jul 2 03:17:58 2022] PUT /identity/v3/projects/3cd89109c1a34a5aa9013c1cd91dd2d1/users/5e767065dd2d4661b02d245ca63134b9/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:17:58.634191 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd10236d-1889-4add-b6ee-a18bed5e72d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:58.634861 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10236d-1889-4add-b6ee-a18bed5e72d2 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:58.635157 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10236d-1889-4add-b6ee-a18bed5e72d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:58.635430 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10236d-1889-4add-b6ee-a18bed5e72d2 None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:58.636225 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd10236d-1889-4add-b6ee-a18bed5e72d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:17:58.636529 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd10236d-1889-4add-b6ee-a18bed5e72d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:58.637995 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd10236d-1889-4add-b6ee-a18bed5e72d2 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:58.653389 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 535/1083] 10.222.0.60 () {56 vars in 1148 bytes} [Sat Jul 2 03:17:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:17:58.659855 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae1a471-4e7e-47ce-a8f1-bac698524c48 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:17:58.771001 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae1a471-4e7e-47ce-a8f1-bac698524c48 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:17:58.773501 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:17:58.809592 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc5f416-1450-4b39-a810-acc1bf2c3151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:17:58.810493 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5f416-1450-4b39-a810-acc1bf2c3151 None admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:17:58.810780 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5f416-1450-4b39-a810-acc1bf2c3151 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:17:58.811104 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5f416-1450-4b39-a810-acc1bf2c3151 None admin] PATH_INFO: `/v3/projects/e09dc5d9d4904c2b89b0cabed237d55e/users/13530240e2d446b6bf26a431d001362a/roles/fae86c59b548423babeca066992cd92d` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:17:58.813442 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc5f416-1450-4b39-a810-acc1bf2c3151 None admin] RBAC: Authorizing `identity:create_grant(project_id=e09dc5d9d4904c2b89b0cabed237d55e, user_id=13530240e2d446b6bf26a431d001362a, role_id=fae86c59b548423babeca066992cd92d)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:17:58.814889 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc5f416-1450-4b39-a810-acc1bf2c3151 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:17:58.829970 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 549/1084] 10.222.0.60 () {58 vars in 1439 bytes} [Sat Jul 2 03:17:58 2022] PUT /identity/v3/projects/e09dc5d9d4904c2b89b0cabed237d55e/users/13530240e2d446b6bf26a431d001362a/roles/fae86c59b548423babeca066992cd92d => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:18:00.641835 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca9c7d9-73c8-4571-a911-7343cad25306 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:00.642406 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca9c7d9-73c8-4571-a911-7343cad25306 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:00.642406 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca9c7d9-73c8-4571-a911-7343cad25306 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:00.643732 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 536/1085] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:18:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:18:00.649199 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e7ac1-0ea3-4de1-a9df-d851c07d858d None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:00.649586 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e7ac1-0ea3-4de1-a9df-d851c07d858d None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:00.649769 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e7ac1-0ea3-4de1-a9df-d851c07d858d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:00.668009 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-e63e7ac1-0ea3-4de1-a9df-d851c07d858d None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:18:00.669195 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-e63e7ac1-0ea3-4de1-a9df-d851c07d858d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:18:00.740882 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 550/1086] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:18:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 03:18:00.764847 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca9c7d9-73c8-4571-a911-7343cad25306 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:00.836930 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10817fa8-cd6f-487a-adaf-3dbee7cd95bc None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:00.837271 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10817fa8-cd6f-487a-adaf-3dbee7cd95bc None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:00.837472 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10817fa8-cd6f-487a-adaf-3dbee7cd95bc None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:00.838868 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 551/1087] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:18:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 03:18:00.843690 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b76779-cc65-4c8a-8130-bc67e48cc78e None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:00.843946 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b76779-cc65-4c8a-8130-bc67e48cc78e None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:00.844244 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b76779-cc65-4c8a-8130-bc67e48cc78e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:00.861130 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-c4b76779-cc65-4c8a-8130-bc67e48cc78e None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:18:00.862334 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-c4b76779-cc65-4c8a-8130-bc67e48cc78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:18:00.870364 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca9c7d9-73c8-4571-a911-7343cad25306 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:00.877399 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:18:00.904674 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ed0d5-c070-441a-9a6d-0b802599104c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:00.905396 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ed0d5-c070-441a-9a6d-0b802599104c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:00.905695 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ed0d5-c070-441a-9a6d-0b802599104c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:00.905956 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ed0d5-c070-441a-9a6d-0b802599104c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:00.916090 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8ed0d5-c070-441a-9a6d-0b802599104c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:18:00.923645 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-4b8ed0d5-c070-441a-9a6d-0b802599104c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 03:18:00.923645 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:18:00.923645 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:18:00.923645 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:18:00.923645 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:18:00.923645 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:18:00.923645 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:18:00.923645 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:18:00.923645 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:18:00.923645 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:18:00.923645 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:18:00.923645 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:18:00.923645 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:18:00.923645 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:18:00.923645 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:18:00.923645 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:18:00.924618 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:18:00.924618 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:18:00.924618 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:18:00.924618 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:18:00.924618 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:18:00.924618 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:18:00.924618 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:18:00.924618 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:18:00.924618 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:18:00.924618 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:18:00.924618 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:18:00.924618 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:18:00.924618 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:18:00.924618 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:18:00.924618 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:18:00.924618 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:18:00.925447 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:18:00.925447 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:18:00.925447 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:18:00.925447 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:18:00.925447 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:18:00.925447 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:18:00.925447 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:18:00.925447 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:18:00.925447 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:18:00.925447 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:18:00.925447 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 03:18:00.925447 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:18:00.925447 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 537/1088] 10.222.0.60 () {56 vars in 1096 bytes} [Sat Jul 2 03:18:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:18:00.929905 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 552/1089] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:18:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 02 03:18:00.930964 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ed0d5-c070-441a-9a6d-0b802599104c None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:00.953267 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b76779-cc65-4c8a-8130-bc67e48cc78e None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:00.979424 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:18:01.031180 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ed0d5-c070-441a-9a6d-0b802599104c None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:01.055560 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b76779-cc65-4c8a-8130-bc67e48cc78e None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:01.064480 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aefc96-e2e3-44cb-b725-493fae47729d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:01.065147 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aefc96-e2e3-44cb-b725-493fae47729d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:01.065425 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aefc96-e2e3-44cb-b725-493fae47729d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:01.065697 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aefc96-e2e3-44cb-b725-493fae47729d None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:01.066450 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aefc96-e2e3-44cb-b725-493fae47729d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:18:01.066752 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aefc96-e2e3-44cb-b725-493fae47729d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:18:01.068171 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aefc96-e2e3-44cb-b725-493fae47729d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:18:01.076297 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 538/1090] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Jul 2 03:18:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:18:01.081978 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aefc96-e2e3-44cb-b725-493fae47729d None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:01.089272 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6292611a-da99-4b74-b310-1d07407065e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:01.090141 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292611a-da99-4b74-b310-1d07407065e8 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:01.090443 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292611a-da99-4b74-b310-1d07407065e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:01.090753 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292611a-da99-4b74-b310-1d07407065e8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:01.102892 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6292611a-da99-4b74-b310-1d07407065e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:18:01.111098 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-6292611a-da99-4b74-b310-1d07407065e8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 02 03:18:01.111098 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:18:01.111098 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:18:01.111098 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:18:01.111098 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:18:01.111098 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:18:01.111098 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:18:01.111098 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:18:01.111098 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:18:01.111098 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:18:01.111098 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:18:01.111098 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:18:01.111098 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:18:01.111098 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:18:01.111098 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:18:01.111098 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:18:01.112074 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:18:01.112074 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:18:01.112074 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:18:01.112074 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:18:01.112074 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:18:01.112074 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:18:01.112074 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:18:01.112074 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:18:01.112074 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:18:01.112074 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:18:01.112074 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:18:01.112074 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:18:01.112074 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:18:01.112074 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:18:01.112074 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:18:01.112074 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:18:01.112902 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:18:01.112902 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:18:01.112902 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:18:01.112902 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:18:01.112902 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:18:01.112902 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:18:01.112902 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:18:01.112902 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:18:01.112902 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:18:01.112902 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:18:01.112902 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 02 03:18:01.112902 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:18:01.112902 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 553/1091] 10.222.0.60 () {56 vars in 1120 bytes} [Sat Jul 2 03:18:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 03:18:01.114250 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:18:01.118783 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6292611a-da99-4b74-b310-1d07407065e8 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:01.184005 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aefc96-e2e3-44cb-b725-493fae47729d None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:01.202133 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:18:01.216553 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c7f0f1-35ed-4122-a54f-ca12d9c466d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:01.217427 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7f0f1-35ed-4122-a54f-ca12d9c466d7 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:01.217707 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7f0f1-35ed-4122-a54f-ca12d9c466d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:01.217977 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7f0f1-35ed-4122-a54f-ca12d9c466d7 None admin] PATH_INFO: `/v3/users/5e767065dd2d4661b02d245ca63134b9` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:01.218198 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6292611a-da99-4b74-b310-1d07407065e8 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:01.219209 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c7f0f1-35ed-4122-a54f-ca12d9c466d7 None admin] RBAC: Authorizing `identity:get_user(user_id=5e767065dd2d4661b02d245ca63134b9)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:18:01.220636 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c7f0f1-35ed-4122-a54f-ca12d9c466d7 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:18:01.222280 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 539/1092] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Jul 2 03:18:01 2022] GET /identity/v3/users/5e767065dd2d4661b02d245ca63134b9 => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:18:01.228099 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c7f0f1-35ed-4122-a54f-ca12d9c466d7 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:01.251854 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2932e4e2-1699-4942-9af8-6d55f1b1e1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:01.252718 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2932e4e2-1699-4942-9af8-6d55f1b1e1b5 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:01.252997 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2932e4e2-1699-4942-9af8-6d55f1b1e1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:01.253267 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2932e4e2-1699-4942-9af8-6d55f1b1e1b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:01.254015 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2932e4e2-1699-4942-9af8-6d55f1b1e1b5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:18:01.254322 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2932e4e2-1699-4942-9af8-6d55f1b1e1b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:18:01.255731 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2932e4e2-1699-4942-9af8-6d55f1b1e1b5 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:18:01.263642 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 554/1093] 10.222.0.60 () {56 vars in 1115 bytes} [Sat Jul 2 03:18:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:18:01.269124 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2932e4e2-1699-4942-9af8-6d55f1b1e1b5 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:01.320895 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:18:01.327299 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c7f0f1-35ed-4122-a54f-ca12d9c466d7 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:01.361232 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0229d9-4aef-4046-9d18-97afc7130481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:01.361882 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0229d9-4aef-4046-9d18-97afc7130481 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:01.362159 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0229d9-4aef-4046-9d18-97afc7130481 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:01.362429 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0229d9-4aef-4046-9d18-97afc7130481 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:01.378491 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2932e4e2-1699-4942-9af8-6d55f1b1e1b5 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:01.415514 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ece76c-61b4-412a-91b7-28ca682109e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:01.416313 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ece76c-61b4-412a-91b7-28ca682109e8 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:01.416591 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ece76c-61b4-412a-91b7-28ca682109e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:01.416865 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ece76c-61b4-412a-91b7-28ca682109e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:01.427628 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ece76c-61b4-412a-91b7-28ca682109e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:18:01.429118 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ece76c-61b4-412a-91b7-28ca682109e8 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:18:01.432901 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0229d9-4aef-4046-9d18-97afc7130481 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:18:01.434420 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0229d9-4aef-4046-9d18-97afc7130481 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:18:01.435683 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:18:01.447034 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-14ece76c-61b4-412a-91b7-28ca682109e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:18:01.447034 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:18:01.447034 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:18:01.447034 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:18:01.447034 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:18:01.447034 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:18:01.447034 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:18:01.447034 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:18:01.447034 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:18:01.447034 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:18:01.447034 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:18:01.447034 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:18:01.447034 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:18:01.447034 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:18:01.447034 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:18:01.448226 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:18:01.448226 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:18:01.448226 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:18:01.448226 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:18:01.448226 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:18:01.448226 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:18:01.448226 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:18:01.448226 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:18:01.448226 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:18:01.448226 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:18:01.448226 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:18:01.448226 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:18:01.448226 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:18:01.448226 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:18:01.448226 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:18:01.448226 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:18:01.448226 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:18:01.449459 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:18:01.449459 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:18:01.449459 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:18:01.449459 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:18:01.449459 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 555/1094] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:18:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 03:18:01.454048 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ece76c-61b4-412a-91b7-28ca682109e8 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:01.528656 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:18:01.536932 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 540/1095] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Jul 2 03:18:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 02 03:18:01.543219 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0229d9-4aef-4046-9d18-97afc7130481 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:01.556644 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ece76c-61b4-412a-91b7-28ca682109e8 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:01.591410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e38d8a2-0d00-4e28-b7bc-8570ccd3d4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:01.592074 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38d8a2-0d00-4e28-b7bc-8570ccd3d4ba None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:01.592355 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38d8a2-0d00-4e28-b7bc-8570ccd3d4ba None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:01.592626 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38d8a2-0d00-4e28-b7bc-8570ccd3d4ba None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:01.593352 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e38d8a2-0d00-4e28-b7bc-8570ccd3d4ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:18:01.593663 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e38d8a2-0d00-4e28-b7bc-8570ccd3d4ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:18:01.595037 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e38d8a2-0d00-4e28-b7bc-8570ccd3d4ba None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:18:01.607338 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 556/1096] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:18:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:18:01.612995 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e38d8a2-0d00-4e28-b7bc-8570ccd3d4ba None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:01.639651 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0229d9-4aef-4046-9d18-97afc7130481 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:01.670763 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:18:01.674556 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fdf908-66dc-4a8d-9023-80f2b135922c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:01.675437 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fdf908-66dc-4a8d-9023-80f2b135922c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:01.675714 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fdf908-66dc-4a8d-9023-80f2b135922c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:01.675988 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fdf908-66dc-4a8d-9023-80f2b135922c None admin] PATH_INFO: `/v3/projects/3cd89109c1a34a5aa9013c1cd91dd2d1` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:01.677177 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fdf908-66dc-4a8d-9023-80f2b135922c None admin] RBAC: Authorizing `identity:get_project(project_id=3cd89109c1a34a5aa9013c1cd91dd2d1)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:18:01.678621 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fdf908-66dc-4a8d-9023-80f2b135922c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:18:01.680450 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 541/1097] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Jul 2 03:18:01 2022] GET /identity/v3/projects/3cd89109c1a34a5aa9013c1cd91dd2d1 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:18:01.686638 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fdf908-66dc-4a8d-9023-80f2b135922c None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:01.712601 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e38d8a2-0d00-4e28-b7bc-8570ccd3d4ba None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:01.745471 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e2dd1-d305-4945-abc1-35af4d4ee834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:01.746265 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e2dd1-d305-4945-abc1-35af4d4ee834 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:01.746547 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e2dd1-d305-4945-abc1-35af4d4ee834 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:01.746824 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e2dd1-d305-4945-abc1-35af4d4ee834 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:01.747185 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:18:01.754124 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69e2dd1-d305-4945-abc1-35af4d4ee834 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:18:01.755637 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69e2dd1-d305-4945-abc1-35af4d4ee834 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:18:01.770026 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-c69e2dd1-d305-4945-abc1-35af4d4ee834 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 02 03:18:01.770026 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:18:01.770026 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:18:01.770026 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:18:01.770026 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:18:01.770026 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:18:01.770026 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:18:01.770026 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:18:01.770026 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:18:01.770026 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:18:01.770026 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:18:01.770026 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:18:01.770026 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 03:18:01.770026 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 03:18:01.770026 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 03:18:01.770026 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 03:18:01.771041 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:18:01.771041 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:18:01.771041 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 03:18:01.771041 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 03:18:01.771041 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 03:18:01.771041 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 03:18:01.771041 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:18:01.771041 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:18:01.771041 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:18:01.771041 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:18:01.771041 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:18:01.771041 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:18:01.771041 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:18:01.771041 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:18:01.771041 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:18:01.771041 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:18:01.771041 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:18:01.771041 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:18:01.772487 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:18:01.772487 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:18:01.772487 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 03:18:01.772487 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 03:18:01.772487 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 03:18:01.772487 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 03:18:01.772487 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 03:18:01.772487 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 03:18:01.772487 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 02 03:18:01.772487 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:18:01.772487 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 557/1098] 10.222.0.60 () {56 vars in 1093 bytes} [Sat Jul 2 03:18:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:18:01.777046 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e2dd1-d305-4945-abc1-35af4d4ee834 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:01.786736 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fdf908-66dc-4a8d-9023-80f2b135922c None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:01.822192 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ce77d-3efc-4883-b23c-85c3e57dacfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:01.822860 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ce77d-3efc-4883-b23c-85c3e57dacfd None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:01.823150 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ce77d-3efc-4883-b23c-85c3e57dacfd None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:01.823409 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ce77d-3efc-4883-b23c-85c3e57dacfd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:01.824239 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4ce77d-3efc-4883-b23c-85c3e57dacfd None admin] RBAC: Adding query filter params (role.id=5dcd130cda6c490595e862dc2348e83d, scope.project.id=3cd89109c1a34a5aa9013c1cd91dd2d1, user.id=5e767065dd2d4661b02d245ca63134b9) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:18:01.824547 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4ce77d-3efc-4883-b23c-85c3e57dacfd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:18:01.825980 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4ce77d-3efc-4883-b23c-85c3e57dacfd None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:18:01.831829 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 542/1099] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Jul 2 03:18:01 2022] GET /identity/v3/role_assignments?user.id=5e767065dd2d4661b02d245ca63134b9&scope.project.id=3cd89109c1a34a5aa9013c1cd91dd2d1&role.id=5dcd130cda6c490595e862dc2348e83d => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:18:01.878786 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e2dd1-d305-4945-abc1-35af4d4ee834 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:01.900073 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:18:01.920242 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835186d1-cc34-41b5-b341-6d5b1906de8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:01.920928 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835186d1-cc34-41b5-b341-6d5b1906de8d None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:01.921210 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835186d1-cc34-41b5-b341-6d5b1906de8d None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:01.921484 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835186d1-cc34-41b5-b341-6d5b1906de8d None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:01.922328 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835186d1-cc34-41b5-b341-6d5b1906de8d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:18:01.922635 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835186d1-cc34-41b5-b341-6d5b1906de8d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:18:01.924131 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835186d1-cc34-41b5-b341-6d5b1906de8d None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:18:01.944035 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 558/1100] 10.222.0.60 () {56 vars in 1133 bytes} [Sat Jul 2 03:18:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:18:01.950126 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ce77d-3efc-4883-b23c-85c3e57dacfd None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:02.053399 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ce77d-3efc-4883-b23c-85c3e57dacfd None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:02.078196 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:18:02.086875 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c7ca2-75f9-49ca-b334-5102a6d1aa8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:02.087560 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c7ca2-75f9-49ca-b334-5102a6d1aa8e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:02.087837 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c7ca2-75f9-49ca-b334-5102a6d1aa8e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:02.088110 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c7ca2-75f9-49ca-b334-5102a6d1aa8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:02.156555 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0c7ca2-75f9-49ca-b334-5102a6d1aa8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:18:02.158012 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0c7ca2-75f9-49ca-b334-5102a6d1aa8e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:18:02.257184 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 543/1101] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Jul 2 03:18:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 02 03:18:02.263104 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835186d1-cc34-41b5-b341-6d5b1906de8d None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:02.369278 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835186d1-cc34-41b5-b341-6d5b1906de8d None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:02.406819 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5aac03-5f19-44b0-854d-6f56d23c251c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:02.407648 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5aac03-5f19-44b0-854d-6f56d23c251c None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:02.407927 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5aac03-5f19-44b0-854d-6f56d23c251c None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:02.408201 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5aac03-5f19-44b0-854d-6f56d23c251c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:02.419037 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5aac03-5f19-44b0-854d-6f56d23c251c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:18:02.420506 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5aac03-5f19-44b0-854d-6f56d23c251c None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:18:02.438050 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-ff5aac03-5f19-44b0-854d-6f56d23c251c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:18:02.438050 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:18:02.438050 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:18:02.438050 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:18:02.438050 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:18:02.438050 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:18:02.438050 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:18:02.438050 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:18:02.438050 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:18:02.438050 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:18:02.438050 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:18:02.438050 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:18:02.438050 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:18:02.438050 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:18:02.438050 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:18:02.438974 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:18:02.438974 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:18:02.438974 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:18:02.438974 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:18:02.438974 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:18:02.438974 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:18:02.438974 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:18:02.438974 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:18:02.438974 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:18:02.438974 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:18:02.438974 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:18:02.438974 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:18:02.438974 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:18:02.438974 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:18:02.438974 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:18:02.438974 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:18:02.438974 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:18:02.440100 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:18:02.440100 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:18:02.440100 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:18:02.440100 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:18:02.440100 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 559/1102] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:18:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:18:02.445138 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c7ca2-75f9-49ca-b334-5102a6d1aa8e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:02.473154 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:18:02.546392 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c7ca2-75f9-49ca-b334-5102a6d1aa8e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:02.580622 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e4015-257a-4602-b86b-3a869e6f9292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:02.581289 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e4015-257a-4602-b86b-3a869e6f9292 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:02.581564 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e4015-257a-4602-b86b-3a869e6f9292 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:02.581833 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e4015-257a-4602-b86b-3a869e6f9292 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:02.582555 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7e4015-257a-4602-b86b-3a869e6f9292 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:18:02.582856 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7e4015-257a-4602-b86b-3a869e6f9292 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:18:02.584273 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7e4015-257a-4602-b86b-3a869e6f9292 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:18:02.596082 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 544/1103] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:18:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:18:02.601852 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5aac03-5f19-44b0-854d-6f56d23c251c None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:02.631629 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:18:02.706858 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5aac03-5f19-44b0-854d-6f56d23c251c None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:02.740506 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cf0329-9348-44ca-9802-a81973a24a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:02.741295 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cf0329-9348-44ca-9802-a81973a24a36 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:02.741576 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cf0329-9348-44ca-9802-a81973a24a36 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:02.741846 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cf0329-9348-44ca-9802-a81973a24a36 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:02.748902 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cf0329-9348-44ca-9802-a81973a24a36 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:18:02.750343 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cf0329-9348-44ca-9802-a81973a24a36 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:18:02.764245 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-02cf0329-9348-44ca-9802-a81973a24a36 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 03:18:02.764245 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:18:02.764245 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:18:02.764245 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:18:02.764245 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:18:02.764245 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:18:02.764245 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:18:02.764245 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:18:02.764245 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:18:02.764245 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:18:02.764245 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:18:02.764245 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:18:02.764245 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 03:18:02.764245 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 03:18:02.764245 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 03:18:02.765270 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 03:18:02.765270 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:18:02.765270 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:18:02.765270 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:18:02.765270 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:18:02.765270 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:18:02.765270 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:18:02.765270 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:18:02.765270 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:18:02.765270 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:18:02.765270 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:18:02.765270 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:18:02.765270 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:18:02.765270 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:18:02.765270 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:18:02.765270 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:18:02.765270 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:18:02.766619 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 03:18:02.766619 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 03:18:02.766619 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 03:18:02.766619 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 03:18:02.766619 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 03:18:02.766619 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 03:18:02.766619 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 03:18:02.766619 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:18:02.766619 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 560/1104] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Jul 2 03:18:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:18:02.771425 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e4015-257a-4602-b86b-3a869e6f9292 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:02.861044 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:18:02.874251 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e4015-257a-4602-b86b-3a869e6f9292 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:02.908627 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d003ba-d439-46ef-be88-614a2d73d642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:02.909289 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d003ba-d439-46ef-be88-614a2d73d642 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:02.909571 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d003ba-d439-46ef-be88-614a2d73d642 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:02.909844 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d003ba-d439-46ef-be88-614a2d73d642 None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:02.910630 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d003ba-d439-46ef-be88-614a2d73d642 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:18:02.910935 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d003ba-d439-46ef-be88-614a2d73d642 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:18:02.912416 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d003ba-d439-46ef-be88-614a2d73d642 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:18:02.925263 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 545/1105] 10.222.0.60 () {56 vars in 1148 bytes} [Sat Jul 2 03:18:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:18:02.931718 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cf0329-9348-44ca-9802-a81973a24a36 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:03.024938 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:18:03.038206 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cf0329-9348-44ca-9802-a81973a24a36 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:03.072312 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88dddfa-43db-42ad-a9da-98c561c05333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:03.072960 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88dddfa-43db-42ad-a9da-98c561c05333 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:03.073237 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88dddfa-43db-42ad-a9da-98c561c05333 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:03.073506 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88dddfa-43db-42ad-a9da-98c561c05333 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:03.074321 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88dddfa-43db-42ad-a9da-98c561c05333 None admin] RBAC: Adding query filter params (role.id=fae86c59b548423babeca066992cd92d, scope.project.id=e09dc5d9d4904c2b89b0cabed237d55e, user.id=13530240e2d446b6bf26a431d001362a) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:18:03.074628 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88dddfa-43db-42ad-a9da-98c561c05333 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:18:03.076095 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88dddfa-43db-42ad-a9da-98c561c05333 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:18:03.082075 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 561/1106] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Jul 2 03:18:02 2022] GET /identity/v3/role_assignments?user.id=13530240e2d446b6bf26a431d001362a&scope.project.id=e09dc5d9d4904c2b89b0cabed237d55e&role.id=fae86c59b548423babeca066992cd92d => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:18:03.888739 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264f952-fd03-44b2-80d1-ed131519e6fc None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:03.889290 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264f952-fd03-44b2-80d1-ed131519e6fc None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:03.889290 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264f952-fd03-44b2-80d1-ed131519e6fc None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:03.890648 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 546/1107] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:18:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:18:03.896141 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f94c8-b2f7-458d-b0fa-d621c44a53e3 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:03.896612 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f94c8-b2f7-458d-b0fa-d621c44a53e3 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:03.896705 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f94c8-b2f7-458d-b0fa-d621c44a53e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:03.915015 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-416f94c8-b2f7-458d-b0fa-d621c44a53e3 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:18:03.916257 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-416f94c8-b2f7-458d-b0fa-d621c44a53e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:18:03.985710 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 562/1108] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:18:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 03:18:04.013482 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1264f952-fd03-44b2-80d1-ed131519e6fc None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:04.126058 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1264f952-fd03-44b2-80d1-ed131519e6fc None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:04.164824 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f63a37-6110-4f7f-b4b7-cd1a5729c880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:04.165546 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f63a37-6110-4f7f-b4b7-cd1a5729c880 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:04.165825 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f63a37-6110-4f7f-b4b7-cd1a5729c880 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:04.166096 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f63a37-6110-4f7f-b4b7-cd1a5729c880 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:04.167493 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f63a37-6110-4f7f-b4b7-cd1a5729c880 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:18:04.168947 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f63a37-6110-4f7f-b4b7-cd1a5729c880 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:18:04.170578 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 547/1109] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:18:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:18:04.177234 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f94c8-b2f7-458d-b0fa-d621c44a53e3 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:04.277575 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:18:04.297678 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f94c8-b2f7-458d-b0fa-d621c44a53e3 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:04.334375 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b90d650-e750-4949-8c3b-de19442ec43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:04.335023 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b90d650-e750-4949-8c3b-de19442ec43f None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:04.335332 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b90d650-e750-4949-8c3b-de19442ec43f None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:04.335621 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b90d650-e750-4949-8c3b-de19442ec43f None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:04.336329 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b90d650-e750-4949-8c3b-de19442ec43f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:18:04.337747 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b90d650-e750-4949-8c3b-de19442ec43f None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:18:04.359793 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 563/1110] 10.222.0.60 () {60 vars in 1132 bytes} [Sat Jul 2 03:18:04 2022] POST /identity/v3/users => generated 286 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:18:06.423904 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0dae9-2be8-472a-95e4-80412d09383a None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:06.424704 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0dae9-2be8-472a-95e4-80412d09383a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:06.424870 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0dae9-2be8-472a-95e4-80412d09383a None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:06.427034 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 548/1111] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:18:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:18:06.433510 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27810f-6d9f-40ab-b921-d086d7d15bff None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:06.434207 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27810f-6d9f-40ab-b921-d086d7d15bff None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:06.434403 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27810f-6d9f-40ab-b921-d086d7d15bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:06.456600 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-7c27810f-6d9f-40ab-b921-d086d7d15bff None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:18:06.457799 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-7c27810f-6d9f-40ab-b921-d086d7d15bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:18:06.528617 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 564/1112] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:18:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 03:18:06.557088 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d0dae9-2be8-472a-95e4-80412d09383a None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:06.577970 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:18:06.671968 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d0dae9-2be8-472a-95e4-80412d09383a None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:06.719421 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d4ffc0-1c80-483e-b4dc-e2dcb33ebcdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:06.720274 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4ffc0-1c80-483e-b4dc-e2dcb33ebcdd None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:06.720550 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4ffc0-1c80-483e-b4dc-e2dcb33ebcdd None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:06.720818 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4ffc0-1c80-483e-b4dc-e2dcb33ebcdd None admin] PATH_INFO: `/v3/roles/a9792a930e0c4e139f287a712dfc7d4d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:06.722410 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d4ffc0-1c80-483e-b4dc-e2dcb33ebcdd None admin] RBAC: Authorizing `identity:get_role(role_id=a9792a930e0c4e139f287a712dfc7d4d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:18:06.723829 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d4ffc0-1c80-483e-b4dc-e2dcb33ebcdd None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:18:06.725213 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 549/1113] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Jul 2 03:18:06 2022] GET /identity/v3/roles/a9792a930e0c4e139f287a712dfc7d4d => generated 223 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:18:06.731395 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c27810f-6d9f-40ab-b921-d086d7d15bff None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:06.801511 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:18:06.834153 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c27810f-6d9f-40ab-b921-d086d7d15bff None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:06.869049 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3506124-b924-4927-a864-51dbf40f08ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:06.869917 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3506124-b924-4927-a864-51dbf40f08ed None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:06.870198 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3506124-b924-4927-a864-51dbf40f08ed None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:06.870469 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3506124-b924-4927-a864-51dbf40f08ed None admin] PATH_INFO: `/v3/users/2288a03a993e4a90a5db8fa6698f86a1` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:06.884655 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3506124-b924-4927-a864-51dbf40f08ed None admin] RBAC: Authorizing `identity:get_user(user_id=2288a03a993e4a90a5db8fa6698f86a1)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:18:06.886098 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3506124-b924-4927-a864-51dbf40f08ed None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:18:06.887787 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 565/1114] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Jul 2 03:18:06 2022] GET /identity/v3/users/2288a03a993e4a90a5db8fa6698f86a1 => generated 286 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:18:06.894383 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d4ffc0-1c80-483e-b4dc-e2dcb33ebcdd None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:06.991249 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:18:07.008079 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d4ffc0-1c80-483e-b4dc-e2dcb33ebcdd None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:07.042776 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b20a7-73d6-4e65-b3d9-0b192f0fe28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:07.043439 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b20a7-73d6-4e65-b3d9-0b192f0fe28a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:07.043716 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b20a7-73d6-4e65-b3d9-0b192f0fe28a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:07.043993 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b20a7-73d6-4e65-b3d9-0b192f0fe28a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:07.113857 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595b20a7-73d6-4e65-b3d9-0b192f0fe28a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:18:07.115344 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595b20a7-73d6-4e65-b3d9-0b192f0fe28a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:18:07.203474 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:18:07.220334 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 550/1115] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Jul 2 03:18:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 02 03:18:07.228704 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3506124-b924-4927-a864-51dbf40f08ed None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:07.334652 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3506124-b924-4927-a864-51dbf40f08ed None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:07.362699 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:18:07.374024 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f283c2-4829-477c-99b9-778607956aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:07.375276 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f283c2-4829-477c-99b9-778607956aea None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:07.375591 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f283c2-4829-477c-99b9-778607956aea None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:07.375941 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f283c2-4829-477c-99b9-778607956aea None admin] PATH_INFO: `/v3/projects/3cd89109c1a34a5aa9013c1cd91dd2d1` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:07.377457 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f283c2-4829-477c-99b9-778607956aea None admin] RBAC: Authorizing `identity:get_project(project_id=3cd89109c1a34a5aa9013c1cd91dd2d1)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:18:07.378889 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f283c2-4829-477c-99b9-778607956aea None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:18:07.380735 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 566/1116] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Jul 2 03:18:07 2022] GET /identity/v3/projects/3cd89109c1a34a5aa9013c1cd91dd2d1 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:18:07.388961 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b20a7-73d6-4e65-b3d9-0b192f0fe28a None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:07.489289 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b20a7-73d6-4e65-b3d9-0b192f0fe28a None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:07.529940 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dcc77a-c985-4389-84cf-4f13721737f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:07.530593 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dcc77a-c985-4389-84cf-4f13721737f2 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:07.530874 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dcc77a-c985-4389-84cf-4f13721737f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:07.531183 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dcc77a-c985-4389-84cf-4f13721737f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:07.532023 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dcc77a-c985-4389-84cf-4f13721737f2 None admin] RBAC: Adding query filter params (role.id=a9792a930e0c4e139f287a712dfc7d4d, scope.project.id=3cd89109c1a34a5aa9013c1cd91dd2d1, user.id=2288a03a993e4a90a5db8fa6698f86a1) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:18:07.532332 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dcc77a-c985-4389-84cf-4f13721737f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:18:07.533766 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dcc77a-c985-4389-84cf-4f13721737f2 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:18:07.540298 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 551/1117] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Jul 2 03:18:07 2022] GET /identity/v3/role_assignments?user.id=2288a03a993e4a90a5db8fa6698f86a1&scope.project.id=3cd89109c1a34a5aa9013c1cd91dd2d1&role.id=a9792a930e0c4e139f287a712dfc7d4d => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:18:09.517314 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad04e3d-25de-416e-bd0f-ba090b48a7eb None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:09.517865 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad04e3d-25de-416e-bd0f-ba090b48a7eb None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:09.517865 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad04e3d-25de-416e-bd0f-ba090b48a7eb None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:09.519302 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 567/1118] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:18:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:18:09.525688 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a75b60-c36f-445a-809d-6439300372a3 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:09.526381 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a75b60-c36f-445a-809d-6439300372a3 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:09.526564 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a75b60-c36f-445a-809d-6439300372a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:09.549810 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-b3a75b60-c36f-445a-809d-6439300372a3 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:18:09.551031 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b3a75b60-c36f-445a-809d-6439300372a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:18:09.600195 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:18:09.625182 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 552/1119] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:18:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 03:18:09.657123 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad04e3d-25de-416e-bd0f-ba090b48a7eb None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:09.766935 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad04e3d-25de-416e-bd0f-ba090b48a7eb None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:09.801664 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbdb6b1-2c0b-4451-a011-cc7221ca900c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:09.802500 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbdb6b1-2c0b-4451-a011-cc7221ca900c None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:09.802778 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbdb6b1-2c0b-4451-a011-cc7221ca900c None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:09.803049 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbdb6b1-2c0b-4451-a011-cc7221ca900c None admin] PATH_INFO: `/v3/roles/a9792a930e0c4e139f287a712dfc7d4d` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:09.804655 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbdb6b1-2c0b-4451-a011-cc7221ca900c None admin] RBAC: Authorizing `identity:get_role(role_id=a9792a930e0c4e139f287a712dfc7d4d)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:18:09.806028 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbdb6b1-2c0b-4451-a011-cc7221ca900c None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:18:09.807426 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 568/1120] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Jul 2 03:18:09 2022] GET /identity/v3/roles/a9792a930e0c4e139f287a712dfc7d4d => generated 223 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:18:09.813642 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a75b60-c36f-445a-809d-6439300372a3 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:09.920084 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a75b60-c36f-445a-809d-6439300372a3 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:09.964164 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee9731e-59dd-4982-8f74-2ec79951744f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:09.965027 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9731e-59dd-4982-8f74-2ec79951744f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:09.965309 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9731e-59dd-4982-8f74-2ec79951744f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:09.965582 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9731e-59dd-4982-8f74-2ec79951744f None admin] PATH_INFO: `/v3/users/2288a03a993e4a90a5db8fa6698f86a1` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:09.966887 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee9731e-59dd-4982-8f74-2ec79951744f None admin] RBAC: Authorizing `identity:get_user(user_id=2288a03a993e4a90a5db8fa6698f86a1)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:18:09.968382 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee9731e-59dd-4982-8f74-2ec79951744f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:18:09.970022 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 553/1121] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Jul 2 03:18:09 2022] GET /identity/v3/users/2288a03a993e4a90a5db8fa6698f86a1 => generated 286 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:18:09.979719 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbdb6b1-2c0b-4451-a011-cc7221ca900c None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:10.046456 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:18:10.096863 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbdb6b1-2c0b-4451-a011-cc7221ca900c None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:10.132887 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea633c5d-55fa-40bf-9610-a768fbaf6f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:10.133735 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea633c5d-55fa-40bf-9610-a768fbaf6f7b None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:10.134019 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea633c5d-55fa-40bf-9610-a768fbaf6f7b None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:10.134279 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea633c5d-55fa-40bf-9610-a768fbaf6f7b None admin] PATH_INFO: `/v3/projects/3cd89109c1a34a5aa9013c1cd91dd2d1` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:10.135604 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea633c5d-55fa-40bf-9610-a768fbaf6f7b None admin] RBAC: Authorizing `identity:get_project(project_id=3cd89109c1a34a5aa9013c1cd91dd2d1)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:18:10.137024 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea633c5d-55fa-40bf-9610-a768fbaf6f7b None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:18:10.138726 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 569/1122] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Jul 2 03:18:09 2022] GET /identity/v3/projects/3cd89109c1a34a5aa9013c1cd91dd2d1 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:18:10.148107 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee9731e-59dd-4982-8f74-2ec79951744f None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:10.196957 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:18:10.267477 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee9731e-59dd-4982-8f74-2ec79951744f None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:10.328524 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f428e791-1b72-42ce-a511-cff58eeb35c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:10.329422 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428e791-1b72-42ce-a511-cff58eeb35c2 None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:10.329703 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428e791-1b72-42ce-a511-cff58eeb35c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:10.329975 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428e791-1b72-42ce-a511-cff58eeb35c2 None admin] PATH_INFO: `/v3/projects/3cd89109c1a34a5aa9013c1cd91dd2d1/users/2288a03a993e4a90a5db8fa6698f86a1/roles/a9792a930e0c4e139f287a712dfc7d4d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:10.332368 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f428e791-1b72-42ce-a511-cff58eeb35c2 None admin] RBAC: Authorizing `identity:create_grant(project_id=3cd89109c1a34a5aa9013c1cd91dd2d1, user_id=2288a03a993e4a90a5db8fa6698f86a1, role_id=a9792a930e0c4e139f287a712dfc7d4d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:18:10.333842 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f428e791-1b72-42ce-a511-cff58eeb35c2 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:18:10.353049 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 554/1123] 10.222.0.60 () {58 vars in 1439 bytes} [Sat Jul 2 03:18:10 2022] PUT /identity/v3/projects/3cd89109c1a34a5aa9013c1cd91dd2d1/users/2288a03a993e4a90a5db8fa6698f86a1/roles/a9792a930e0c4e139f287a712dfc7d4d => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:18:12.351822 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3049ab-1817-4256-a890-e30dcaf60e70 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:12.352789 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3049ab-1817-4256-a890-e30dcaf60e70 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:12.352789 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3049ab-1817-4256-a890-e30dcaf60e70 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:12.354885 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 570/1124] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:18:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:18:12.362838 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceebf9b-824a-4ea9-a33d-e5d9696275ee None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:12.363325 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceebf9b-824a-4ea9-a33d-e5d9696275ee None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:12.363423 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceebf9b-824a-4ea9-a33d-e5d9696275ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:12.385950 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-aceebf9b-824a-4ea9-a33d-e5d9696275ee None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:18:12.387165 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-aceebf9b-824a-4ea9-a33d-e5d9696275ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:18:12.465269 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 555/1125] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:18:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 02 03:18:12.490225 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3049ab-1817-4256-a890-e30dcaf60e70 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:12.603891 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3049ab-1817-4256-a890-e30dcaf60e70 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:12.635556 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:18:12.645435 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd7a60-ebc1-4a50-8e88-95ce436fae85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:12.646731 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd7a60-ebc1-4a50-8e88-95ce436fae85 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:12.647099 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd7a60-ebc1-4a50-8e88-95ce436fae85 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:12.647497 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd7a60-ebc1-4a50-8e88-95ce436fae85 None admin] PATH_INFO: `/v3/roles/a9792a930e0c4e139f287a712dfc7d4d` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:12.649356 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcd7a60-ebc1-4a50-8e88-95ce436fae85 None admin] RBAC: Authorizing `identity:get_role(role_id=a9792a930e0c4e139f287a712dfc7d4d)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:18:12.650752 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcd7a60-ebc1-4a50-8e88-95ce436fae85 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:18:12.652221 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 571/1126] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Jul 2 03:18:12 2022] GET /identity/v3/roles/a9792a930e0c4e139f287a712dfc7d4d => generated 223 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:18:12.658980 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceebf9b-824a-4ea9-a33d-e5d9696275ee None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:12.702822 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:18:12.768623 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceebf9b-824a-4ea9-a33d-e5d9696275ee None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:12.804430 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153f69ff-f663-43ff-981c-5304c83be344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:12.805282 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153f69ff-f663-43ff-981c-5304c83be344 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:12.805550 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153f69ff-f663-43ff-981c-5304c83be344 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:12.805813 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153f69ff-f663-43ff-981c-5304c83be344 None admin] PATH_INFO: `/v3/users/2288a03a993e4a90a5db8fa6698f86a1` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:12.807164 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153f69ff-f663-43ff-981c-5304c83be344 None admin] RBAC: Authorizing `identity:get_user(user_id=2288a03a993e4a90a5db8fa6698f86a1)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:18:12.808580 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153f69ff-f663-43ff-981c-5304c83be344 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:18:12.810191 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 556/1127] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Jul 2 03:18:12 2022] GET /identity/v3/users/2288a03a993e4a90a5db8fa6698f86a1 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:18:12.816460 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd7a60-ebc1-4a50-8e88-95ce436fae85 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:12.919907 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd7a60-ebc1-4a50-8e88-95ce436fae85 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:12.954135 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77f2b29-0de6-416b-a00e-90f976e9632f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:12.954755 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f2b29-0de6-416b-a00e-90f976e9632f None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:12.955032 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f2b29-0de6-416b-a00e-90f976e9632f None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:12.955309 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f2b29-0de6-416b-a00e-90f976e9632f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:13.044572 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:18:13.048842 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77f2b29-0de6-416b-a00e-90f976e9632f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:18:13.050373 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77f2b29-0de6-416b-a00e-90f976e9632f None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:18:13.155293 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 572/1128] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Jul 2 03:18:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 02 03:18:13.162073 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153f69ff-f663-43ff-981c-5304c83be344 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:13.274687 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153f69ff-f663-43ff-981c-5304c83be344 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:13.277361 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:18:13.312783 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eebe669-00f2-4ad5-91d4-a74d67f01f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:13.313635 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eebe669-00f2-4ad5-91d4-a74d67f01f7f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:13.313921 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eebe669-00f2-4ad5-91d4-a74d67f01f7f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:13.314195 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eebe669-00f2-4ad5-91d4-a74d67f01f7f None admin] PATH_INFO: `/v3/projects/3cd89109c1a34a5aa9013c1cd91dd2d1` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:13.315438 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eebe669-00f2-4ad5-91d4-a74d67f01f7f None admin] RBAC: Authorizing `identity:get_project(project_id=3cd89109c1a34a5aa9013c1cd91dd2d1)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:18:13.316872 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eebe669-00f2-4ad5-91d4-a74d67f01f7f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:18:13.318595 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 557/1129] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Jul 2 03:18:13 2022] GET /identity/v3/projects/3cd89109c1a34a5aa9013c1cd91dd2d1 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:18:13.324787 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77f2b29-0de6-416b-a00e-90f976e9632f None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:13.430684 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:18:13.434665 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77f2b29-0de6-416b-a00e-90f976e9632f None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:13.473507 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e7c6c6-6183-412f-8443-84a602491db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:13.474145 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7c6c6-6183-412f-8443-84a602491db0 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:13.474423 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7c6c6-6183-412f-8443-84a602491db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:13.474690 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7c6c6-6183-412f-8443-84a602491db0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:13.475552 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e7c6c6-6183-412f-8443-84a602491db0 None admin] RBAC: Adding query filter params (role.id=a9792a930e0c4e139f287a712dfc7d4d, scope.project.id=3cd89109c1a34a5aa9013c1cd91dd2d1, user.id=2288a03a993e4a90a5db8fa6698f86a1) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:18:13.475855 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e7c6c6-6183-412f-8443-84a602491db0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:18:13.477284 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e7c6c6-6183-412f-8443-84a602491db0 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:18:13.483130 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 573/1130] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Jul 2 03:18:13 2022] GET /identity/v3/role_assignments?user.id=2288a03a993e4a90a5db8fa6698f86a1&scope.project.id=3cd89109c1a34a5aa9013c1cd91dd2d1&role.id=a9792a930e0c4e139f287a712dfc7d4d => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:18:15.501780 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7301ce6-3084-4093-b2f7-a3db8f533584 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:15.502657 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7301ce6-3084-4093-b2f7-a3db8f533584 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:15.502657 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7301ce6-3084-4093-b2f7-a3db8f533584 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:15.504996 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 558/1131] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:18:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:18:15.510560 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3307e1f2-ccc5-45a1-9572-d83c955f77f3 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:15.511030 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3307e1f2-ccc5-45a1-9572-d83c955f77f3 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:15.511166 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3307e1f2-ccc5-45a1-9572-d83c955f77f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:15.529587 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-3307e1f2-ccc5-45a1-9572-d83c955f77f3 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:18:15.530765 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-3307e1f2-ccc5-45a1-9572-d83c955f77f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:18:15.607610 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 574/1132] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:18:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 03:18:15.634701 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7301ce6-3084-4093-b2f7-a3db8f533584 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:15.742833 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7301ce6-3084-4093-b2f7-a3db8f533584 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:15.778115 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b784405-8b97-4470-9cd8-d9a9a84dd425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:15.778893 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b784405-8b97-4470-9cd8-d9a9a84dd425 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:15.779176 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b784405-8b97-4470-9cd8-d9a9a84dd425 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:15.779480 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b784405-8b97-4470-9cd8-d9a9a84dd425 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:15.780718 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b784405-8b97-4470-9cd8-d9a9a84dd425 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:18:15.782164 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b784405-8b97-4470-9cd8-d9a9a84dd425 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:18:15.783847 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 559/1133] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:18:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:18:15.793668 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3307e1f2-ccc5-45a1-9572-d83c955f77f3 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:15.893841 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:18:15.904031 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3307e1f2-ccc5-45a1-9572-d83c955f77f3 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:15.942118 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab9d22b-6d8b-42bc-a2da-736ee6d80f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:15.942775 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab9d22b-6d8b-42bc-a2da-736ee6d80f94 None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:15.943229 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab9d22b-6d8b-42bc-a2da-736ee6d80f94 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:15.943421 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab9d22b-6d8b-42bc-a2da-736ee6d80f94 None admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:15.944149 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab9d22b-6d8b-42bc-a2da-736ee6d80f94 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:18:15.945613 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab9d22b-6d8b-42bc-a2da-736ee6d80f94 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:18:15.978051 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 575/1134] 10.222.0.60 () {60 vars in 1141 bytes} [Sat Jul 2 03:18:15 2022] POST /identity/v3/projects => generated 311 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:18:18.019201 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15545ef-9fb0-48b0-a40d-415a192b458b None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:18.020071 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15545ef-9fb0-48b0-a40d-415a192b458b None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:18.020181 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15545ef-9fb0-48b0-a40d-415a192b458b None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:18.022314 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 560/1135] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:18:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:18:18.028131 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75533df7-17c6-492d-b2ed-4a7ce4bbbd51 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:18.028552 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75533df7-17c6-492d-b2ed-4a7ce4bbbd51 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:18.028666 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75533df7-17c6-492d-b2ed-4a7ce4bbbd51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:18.047811 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-75533df7-17c6-492d-b2ed-4a7ce4bbbd51 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:18:18.048997 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-75533df7-17c6-492d-b2ed-4a7ce4bbbd51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:18:18.118581 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 576/1136] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:18:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 03:18:18.144161 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15545ef-9fb0-48b0-a40d-415a192b458b None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:18.188773 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:18:18.253726 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15545ef-9fb0-48b0-a40d-415a192b458b None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:18.289160 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c43aa32-ed13-4898-a56e-31e26b290ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:18.289878 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43aa32-ed13-4898-a56e-31e26b290ea4 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:18.290155 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43aa32-ed13-4898-a56e-31e26b290ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:18.290435 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43aa32-ed13-4898-a56e-31e26b290ea4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:18.291672 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c43aa32-ed13-4898-a56e-31e26b290ea4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:18:18.293116 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c43aa32-ed13-4898-a56e-31e26b290ea4 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:18:18.294748 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 561/1137] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:18:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:18:18.304309 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75533df7-17c6-492d-b2ed-4a7ce4bbbd51 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:18.392053 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:18:18.418372 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75533df7-17c6-492d-b2ed-4a7ce4bbbd51 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:18.453889 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c88178-7d3b-409c-833d-7372aebb611e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:18.454580 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c88178-7d3b-409c-833d-7372aebb611e None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:18.454855 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c88178-7d3b-409c-833d-7372aebb611e None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:18.455163 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c88178-7d3b-409c-833d-7372aebb611e None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:18.455869 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c88178-7d3b-409c-833d-7372aebb611e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:18:18.457306 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c88178-7d3b-409c-833d-7372aebb611e None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:18:18.479235 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 577/1138] 10.222.0.60 () {60 vars in 1132 bytes} [Sat Jul 2 03:18:18 2022] POST /identity/v3/users => generated 286 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:18:20.549558 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81276815-aeed-480e-b953-f2deddb4a3a5 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:20.550106 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81276815-aeed-480e-b953-f2deddb4a3a5 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:20.550106 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81276815-aeed-480e-b953-f2deddb4a3a5 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:20.552293 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 562/1139] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:18:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:18:20.560120 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f5068-9208-4608-a998-bee6caaf8ca7 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:20.560597 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f5068-9208-4608-a998-bee6caaf8ca7 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:20.560697 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f5068-9208-4608-a998-bee6caaf8ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:20.579822 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-3a6f5068-9208-4608-a998-bee6caaf8ca7 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:18:20.581001 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-3a6f5068-9208-4608-a998-bee6caaf8ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:18:20.652768 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 578/1140] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:18:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 02 03:18:20.677042 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81276815-aeed-480e-b953-f2deddb4a3a5 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:20.792485 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81276815-aeed-480e-b953-f2deddb4a3a5 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:20.801831 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:18:20.830194 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c2d13-2937-4c98-97b4-98d2a87002f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:20.830973 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c2d13-2937-4c98-97b4-98d2a87002f9 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:20.831284 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c2d13-2937-4c98-97b4-98d2a87002f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:20.831555 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c2d13-2937-4c98-97b4-98d2a87002f9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:20.842130 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2c2d13-2937-4c98-97b4-98d2a87002f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:18:20.849741 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-fc2c2d13-2937-4c98-97b4-98d2a87002f9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 03:18:20.849741 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:18:20.849741 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:18:20.849741 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:18:20.849741 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:18:20.849741 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:18:20.849741 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:18:20.849741 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:18:20.849741 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:18:20.849741 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:18:20.849741 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:18:20.849741 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:18:20.849741 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:18:20.849741 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:18:20.849741 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:18:20.849741 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:18:20.850958 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:18:20.850958 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:18:20.850958 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:18:20.850958 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:18:20.850958 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:18:20.850958 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:18:20.850958 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:18:20.850958 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:18:20.850958 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:18:20.850958 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:18:20.850958 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:18:20.850958 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:18:20.850958 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:18:20.850958 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:18:20.850958 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:18:20.850958 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:18:20.852264 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:18:20.852264 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:18:20.852264 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:18:20.852264 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:18:20.852264 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:18:20.852264 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:18:20.852264 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:18:20.852264 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:18:20.852264 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:18:20.852264 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:18:20.852264 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 03:18:20.852264 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:18:20.852264 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 563/1141] 10.222.0.60 () {56 vars in 1096 bytes} [Sat Jul 2 03:18:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:18:20.857435 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6f5068-9208-4608-a998-bee6caaf8ca7 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:20.921482 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:18:20.964288 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6f5068-9208-4608-a998-bee6caaf8ca7 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:20.999850 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cab851-2555-411c-a9ce-9407fa33757a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:21.000501 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cab851-2555-411c-a9ce-9407fa33757a None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:21.000779 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cab851-2555-411c-a9ce-9407fa33757a None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:21.001047 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cab851-2555-411c-a9ce-9407fa33757a None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:21.001796 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cab851-2555-411c-a9ce-9407fa33757a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:18:21.002095 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cab851-2555-411c-a9ce-9407fa33757a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:18:21.003501 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cab851-2555-411c-a9ce-9407fa33757a None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:18:21.011858 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 579/1142] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Jul 2 03:18:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:18:21.021113 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c2d13-2937-4c98-97b4-98d2a87002f9 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:21.127909 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c2d13-2937-4c98-97b4-98d2a87002f9 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:21.162809 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8fb728-e324-4c73-99fb-ba9f3a32704f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:21.163695 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8fb728-e324-4c73-99fb-ba9f3a32704f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:21.163972 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8fb728-e324-4c73-99fb-ba9f3a32704f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:21.164245 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8fb728-e324-4c73-99fb-ba9f3a32704f None admin] PATH_INFO: `/v3/users/972b39d0450c4d199376e205b63da46b` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:21.177825 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8fb728-e324-4c73-99fb-ba9f3a32704f None admin] RBAC: Authorizing `identity:get_user(user_id=972b39d0450c4d199376e205b63da46b)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:18:21.179316 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8fb728-e324-4c73-99fb-ba9f3a32704f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:18:21.180942 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 564/1143] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Jul 2 03:18:21 2022] GET /identity/v3/users/972b39d0450c4d199376e205b63da46b => generated 286 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:18:21.186927 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cab851-2555-411c-a9ce-9407fa33757a None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:21.288902 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cab851-2555-411c-a9ce-9407fa33757a None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:21.311556 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:18:21.324417 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38498057-c477-4464-b255-8838a3102ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:21.325073 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38498057-c477-4464-b255-8838a3102ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:21.325350 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38498057-c477-4464-b255-8838a3102ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:21.325620 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38498057-c477-4464-b255-8838a3102ea5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:21.399242 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38498057-c477-4464-b255-8838a3102ea5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:18:21.400684 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38498057-c477-4464-b255-8838a3102ea5 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:18:21.513019 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 580/1144] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Jul 2 03:18:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 02 03:18:21.519200 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8fb728-e324-4c73-99fb-ba9f3a32704f None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:21.549759 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:18:21.632401 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8fb728-e324-4c73-99fb-ba9f3a32704f None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:21.667775 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111f9a1-2d72-47de-b51e-0e467a7dc75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:21.668626 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111f9a1-2d72-47de-b51e-0e467a7dc75d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:21.668903 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111f9a1-2d72-47de-b51e-0e467a7dc75d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:21.669170 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111f9a1-2d72-47de-b51e-0e467a7dc75d None admin] PATH_INFO: `/v3/projects/b0a58e16658f40eda5d5c35fb5afa915` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:21.670465 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f111f9a1-2d72-47de-b51e-0e467a7dc75d None admin] RBAC: Authorizing `identity:get_project(project_id=b0a58e16658f40eda5d5c35fb5afa915)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:18:21.671930 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f111f9a1-2d72-47de-b51e-0e467a7dc75d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:18:21.673617 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 565/1145] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Jul 2 03:18:21 2022] GET /identity/v3/projects/b0a58e16658f40eda5d5c35fb5afa915 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:18:21.680270 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38498057-c477-4464-b255-8838a3102ea5 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:21.710551 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:18:21.800505 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38498057-c477-4464-b255-8838a3102ea5 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:21.841078 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026d4d3d-fc8d-4852-9229-6ae7bc8bb26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:21.841740 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d4d3d-fc8d-4852-9229-6ae7bc8bb26c None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:21.842021 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d4d3d-fc8d-4852-9229-6ae7bc8bb26c None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:21.842294 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d4d3d-fc8d-4852-9229-6ae7bc8bb26c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:21.843154 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026d4d3d-fc8d-4852-9229-6ae7bc8bb26c None admin] RBAC: Adding query filter params (role.id=5dcd130cda6c490595e862dc2348e83d, scope.project.id=b0a58e16658f40eda5d5c35fb5afa915, user.id=972b39d0450c4d199376e205b63da46b) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:18:21.843481 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026d4d3d-fc8d-4852-9229-6ae7bc8bb26c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:18:21.844929 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026d4d3d-fc8d-4852-9229-6ae7bc8bb26c None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:18:21.851522 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 581/1146] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Jul 2 03:18:21 2022] GET /identity/v3/role_assignments?user.id=972b39d0450c4d199376e205b63da46b&scope.project.id=b0a58e16658f40eda5d5c35fb5afa915&role.id=5dcd130cda6c490595e862dc2348e83d => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:18:23.861682 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01669585-0edf-4c50-b7e9-a9f4251c5afe None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:23.862545 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01669585-0edf-4c50-b7e9-a9f4251c5afe None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:23.862545 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01669585-0edf-4c50-b7e9-a9f4251c5afe None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:23.864816 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 566/1147] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:18:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:18:23.870249 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3dc311-b8ba-41c3-9d82-bad498e895b3 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:23.870677 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3dc311-b8ba-41c3-9d82-bad498e895b3 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:23.870766 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3dc311-b8ba-41c3-9d82-bad498e895b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:23.888065 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-ae3dc311-b8ba-41c3-9d82-bad498e895b3 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:18:23.889218 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-ae3dc311-b8ba-41c3-9d82-bad498e895b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:18:23.958632 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 582/1148] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:18:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 03:18:23.982026 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01669585-0edf-4c50-b7e9-a9f4251c5afe None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:24.080564 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:18:24.089289 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01669585-0edf-4c50-b7e9-a9f4251c5afe None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:24.126952 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e8a25-e909-4a19-bdfa-b7489dd838be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:24.128054 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e8a25-e909-4a19-bdfa-b7489dd838be None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:24.128438 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e8a25-e909-4a19-bdfa-b7489dd838be None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:24.128799 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e8a25-e909-4a19-bdfa-b7489dd838be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:24.146256 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490e8a25-e909-4a19-bdfa-b7489dd838be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:18:24.156089 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-490e8a25-e909-4a19-bdfa-b7489dd838be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 03:18:24.156089 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:18:24.156089 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:18:24.156089 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:18:24.156089 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:18:24.156089 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:18:24.156089 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:18:24.156089 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:18:24.156089 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:18:24.156089 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:18:24.156089 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:18:24.156089 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:18:24.156089 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:18:24.156089 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:18:24.156089 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:18:24.156089 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:18:24.158000 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:18:24.158000 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:18:24.158000 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:18:24.158000 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:18:24.158000 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:18:24.158000 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:18:24.158000 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:18:24.158000 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:18:24.158000 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:18:24.158000 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:18:24.158000 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:18:24.158000 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:18:24.158000 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:18:24.158000 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:18:24.158000 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:18:24.158000 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:18:24.159187 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:18:24.159187 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:18:24.159187 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:18:24.159187 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:18:24.159187 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:18:24.159187 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:18:24.159187 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:18:24.159187 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:18:24.159187 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:18:24.159187 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:18:24.159187 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 03:18:24.159187 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:18:24.159187 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 567/1149] 10.222.0.60 () {56 vars in 1096 bytes} [Sat Jul 2 03:18:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:18:24.164795 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3dc311-b8ba-41c3-9d82-bad498e895b3 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:24.190376 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:18:24.283356 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3dc311-b8ba-41c3-9d82-bad498e895b3 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:24.319050 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d779c-ab59-4a01-b935-ea903cdfccc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:24.319740 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d779c-ab59-4a01-b935-ea903cdfccc0 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:24.320020 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d779c-ab59-4a01-b935-ea903cdfccc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:24.320293 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d779c-ab59-4a01-b935-ea903cdfccc0 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:24.321205 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292d779c-ab59-4a01-b935-ea903cdfccc0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:18:24.321520 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292d779c-ab59-4a01-b935-ea903cdfccc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:18:24.322888 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292d779c-ab59-4a01-b935-ea903cdfccc0 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:18:24.331584 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 583/1150] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Jul 2 03:18:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:18:24.340822 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e8a25-e909-4a19-bdfa-b7489dd838be None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:24.457776 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e8a25-e909-4a19-bdfa-b7489dd838be None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:24.493790 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e498907d-518f-42d5-8ee7-643a816cc6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:24.494662 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498907d-518f-42d5-8ee7-643a816cc6f8 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:24.494942 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498907d-518f-42d5-8ee7-643a816cc6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:24.495248 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498907d-518f-42d5-8ee7-643a816cc6f8 None admin] PATH_INFO: `/v3/users/972b39d0450c4d199376e205b63da46b` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:24.496575 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e498907d-518f-42d5-8ee7-643a816cc6f8 None admin] RBAC: Authorizing `identity:get_user(user_id=972b39d0450c4d199376e205b63da46b)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:18:24.498026 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e498907d-518f-42d5-8ee7-643a816cc6f8 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:18:24.499703 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 568/1151] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Jul 2 03:18:24 2022] GET /identity/v3/users/972b39d0450c4d199376e205b63da46b => generated 286 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:18:24.509198 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d779c-ab59-4a01-b935-ea903cdfccc0 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:24.600869 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:18:24.623601 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d779c-ab59-4a01-b935-ea903cdfccc0 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:24.657530 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e8a67-c608-4025-91ff-865953924112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:24.658373 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e8a67-c608-4025-91ff-865953924112 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:24.658664 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e8a67-c608-4025-91ff-865953924112 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:24.658927 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e8a67-c608-4025-91ff-865953924112 None admin] PATH_INFO: `/v3/projects/b0a58e16658f40eda5d5c35fb5afa915` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:24.660171 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00e8a67-c608-4025-91ff-865953924112 None admin] RBAC: Authorizing `identity:get_project(project_id=b0a58e16658f40eda5d5c35fb5afa915)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:18:24.661592 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00e8a67-c608-4025-91ff-865953924112 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:18:24.663672 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 584/1152] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Jul 2 03:18:24 2022] GET /identity/v3/projects/b0a58e16658f40eda5d5c35fb5afa915 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:18:24.670249 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e498907d-518f-42d5-8ee7-643a816cc6f8 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:24.700781 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:18:24.786816 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e498907d-518f-42d5-8ee7-643a816cc6f8 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:24.821926 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384eb694-44f9-432a-abc5-cb30909778bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:24.822807 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384eb694-44f9-432a-abc5-cb30909778bf None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:24.823080 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384eb694-44f9-432a-abc5-cb30909778bf None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:24.823387 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384eb694-44f9-432a-abc5-cb30909778bf None admin] PATH_INFO: `/v3/projects/b0a58e16658f40eda5d5c35fb5afa915/users/972b39d0450c4d199376e205b63da46b/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:24.825597 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384eb694-44f9-432a-abc5-cb30909778bf None admin] RBAC: Authorizing `identity:create_grant(project_id=b0a58e16658f40eda5d5c35fb5afa915, user_id=972b39d0450c4d199376e205b63da46b, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:18:24.827038 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384eb694-44f9-432a-abc5-cb30909778bf None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:18:24.847194 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 569/1153] 10.222.0.60 () {58 vars in 1439 bytes} [Sat Jul 2 03:18:24 2022] PUT /identity/v3/projects/b0a58e16658f40eda5d5c35fb5afa915/users/972b39d0450c4d199376e205b63da46b/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:18:26.858419 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b307e-e160-43f1-803c-34b407f868dd None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:26.858971 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b307e-e160-43f1-803c-34b407f868dd None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:26.858971 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b307e-e160-43f1-803c-34b407f868dd None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:26.861306 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 585/1154] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:18:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:18:26.869315 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af21c3-2405-44c3-9abc-165b9216dfa4 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:26.869793 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af21c3-2405-44c3-9abc-165b9216dfa4 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:26.869885 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af21c3-2405-44c3-9abc-165b9216dfa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:26.887023 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-74af21c3-2405-44c3-9abc-165b9216dfa4 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:18:26.888231 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-74af21c3-2405-44c3-9abc-165b9216dfa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:18:26.956839 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 570/1155] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:18:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 02 03:18:26.981152 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568b307e-e160-43f1-803c-34b407f868dd None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:27.090958 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568b307e-e160-43f1-803c-34b407f868dd None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:27.128039 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00544bc-f0d9-4b4b-9ebc-f4850ca36dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:27.128749 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00544bc-f0d9-4b4b-9ebc-f4850ca36dd1 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:27.129030 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00544bc-f0d9-4b4b-9ebc-f4850ca36dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:27.129301 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00544bc-f0d9-4b4b-9ebc-f4850ca36dd1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:27.139706 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00544bc-f0d9-4b4b-9ebc-f4850ca36dd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:18:27.147412 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-e00544bc-f0d9-4b4b-9ebc-f4850ca36dd1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 03:18:27.147412 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:18:27.147412 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:18:27.147412 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:18:27.147412 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:18:27.147412 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:18:27.147412 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:18:27.147412 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:18:27.147412 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:18:27.147412 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:18:27.147412 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:18:27.147412 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:18:27.147412 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:18:27.147412 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:18:27.147412 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:18:27.147412 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:18:27.148477 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:18:27.148477 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:18:27.148477 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:18:27.148477 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:18:27.148477 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:18:27.148477 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:18:27.148477 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:18:27.148477 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:18:27.148477 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:18:27.148477 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:18:27.148477 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:18:27.148477 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:18:27.148477 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:18:27.148477 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:18:27.148477 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:18:27.148477 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:18:27.149551 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:18:27.149551 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:18:27.149551 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:18:27.149551 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:18:27.149551 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:18:27.149551 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:18:27.149551 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:18:27.149551 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:18:27.149551 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:18:27.149551 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:18:27.149551 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 03:18:27.149551 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:18:27.149551 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 586/1156] 10.222.0.60 () {56 vars in 1096 bytes} [Sat Jul 2 03:18:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:18:27.155163 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74af21c3-2405-44c3-9abc-165b9216dfa4 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:27.169829 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:18:27.261359 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74af21c3-2405-44c3-9abc-165b9216dfa4 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:27.297000 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dcd598-9699-4d09-a1a8-f0e23f112bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:27.297655 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dcd598-9699-4d09-a1a8-f0e23f112bcb None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:27.297933 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dcd598-9699-4d09-a1a8-f0e23f112bcb None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:27.298212 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dcd598-9699-4d09-a1a8-f0e23f112bcb None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:27.298961 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dcd598-9699-4d09-a1a8-f0e23f112bcb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:18:27.299303 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dcd598-9699-4d09-a1a8-f0e23f112bcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:18:27.300702 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dcd598-9699-4d09-a1a8-f0e23f112bcb None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:18:27.309021 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 571/1157] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Jul 2 03:18:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:18:27.315004 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00544bc-f0d9-4b4b-9ebc-f4850ca36dd1 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:27.325351 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:18:27.419645 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00544bc-f0d9-4b4b-9ebc-f4850ca36dd1 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:27.454703 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31800e6-53e3-498d-a44f-a1d3089ce41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:27.455609 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31800e6-53e3-498d-a44f-a1d3089ce41b None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:27.455859 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31800e6-53e3-498d-a44f-a1d3089ce41b None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:27.456160 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31800e6-53e3-498d-a44f-a1d3089ce41b None admin] PATH_INFO: `/v3/users/972b39d0450c4d199376e205b63da46b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:27.457481 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31800e6-53e3-498d-a44f-a1d3089ce41b None admin] RBAC: Authorizing `identity:get_user(user_id=972b39d0450c4d199376e205b63da46b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:18:27.458924 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31800e6-53e3-498d-a44f-a1d3089ce41b None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:18:27.460596 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 587/1158] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Jul 2 03:18:27 2022] GET /identity/v3/users/972b39d0450c4d199376e205b63da46b => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:18:27.467380 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dcd598-9699-4d09-a1a8-f0e23f112bcb None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:27.544214 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:18:27.578592 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dcd598-9699-4d09-a1a8-f0e23f112bcb None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:27.613101 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406a8306-18d1-49c7-9344-7721302e9f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:27.613731 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a8306-18d1-49c7-9344-7721302e9f57 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:27.614008 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a8306-18d1-49c7-9344-7721302e9f57 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:27.614279 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a8306-18d1-49c7-9344-7721302e9f57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:27.686079 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406a8306-18d1-49c7-9344-7721302e9f57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:18:27.687522 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406a8306-18d1-49c7-9344-7721302e9f57 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:18:27.763914 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:18:27.791810 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 572/1159] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Jul 2 03:18:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 02 03:18:27.798083 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31800e6-53e3-498d-a44f-a1d3089ce41b None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:27.879156 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:18:27.915342 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31800e6-53e3-498d-a44f-a1d3089ce41b None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:27.955790 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a390587-b246-4942-91e4-8834095c53ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:27.956592 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a390587-b246-4942-91e4-8834095c53ad None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:27.956869 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a390587-b246-4942-91e4-8834095c53ad None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:27.957143 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a390587-b246-4942-91e4-8834095c53ad None admin] PATH_INFO: `/v3/projects/b0a58e16658f40eda5d5c35fb5afa915` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:27.958455 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a390587-b246-4942-91e4-8834095c53ad None admin] RBAC: Authorizing `identity:get_project(project_id=b0a58e16658f40eda5d5c35fb5afa915)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:18:27.959930 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a390587-b246-4942-91e4-8834095c53ad None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:18:27.961660 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 588/1160] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Jul 2 03:18:27 2022] GET /identity/v3/projects/b0a58e16658f40eda5d5c35fb5afa915 => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:18:27.968207 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406a8306-18d1-49c7-9344-7721302e9f57 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:28.068834 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406a8306-18d1-49c7-9344-7721302e9f57 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:28.103554 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78a1591-477e-408e-ad3c-a67b19665688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:28.104193 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a1591-477e-408e-ad3c-a67b19665688 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:28.104468 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a1591-477e-408e-ad3c-a67b19665688 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:28.104745 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a1591-477e-408e-ad3c-a67b19665688 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:28.105608 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78a1591-477e-408e-ad3c-a67b19665688 None admin] RBAC: Adding query filter params (role.id=5dcd130cda6c490595e862dc2348e83d, scope.project.id=b0a58e16658f40eda5d5c35fb5afa915, user.id=972b39d0450c4d199376e205b63da46b) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:18:28.105922 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78a1591-477e-408e-ad3c-a67b19665688 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:18:28.107386 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78a1591-477e-408e-ad3c-a67b19665688 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:18:28.113319 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 573/1161] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Jul 2 03:18:27 2022] GET /identity/v3/role_assignments?user.id=972b39d0450c4d199376e205b63da46b&scope.project.id=b0a58e16658f40eda5d5c35fb5afa915&role.id=5dcd130cda6c490595e862dc2348e83d => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:18:30.149137 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98ba57-f340-4fb6-9d19-f162d86c6c05 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:30.149733 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98ba57-f340-4fb6-9d19-f162d86c6c05 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:30.149733 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98ba57-f340-4fb6-9d19-f162d86c6c05 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:30.151094 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 589/1162] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:18:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:18:30.157574 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad427d9b-ad2e-4329-948f-b8295d9ecc1e None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:30.158288 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad427d9b-ad2e-4329-948f-b8295d9ecc1e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:30.158448 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad427d9b-ad2e-4329-948f-b8295d9ecc1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:30.184733 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-ad427d9b-ad2e-4329-948f-b8295d9ecc1e None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:18:30.185916 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ad427d9b-ad2e-4329-948f-b8295d9ecc1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:18:30.215986 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:18:30.254534 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 574/1163] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:18:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 03:18:30.291378 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf98ba57-f340-4fb6-9d19-f162d86c6c05 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:30.402579 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf98ba57-f340-4fb6-9d19-f162d86c6c05 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:30.438585 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa347de-cb25-4adf-8ed6-93a8c4cf2a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:30.439249 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa347de-cb25-4adf-8ed6-93a8c4cf2a75 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:30.439532 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa347de-cb25-4adf-8ed6-93a8c4cf2a75 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:30.439814 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa347de-cb25-4adf-8ed6-93a8c4cf2a75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:30.451879 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:18:30.510336 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa347de-cb25-4adf-8ed6-93a8c4cf2a75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:18:30.511817 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa347de-cb25-4adf-8ed6-93a8c4cf2a75 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:18:30.616713 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 590/1164] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Jul 2 03:18:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 02 03:18:30.623822 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad427d9b-ad2e-4329-948f-b8295d9ecc1e None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:30.747147 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad427d9b-ad2e-4329-948f-b8295d9ecc1e None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:30.782342 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f81217-bf26-4882-b0a5-ff15dc3a86de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:30.783159 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f81217-bf26-4882-b0a5-ff15dc3a86de None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:30.783432 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f81217-bf26-4882-b0a5-ff15dc3a86de None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:30.783704 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f81217-bf26-4882-b0a5-ff15dc3a86de None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:30.790956 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f81217-bf26-4882-b0a5-ff15dc3a86de None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:18:30.793191 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f81217-bf26-4882-b0a5-ff15dc3a86de None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:18:30.807603 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-d7f81217-bf26-4882-b0a5-ff15dc3a86de None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 02 03:18:30.807603 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:18:30.807603 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 02 03:18:30.807603 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 02 03:18:30.807603 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 03:18:30.807603 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 03:18:30.807603 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 03:18:30.807603 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 03:18:30.807603 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 02 03:18:30.807603 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:18:30.807603 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 03:18:30.807603 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:18:30.807603 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:18:30.807603 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:18:30.807603 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:18:30.807603 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:18:30.807603 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:18:30.808764 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:18:30.808764 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:18:30.808764 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:18:30.808764 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:18:30.808764 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:18:30.808764 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:18:30.808764 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:18:30.808764 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:18:30.808764 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:18:30.808764 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:18:30.808764 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:18:30.808764 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:18:30.808764 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:18:30.808764 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:18:30.808764 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:18:30.808764 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:18:30.809609 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:18:30.809609 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:18:30.809609 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:18:30.809609 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:18:30.809609 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:18:30.809609 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:18:30.809609 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:18:30.809609 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:18:30.809609 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:18:30.809609 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:18:30.809609 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 02 03:18:30.809609 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:18:30.809609 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 02 03:18:30.809609 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:18:30.809609 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 575/1165] 10.222.0.60 () {56 vars in 1117 bytes} [Sat Jul 2 03:18:30 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:18:30.817486 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa347de-cb25-4adf-8ed6-93a8c4cf2a75 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:30.869261 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:18:30.932305 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa347de-cb25-4adf-8ed6-93a8c4cf2a75 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:30.967560 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a77cc-3a04-41e9-94d7-9efd04586f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:30.968210 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a77cc-3a04-41e9-94d7-9efd04586f39 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:30.968489 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a77cc-3a04-41e9-94d7-9efd04586f39 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:30.968758 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a77cc-3a04-41e9-94d7-9efd04586f39 None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:30.969478 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25a77cc-3a04-41e9-94d7-9efd04586f39 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:18:30.969784 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25a77cc-3a04-41e9-94d7-9efd04586f39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:18:30.971167 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25a77cc-3a04-41e9-94d7-9efd04586f39 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:18:30.978437 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 591/1166] 10.222.0.60 () {56 vars in 1115 bytes} [Sat Jul 2 03:18:30 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:18:32.985135 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d6cd25-1e96-4c58-8838-e95d4d55fe60 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:32.986043 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d6cd25-1e96-4c58-8838-e95d4d55fe60 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:32.986043 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d6cd25-1e96-4c58-8838-e95d4d55fe60 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:32.988273 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 576/1167] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:18:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:18:32.993906 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d07f521-2b99-4676-965b-cddab62159e9 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:32.994344 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d07f521-2b99-4676-965b-cddab62159e9 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:32.994446 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d07f521-2b99-4676-965b-cddab62159e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:33.012955 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-1d07f521-2b99-4676-965b-cddab62159e9 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:18:33.014132 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-1d07f521-2b99-4676-965b-cddab62159e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:18:33.084569 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 592/1168] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:18:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 03:18:33.108746 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d6cd25-1e96-4c58-8838-e95d4d55fe60 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:33.145202 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:18:33.223513 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d6cd25-1e96-4c58-8838-e95d4d55fe60 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:33.258323 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699eb105-763f-4a32-a98c-9fe75b743e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:33.258965 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699eb105-763f-4a32-a98c-9fe75b743e26 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:33.259282 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699eb105-763f-4a32-a98c-9fe75b743e26 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:33.259559 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699eb105-763f-4a32-a98c-9fe75b743e26 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:33.260298 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699eb105-763f-4a32-a98c-9fe75b743e26 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:18:33.261674 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699eb105-763f-4a32-a98c-9fe75b743e26 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:18:33.282143 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 577/1169] 10.222.0.60 () {60 vars in 1138 bytes} [Sat Jul 2 03:18:33 2022] POST /identity/v3/domains => generated 267 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:18:35.300878 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b31cf3-6612-45ac-b0a2-71dd15979545 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:35.301443 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b31cf3-6612-45ac-b0a2-71dd15979545 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:35.301443 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b31cf3-6612-45ac-b0a2-71dd15979545 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:35.302815 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 593/1170] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:18:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:18:35.309235 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f5719-2c7d-4575-ac24-a76b0f72bff7 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:35.310009 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f5719-2c7d-4575-ac24-a76b0f72bff7 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:35.310136 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f5719-2c7d-4575-ac24-a76b0f72bff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:35.336354 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-de8f5719-2c7d-4575-ac24-a76b0f72bff7 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:18:35.337554 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-de8f5719-2c7d-4575-ac24-a76b0f72bff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:18:35.415765 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 578/1171] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:18:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 03:18:35.442796 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b31cf3-6612-45ac-b0a2-71dd15979545 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:35.490709 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:18:35.560265 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b31cf3-6612-45ac-b0a2-71dd15979545 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:35.595872 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24144761-a15e-4032-9e2c-de63e762606a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:35.596758 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24144761-a15e-4032-9e2c-de63e762606a None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:35.597039 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24144761-a15e-4032-9e2c-de63e762606a None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:35.597285 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24144761-a15e-4032-9e2c-de63e762606a None admin] PATH_INFO: `/v3/domains/7286af993a194e1ea611c5ea1a3a71db` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:35.608405 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24144761-a15e-4032-9e2c-de63e762606a None admin] RBAC: Authorizing `identity:get_domain(domain_id=7286af993a194e1ea611c5ea1a3a71db)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:18:35.609841 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24144761-a15e-4032-9e2c-de63e762606a None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:18:35.611659 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 594/1172] 10.222.0.60 () {56 vars in 1183 bytes} [Sat Jul 2 03:18:35 2022] GET /identity/v3/domains/7286af993a194e1ea611c5ea1a3a71db => generated 267 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:18:35.617885 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8f5719-2c7d-4575-ac24-a76b0f72bff7 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:35.637447 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:18:35.725800 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8f5719-2c7d-4575-ac24-a76b0f72bff7 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:35.763475 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcb1708-2bdb-4f25-995d-413410bdb4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:35.764131 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb1708-2bdb-4f25-995d-413410bdb4c0 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:35.764417 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb1708-2bdb-4f25-995d-413410bdb4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:35.764694 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb1708-2bdb-4f25-995d-413410bdb4c0 None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:35.765396 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcb1708-2bdb-4f25-995d-413410bdb4c0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:18:35.766845 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcb1708-2bdb-4f25-995d-413410bdb4c0 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:18:35.795489 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 579/1173] 10.222.0.60 () {60 vars in 1141 bytes} [Sat Jul 2 03:18:35 2022] POST /identity/v3/projects => generated 361 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:18:37.818358 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b1a6eb-71cf-4c70-9bb4-f4fd65edb388 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:37.819246 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b1a6eb-71cf-4c70-9bb4-f4fd65edb388 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:37.819441 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b1a6eb-71cf-4c70-9bb4-f4fd65edb388 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:37.820948 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 595/1174] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:18:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:18:37.826335 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b773675-0742-4346-b6bb-6421a7fea623 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:37.826758 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b773675-0742-4346-b6bb-6421a7fea623 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:37.826848 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b773675-0742-4346-b6bb-6421a7fea623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:37.845463 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-7b773675-0742-4346-b6bb-6421a7fea623 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:18:37.846612 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7b773675-0742-4346-b6bb-6421a7fea623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:18:37.910826 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:18:37.916569 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 580/1175] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:18:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 03:18:37.941568 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b1a6eb-71cf-4c70-9bb4-f4fd65edb388 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:38.050067 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:18:38.059652 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b1a6eb-71cf-4c70-9bb4-f4fd65edb388 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:38.096602 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9288b8a3-72ca-4806-8657-6de2db829e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:38.097742 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9288b8a3-72ca-4806-8657-6de2db829e73 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:38.098086 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9288b8a3-72ca-4806-8657-6de2db829e73 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:38.098428 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9288b8a3-72ca-4806-8657-6de2db829e73 None admin] PATH_INFO: `/v3/domains/7286af993a194e1ea611c5ea1a3a71db` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:38.100285 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9288b8a3-72ca-4806-8657-6de2db829e73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=7286af993a194e1ea611c5ea1a3a71db)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:18:38.102475 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9288b8a3-72ca-4806-8657-6de2db829e73 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:18:38.105003 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 596/1176] 10.222.0.60 () {56 vars in 1183 bytes} [Sat Jul 2 03:18:37 2022] GET /identity/v3/domains/7286af993a194e1ea611c5ea1a3a71db => generated 267 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:18:38.111163 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b773675-0742-4346-b6bb-6421a7fea623 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:38.218326 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b773675-0742-4346-b6bb-6421a7fea623 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:38.253752 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59600c1-b8ae-43af-b041-8d7ecd53575d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:38.254407 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59600c1-b8ae-43af-b041-8d7ecd53575d None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:38.254690 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59600c1-b8ae-43af-b041-8d7ecd53575d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:38.254968 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59600c1-b8ae-43af-b041-8d7ecd53575d None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:38.255714 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59600c1-b8ae-43af-b041-8d7ecd53575d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:18:38.257212 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59600c1-b8ae-43af-b041-8d7ecd53575d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:18:38.281157 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 581/1177] 10.222.0.60 () {60 vars in 1132 bytes} [Sat Jul 2 03:18:38 2022] POST /identity/v3/users => generated 311 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:18:40.321436 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995f845-ce0a-4c81-bc62-5ae8d30179da None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:40.322357 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995f845-ce0a-4c81-bc62-5ae8d30179da None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:40.322357 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995f845-ce0a-4c81-bc62-5ae8d30179da None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:40.324535 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 597/1178] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:18:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:18:40.332319 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1cdac2-5e9e-4626-bcd4-0b4bd5ebcec1 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:40.332766 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1cdac2-5e9e-4626-bcd4-0b4bd5ebcec1 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:40.332856 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1cdac2-5e9e-4626-bcd4-0b4bd5ebcec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:40.352392 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-1f1cdac2-5e9e-4626-bcd4-0b4bd5ebcec1 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:18:40.354131 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1f1cdac2-5e9e-4626-bcd4-0b4bd5ebcec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:18:40.416643 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:18:40.435051 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 582/1179] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:18:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 02 03:18:40.459165 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f995f845-ce0a-4c81-bc62-5ae8d30179da None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:40.578229 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f995f845-ce0a-4c81-bc62-5ae8d30179da None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:40.624888 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337d66f9-3f27-4911-bf2a-a405726e6a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:40.625675 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d66f9-3f27-4911-bf2a-a405726e6a34 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:40.625957 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d66f9-3f27-4911-bf2a-a405726e6a34 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:40.626233 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d66f9-3f27-4911-bf2a-a405726e6a34 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:40.637253 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337d66f9-3f27-4911-bf2a-a405726e6a34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:18:40.644915 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-337d66f9-3f27-4911-bf2a-a405726e6a34 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 03:18:40.644915 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:18:40.644915 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:18:40.644915 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:18:40.644915 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:18:40.644915 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:18:40.644915 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:18:40.644915 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:18:40.644915 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:18:40.644915 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:18:40.644915 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:18:40.644915 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:18:40.644915 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:18:40.644915 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:18:40.644915 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:18:40.644915 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:18:40.646225 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:18:40.646225 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:18:40.646225 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:18:40.646225 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:18:40.646225 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:18:40.646225 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:18:40.646225 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:18:40.646225 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:18:40.646225 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:18:40.646225 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:18:40.646225 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:18:40.646225 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:18:40.646225 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:18:40.646225 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:18:40.646225 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:18:40.646225 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:18:40.647917 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:18:40.647917 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:18:40.647917 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:18:40.647917 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:18:40.647917 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:18:40.647917 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:18:40.647917 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:18:40.647917 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:18:40.647917 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:18:40.647917 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:18:40.647917 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 03:18:40.647917 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:18:40.647917 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 598/1180] 10.222.0.60 () {56 vars in 1096 bytes} [Sat Jul 2 03:18:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:18:40.653078 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1cdac2-5e9e-4626-bcd4-0b4bd5ebcec1 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:40.770434 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1cdac2-5e9e-4626-bcd4-0b4bd5ebcec1 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:40.809229 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce46198-5cac-45d2-b930-6425473abbe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:40.809950 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce46198-5cac-45d2-b930-6425473abbe0 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:40.810211 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce46198-5cac-45d2-b930-6425473abbe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:40.810482 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce46198-5cac-45d2-b930-6425473abbe0 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:40.811257 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce46198-5cac-45d2-b930-6425473abbe0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:18:40.811563 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce46198-5cac-45d2-b930-6425473abbe0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:18:40.812938 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce46198-5cac-45d2-b930-6425473abbe0 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:18:40.821236 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 583/1181] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Jul 2 03:18:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:18:40.828141 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337d66f9-3f27-4911-bf2a-a405726e6a34 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:40.858684 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:18:40.943948 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337d66f9-3f27-4911-bf2a-a405726e6a34 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:40.983004 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02788275-8bdb-4c6b-ad96-db2e9b3e7e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:40.983894 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02788275-8bdb-4c6b-ad96-db2e9b3e7e18 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:40.984176 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02788275-8bdb-4c6b-ad96-db2e9b3e7e18 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:40.984445 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02788275-8bdb-4c6b-ad96-db2e9b3e7e18 None admin] PATH_INFO: `/v3/users/1b709b5d8b644866b8a06ea4e3adbac2` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:41.000938 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02788275-8bdb-4c6b-ad96-db2e9b3e7e18 None admin] RBAC: Authorizing `identity:get_user(user_id=1b709b5d8b644866b8a06ea4e3adbac2)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:18:41.002372 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02788275-8bdb-4c6b-ad96-db2e9b3e7e18 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:18:41.004081 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 599/1182] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Jul 2 03:18:40 2022] GET /identity/v3/users/1b709b5d8b644866b8a06ea4e3adbac2 => generated 311 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:18:41.010416 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce46198-5cac-45d2-b930-6425473abbe0 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:41.073636 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:18:41.129185 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce46198-5cac-45d2-b930-6425473abbe0 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:41.165397 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e87fe3-fd87-4ab9-ab4c-f1595fbb0bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:41.166029 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e87fe3-fd87-4ab9-ab4c-f1595fbb0bdf None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:41.166306 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e87fe3-fd87-4ab9-ab4c-f1595fbb0bdf None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:41.166575 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e87fe3-fd87-4ab9-ab4c-f1595fbb0bdf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:41.237156 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e87fe3-fd87-4ab9-ab4c-f1595fbb0bdf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:18:41.238585 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e87fe3-fd87-4ab9-ab4c-f1595fbb0bdf None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:18:41.292924 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:18:41.350492 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 584/1183] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Jul 2 03:18:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 02 03:18:41.356839 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02788275-8bdb-4c6b-ad96-db2e9b3e7e18 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:41.446621 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:18:41.469888 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02788275-8bdb-4c6b-ad96-db2e9b3e7e18 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:41.508803 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a7c034-3d2d-4018-beb8-5692e53a4fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:41.509715 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7c034-3d2d-4018-beb8-5692e53a4fdb None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:41.510000 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7c034-3d2d-4018-beb8-5692e53a4fdb None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:41.510277 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7c034-3d2d-4018-beb8-5692e53a4fdb None admin] PATH_INFO: `/v3/projects/4bf8103108654479af62e5a2d98a3655` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:41.511625 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a7c034-3d2d-4018-beb8-5692e53a4fdb None admin] RBAC: Authorizing `identity:get_project(project_id=4bf8103108654479af62e5a2d98a3655)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:18:41.513061 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a7c034-3d2d-4018-beb8-5692e53a4fdb None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:18:41.514784 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 600/1184] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Jul 2 03:18:41 2022] GET /identity/v3/projects/4bf8103108654479af62e5a2d98a3655 => generated 361 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:18:41.524201 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e87fe3-fd87-4ab9-ab4c-f1595fbb0bdf None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:41.627069 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e87fe3-fd87-4ab9-ab4c-f1595fbb0bdf None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:41.662642 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb38b83-8a16-4d4d-8986-71bc3b07f12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:41.663376 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb38b83-8a16-4d4d-8986-71bc3b07f12f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:41.663656 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb38b83-8a16-4d4d-8986-71bc3b07f12f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:41.663927 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb38b83-8a16-4d4d-8986-71bc3b07f12f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:41.664756 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb38b83-8a16-4d4d-8986-71bc3b07f12f None admin] RBAC: Adding query filter params (role.id=5dcd130cda6c490595e862dc2348e83d, scope.project.id=4bf8103108654479af62e5a2d98a3655, user.id=1b709b5d8b644866b8a06ea4e3adbac2) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:18:41.665071 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb38b83-8a16-4d4d-8986-71bc3b07f12f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:18:41.666479 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb38b83-8a16-4d4d-8986-71bc3b07f12f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:18:41.672056 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 585/1185] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Jul 2 03:18:41 2022] GET /identity/v3/role_assignments?user.id=1b709b5d8b644866b8a06ea4e3adbac2&scope.project.id=4bf8103108654479af62e5a2d98a3655&role.id=5dcd130cda6c490595e862dc2348e83d => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:18:43.637648 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27fbdb-5b4d-4ce9-8ea2-a8621a11342c None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:43.638489 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27fbdb-5b4d-4ce9-8ea2-a8621a11342c None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:43.638489 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27fbdb-5b4d-4ce9-8ea2-a8621a11342c None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:43.640700 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 601/1186] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:18:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:18:43.646946 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87be46-9c4a-4abe-bfd2-fa16757fa2f3 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:43.647494 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87be46-9c4a-4abe-bfd2-fa16757fa2f3 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:43.647655 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87be46-9c4a-4abe-bfd2-fa16757fa2f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:43.666596 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-2a87be46-9c4a-4abe-bfd2-fa16757fa2f3 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:18:43.667826 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2a87be46-9c4a-4abe-bfd2-fa16757fa2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:18:43.675814 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:18:43.745294 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 586/1187] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:18:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 03:18:43.768745 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27fbdb-5b4d-4ce9-8ea2-a8621a11342c None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:43.884130 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27fbdb-5b4d-4ce9-8ea2-a8621a11342c None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:43.920136 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c10765b-9ea3-4048-980b-61da42cf6311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:43.920872 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c10765b-9ea3-4048-980b-61da42cf6311 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:43.921119 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c10765b-9ea3-4048-980b-61da42cf6311 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:43.921418 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c10765b-9ea3-4048-980b-61da42cf6311 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:43.932083 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c10765b-9ea3-4048-980b-61da42cf6311 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:18:43.939700 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-7c10765b-9ea3-4048-980b-61da42cf6311 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 03:18:43.939700 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:18:43.939700 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:18:43.939700 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:18:43.939700 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:18:43.939700 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:18:43.939700 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:18:43.939700 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:18:43.939700 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:18:43.939700 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:18:43.939700 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:18:43.939700 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:18:43.939700 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:18:43.939700 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:18:43.939700 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:18:43.939700 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:18:43.940736 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:18:43.940736 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:18:43.940736 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:18:43.940736 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:18:43.940736 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:18:43.940736 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:18:43.940736 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:18:43.940736 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:18:43.940736 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:18:43.940736 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:18:43.940736 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:18:43.940736 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:18:43.940736 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:18:43.940736 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:18:43.940736 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:18:43.940736 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:18:43.941833 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:18:43.941833 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:18:43.941833 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:18:43.941833 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:18:43.941833 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:18:43.941833 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:18:43.941833 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:18:43.941833 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:18:43.941833 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:18:43.941833 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:18:43.941833 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 03:18:43.941833 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:18:43.941833 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 602/1188] 10.222.0.60 () {56 vars in 1096 bytes} [Sat Jul 2 03:18:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:18:43.947914 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87be46-9c4a-4abe-bfd2-fa16757fa2f3 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:44.063393 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87be46-9c4a-4abe-bfd2-fa16757fa2f3 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:44.106723 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e96b7-f85d-46f5-a041-9005c6a1c2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:44.107766 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e96b7-f85d-46f5-a041-9005c6a1c2ba None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:44.108120 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e96b7-f85d-46f5-a041-9005c6a1c2ba None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:44.108466 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e96b7-f85d-46f5-a041-9005c6a1c2ba None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:44.109625 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02e96b7-f85d-46f5-a041-9005c6a1c2ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:18:44.110028 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02e96b7-f85d-46f5-a041-9005c6a1c2ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:18:44.112244 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02e96b7-f85d-46f5-a041-9005c6a1c2ba None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:18:44.122327 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 587/1189] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Jul 2 03:18:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:18:44.131558 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c10765b-9ea3-4048-980b-61da42cf6311 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:44.151755 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:18:44.251668 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c10765b-9ea3-4048-980b-61da42cf6311 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:44.286941 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0c3ec5-b40c-44d7-8b99-5416077c8a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:44.287820 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c3ec5-b40c-44d7-8b99-5416077c8a61 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:44.288105 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c3ec5-b40c-44d7-8b99-5416077c8a61 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:44.288379 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c3ec5-b40c-44d7-8b99-5416077c8a61 None admin] PATH_INFO: `/v3/users/1b709b5d8b644866b8a06ea4e3adbac2` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:44.289647 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0c3ec5-b40c-44d7-8b99-5416077c8a61 None admin] RBAC: Authorizing `identity:get_user(user_id=1b709b5d8b644866b8a06ea4e3adbac2)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:18:44.291083 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0c3ec5-b40c-44d7-8b99-5416077c8a61 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:18:44.292778 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 603/1190] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Jul 2 03:18:44 2022] GET /identity/v3/users/1b709b5d8b644866b8a06ea4e3adbac2 => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:18:44.299354 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e96b7-f85d-46f5-a041-9005c6a1c2ba None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:44.305434 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:18:44.416503 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e96b7-f85d-46f5-a041-9005c6a1c2ba None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:44.451192 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dbc0c3-1e71-481a-a7ab-d6555d4e47c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:44.452050 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dbc0c3-1e71-481a-a7ab-d6555d4e47c3 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:44.452326 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dbc0c3-1e71-481a-a7ab-d6555d4e47c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:44.452597 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dbc0c3-1e71-481a-a7ab-d6555d4e47c3 None admin] PATH_INFO: `/v3/projects/4bf8103108654479af62e5a2d98a3655` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:44.453828 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dbc0c3-1e71-481a-a7ab-d6555d4e47c3 None admin] RBAC: Authorizing `identity:get_project(project_id=4bf8103108654479af62e5a2d98a3655)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:18:44.455312 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dbc0c3-1e71-481a-a7ab-d6555d4e47c3 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:18:44.457004 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 588/1191] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Jul 2 03:18:44 2022] GET /identity/v3/projects/4bf8103108654479af62e5a2d98a3655 => generated 361 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:18:44.466392 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0c3ec5-b40c-44d7-8b99-5416077c8a61 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:44.554518 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:18:44.584523 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0c3ec5-b40c-44d7-8b99-5416077c8a61 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:44.621516 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e4bd62-5e4a-42d3-aa54-894e6c95922c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:44.622904 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4bd62-5e4a-42d3-aa54-894e6c95922c None admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:44.623316 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4bd62-5e4a-42d3-aa54-894e6c95922c None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:44.623664 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4bd62-5e4a-42d3-aa54-894e6c95922c None admin] PATH_INFO: `/v3/projects/4bf8103108654479af62e5a2d98a3655/users/1b709b5d8b644866b8a06ea4e3adbac2/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:44.628160 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e4bd62-5e4a-42d3-aa54-894e6c95922c None admin] RBAC: Authorizing `identity:create_grant(project_id=4bf8103108654479af62e5a2d98a3655, user_id=1b709b5d8b644866b8a06ea4e3adbac2, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:18:44.630402 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e4bd62-5e4a-42d3-aa54-894e6c95922c None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:18:44.648825 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 604/1192] 10.222.0.60 () {58 vars in 1439 bytes} [Sat Jul 2 03:18:44 2022] PUT /identity/v3/projects/4bf8103108654479af62e5a2d98a3655/users/1b709b5d8b644866b8a06ea4e3adbac2/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:18:46.667558 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cbe50e-844f-44df-9399-ebafaa58b0ca None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:46.668479 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cbe50e-844f-44df-9399-ebafaa58b0ca None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:46.668479 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cbe50e-844f-44df-9399-ebafaa58b0ca None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:46.670546 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 589/1193] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:18:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:18:46.676018 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc84c77-8ae5-41ab-b3fc-7c4f54a0a67c None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:46.676471 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc84c77-8ae5-41ab-b3fc-7c4f54a0a67c None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:46.676571 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc84c77-8ae5-41ab-b3fc-7c4f54a0a67c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:46.694955 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-cdc84c77-8ae5-41ab-b3fc-7c4f54a0a67c None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:18:46.696272 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-cdc84c77-8ae5-41ab-b3fc-7c4f54a0a67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:18:46.764653 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 605/1194] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:18:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 03:18:46.789882 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cbe50e-844f-44df-9399-ebafaa58b0ca None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:46.878019 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:18:46.910072 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cbe50e-844f-44df-9399-ebafaa58b0ca None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:46.951113 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce9f10-1807-4178-b98a-6570395d4602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:46.951861 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce9f10-1807-4178-b98a-6570395d4602 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:46.952144 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce9f10-1807-4178-b98a-6570395d4602 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:46.952420 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce9f10-1807-4178-b98a-6570395d4602 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:46.967935 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfce9f10-1807-4178-b98a-6570395d4602 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:18:46.979292 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-bfce9f10-1807-4178-b98a-6570395d4602 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 03:18:46.979292 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:18:46.979292 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:18:46.979292 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:18:46.979292 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:18:46.979292 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:18:46.979292 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:18:46.979292 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:18:46.979292 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:18:46.979292 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:18:46.979292 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:18:46.979292 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:18:46.979292 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:18:46.979292 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:18:46.979292 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:18:46.979292 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:18:46.980437 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:18:46.980437 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:18:46.980437 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:18:46.980437 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:18:46.980437 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:18:46.980437 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:18:46.980437 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:18:46.980437 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:18:46.980437 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:18:46.980437 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:18:46.980437 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:18:46.980437 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:18:46.980437 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:18:46.980437 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:18:46.980437 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:18:46.980437 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:18:46.981553 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:18:46.981553 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:18:46.981553 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:18:46.981553 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:18:46.981553 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:18:46.981553 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:18:46.981553 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:18:46.981553 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:18:46.981553 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:18:46.981553 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:18:46.981553 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 03:18:46.981553 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:18:46.981553 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 590/1195] 10.222.0.60 () {56 vars in 1096 bytes} [Sat Jul 2 03:18:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:18:46.988926 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc84c77-8ae5-41ab-b3fc-7c4f54a0a67c None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:47.066404 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:18:47.099720 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc84c77-8ae5-41ab-b3fc-7c4f54a0a67c None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:47.135428 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d601e94e-5088-4ee6-93a3-c1dec133c410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:47.136088 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601e94e-5088-4ee6-93a3-c1dec133c410 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:47.136363 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601e94e-5088-4ee6-93a3-c1dec133c410 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:47.136633 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601e94e-5088-4ee6-93a3-c1dec133c410 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:47.137382 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d601e94e-5088-4ee6-93a3-c1dec133c410 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:18:47.137687 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d601e94e-5088-4ee6-93a3-c1dec133c410 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:18:47.139060 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d601e94e-5088-4ee6-93a3-c1dec133c410 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:18:47.147442 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 606/1196] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Jul 2 03:18:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:18:47.153671 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce9f10-1807-4178-b98a-6570395d4602 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:47.275733 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce9f10-1807-4178-b98a-6570395d4602 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:47.305520 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:18:47.314126 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b301671-8fe8-4dc0-91ce-2b1bd95aab3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:47.315500 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b301671-8fe8-4dc0-91ce-2b1bd95aab3f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:47.315894 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b301671-8fe8-4dc0-91ce-2b1bd95aab3f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:47.316298 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b301671-8fe8-4dc0-91ce-2b1bd95aab3f None admin] PATH_INFO: `/v3/users/1b709b5d8b644866b8a06ea4e3adbac2` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:47.318288 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b301671-8fe8-4dc0-91ce-2b1bd95aab3f None admin] RBAC: Authorizing `identity:get_user(user_id=1b709b5d8b644866b8a06ea4e3adbac2)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:18:47.320677 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b301671-8fe8-4dc0-91ce-2b1bd95aab3f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:18:47.323471 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 591/1197] 10.222.0.60 () {56 vars in 1177 bytes} [Sat Jul 2 03:18:47 2022] GET /identity/v3/users/1b709b5d8b644866b8a06ea4e3adbac2 => generated 311 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:18:47.329338 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d601e94e-5088-4ee6-93a3-c1dec133c410 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:47.436913 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d601e94e-5088-4ee6-93a3-c1dec133c410 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:47.465605 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:18:47.472690 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d5dc0-5b7c-4d50-95fa-cf76d2cc87f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:47.473335 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d5dc0-5b7c-4d50-95fa-cf76d2cc87f4 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:47.473611 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d5dc0-5b7c-4d50-95fa-cf76d2cc87f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:47.473884 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d5dc0-5b7c-4d50-95fa-cf76d2cc87f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:47.542099 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918d5dc0-5b7c-4d50-95fa-cf76d2cc87f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:18:47.543495 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918d5dc0-5b7c-4d50-95fa-cf76d2cc87f4 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:18:47.645347 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 607/1198] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Jul 2 03:18:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 02 03:18:47.651929 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b301671-8fe8-4dc0-91ce-2b1bd95aab3f None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:47.753897 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b301671-8fe8-4dc0-91ce-2b1bd95aab3f None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:47.806978 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaacff80-cab4-4e47-9870-a44ab212b1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:47.807836 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaacff80-cab4-4e47-9870-a44ab212b1c0 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:47.808118 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaacff80-cab4-4e47-9870-a44ab212b1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:47.808399 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaacff80-cab4-4e47-9870-a44ab212b1c0 None admin] PATH_INFO: `/v3/projects/4bf8103108654479af62e5a2d98a3655` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:47.809782 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaacff80-cab4-4e47-9870-a44ab212b1c0 None admin] RBAC: Authorizing `identity:get_project(project_id=4bf8103108654479af62e5a2d98a3655)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:18:47.811270 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaacff80-cab4-4e47-9870-a44ab212b1c0 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:18:47.813064 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 592/1199] 10.222.0.60 () {56 vars in 1186 bytes} [Sat Jul 2 03:18:47 2022] GET /identity/v3/projects/4bf8103108654479af62e5a2d98a3655 => generated 361 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:18:47.819573 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d5dc0-5b7c-4d50-95fa-cf76d2cc87f4 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:18:47.851914 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:18:47.929916 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d5dc0-5b7c-4d50-95fa-cf76d2cc87f4 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:18:47.974301 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8344b0-e58e-4a41-8bfe-e6ef29b54d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:18:47.975194 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8344b0-e58e-4a41-8bfe-e6ef29b54d24 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:18:47.975602 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8344b0-e58e-4a41-8bfe-e6ef29b54d24 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:18:47.975959 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8344b0-e58e-4a41-8bfe-e6ef29b54d24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:18:47.977329 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8344b0-e58e-4a41-8bfe-e6ef29b54d24 None admin] RBAC: Adding query filter params (role.id=5dcd130cda6c490595e862dc2348e83d, scope.project.id=4bf8103108654479af62e5a2d98a3655, user.id=1b709b5d8b644866b8a06ea4e3adbac2) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:18:47.977753 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8344b0-e58e-4a41-8bfe-e6ef29b54d24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:18:47.980044 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8344b0-e58e-4a41-8bfe-e6ef29b54d24 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:18:47.989804 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 608/1200] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Jul 2 03:18:47 2022] GET /identity/v3/role_assignments?user.id=1b709b5d8b644866b8a06ea4e3adbac2&scope.project.id=4bf8103108654479af62e5a2d98a3655&role.id=5dcd130cda6c490595e862dc2348e83d => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:18:57.799495 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=66 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:18:57.984936 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=53 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:19:42.864618 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069db0f-0fda-46ad-8865-fab4fd0d2057 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:19:42.865280 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069db0f-0fda-46ad-8865-fab4fd0d2057 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:19:42.865415 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069db0f-0fda-46ad-8865-fab4fd0d2057 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:19:42.867080 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 593/1201] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:19:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:19:42.874388 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce1a21-eac3-4eb0-b438-39f81da105fc None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:19:42.874857 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce1a21-eac3-4eb0-b438-39f81da105fc None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:19:42.874976 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce1a21-eac3-4eb0-b438-39f81da105fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:19:42.893420 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-08ce1a21-eac3-4eb0-b438-39f81da105fc None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:19:42.894634 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-08ce1a21-eac3-4eb0-b438-39f81da105fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:19:42.977053 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 609/1202] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:19:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 03:19:43.002105 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e069db0f-0fda-46ad-8865-fab4fd0d2057 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:19:43.125647 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e069db0f-0fda-46ad-8865-fab4fd0d2057 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:19:43.169907 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84446bf-573a-459f-94bc-44a6c6bba1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:19:43.170708 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84446bf-573a-459f-94bc-44a6c6bba1b5 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:19:43.170992 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84446bf-573a-459f-94bc-44a6c6bba1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:19:43.171322 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84446bf-573a-459f-94bc-44a6c6bba1b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:19:43.184203 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84446bf-573a-459f-94bc-44a6c6bba1b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:19:43.186086 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84446bf-573a-459f-94bc-44a6c6bba1b5 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:19:43.206318 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-d84446bf-573a-459f-94bc-44a6c6bba1b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:19:43.206318 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:19:43.206318 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:19:43.206318 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:19:43.206318 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:19:43.206318 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:19:43.206318 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:19:43.206318 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:19:43.206318 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:19:43.206318 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:19:43.206318 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:19:43.206318 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:19:43.206318 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:19:43.206318 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:19:43.206318 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:19:43.207542 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:19:43.207542 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:19:43.207542 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:19:43.207542 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:19:43.207542 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:19:43.207542 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:19:43.207542 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:19:43.207542 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:19:43.207542 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:19:43.207542 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:19:43.207542 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:19:43.207542 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:19:43.207542 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:19:43.207542 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:19:43.207542 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:19:43.207542 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:19:43.207542 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:19:43.212130 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:19:43.212130 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:19:43.212130 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:19:43.212130 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:19:43.212130 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 594/1203] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:19:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 03:19:43.213888 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ce1a21-eac3-4eb0-b438-39f81da105fc None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:19:43.329454 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ce1a21-eac3-4eb0-b438-39f81da105fc None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:19:43.366828 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:19:43.379289 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551a2b0d-97af-46f1-bb32-8ced3e92f76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:19:43.380124 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a2b0d-97af-46f1-bb32-8ced3e92f76b None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:19:43.380408 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a2b0d-97af-46f1-bb32-8ced3e92f76b None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:19:43.380679 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a2b0d-97af-46f1-bb32-8ced3e92f76b None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:19:43.381418 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551a2b0d-97af-46f1-bb32-8ced3e92f76b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:19:43.381720 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551a2b0d-97af-46f1-bb32-8ced3e92f76b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:19:43.383092 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551a2b0d-97af-46f1-bb32-8ced3e92f76b None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:19:43.397807 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 610/1204] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:19:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:19:43.404240 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84446bf-573a-459f-94bc-44a6c6bba1b5 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:19:43.467899 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:19:43.538147 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84446bf-573a-459f-94bc-44a6c6bba1b5 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:19:43.574176 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3a207e-c590-4d90-bc56-181397928e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:19:43.575283 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a207e-c590-4d90-bc56-181397928e5e None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:19:43.575759 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a207e-c590-4d90-bc56-181397928e5e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:19:43.576187 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a207e-c590-4d90-bc56-181397928e5e None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:19:43.577042 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3a207e-c590-4d90-bc56-181397928e5e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:19:43.578643 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3a207e-c590-4d90-bc56-181397928e5e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:19:43.606981 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 595/1205] 10.222.0.60 () {60 vars in 1132 bytes} [Sat Jul 2 03:19:43 2022] POST /identity/v3/users => generated 251 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:19:45.818816 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed5994-a895-45d8-9ee0-32f9510fbfcb None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:19:45.819466 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed5994-a895-45d8-9ee0-32f9510fbfcb None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:19:45.819598 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed5994-a895-45d8-9ee0-32f9510fbfcb None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:19:45.821332 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 611/1206] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:19:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:19:45.826778 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c45df1-56af-4948-90d2-a5e206dd9da4 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:19:45.827283 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c45df1-56af-4948-90d2-a5e206dd9da4 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:19:45.827370 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c45df1-56af-4948-90d2-a5e206dd9da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:19:45.845428 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-f6c45df1-56af-4948-90d2-a5e206dd9da4 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:19:45.846640 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f6c45df1-56af-4948-90d2-a5e206dd9da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:19:45.926962 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 596/1207] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:19:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 03:19:45.951414 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ed5994-a895-45d8-9ee0-32f9510fbfcb None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:19:46.075768 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ed5994-a895-45d8-9ee0-32f9510fbfcb None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:19:46.115772 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e418ed8-8fd1-4ad3-8bfd-25d29f8d7b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:19:46.116568 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e418ed8-8fd1-4ad3-8bfd-25d29f8d7b96 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:19:46.116898 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e418ed8-8fd1-4ad3-8bfd-25d29f8d7b96 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:19:46.117236 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e418ed8-8fd1-4ad3-8bfd-25d29f8d7b96 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:19:46.128738 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e418ed8-8fd1-4ad3-8bfd-25d29f8d7b96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:19:46.136829 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-2e418ed8-8fd1-4ad3-8bfd-25d29f8d7b96 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 02 03:19:46.136829 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:19:46.136829 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:19:46.136829 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:19:46.136829 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:19:46.136829 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:19:46.136829 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:19:46.136829 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:19:46.136829 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:19:46.136829 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:19:46.136829 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:19:46.136829 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:19:46.136829 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:19:46.136829 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:19:46.136829 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:19:46.136829 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:19:46.137819 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:19:46.137819 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:19:46.137819 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:19:46.137819 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:19:46.137819 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:19:46.137819 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:19:46.137819 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:19:46.137819 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:19:46.137819 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:19:46.137819 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:19:46.137819 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:19:46.137819 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:19:46.137819 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:19:46.137819 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:19:46.137819 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:19:46.137819 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:19:46.138688 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:19:46.138688 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:19:46.138688 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:19:46.138688 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:19:46.138688 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:19:46.138688 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:19:46.138688 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:19:46.138688 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:19:46.138688 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:19:46.138688 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:19:46.138688 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 02 03:19:46.138688 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:19:46.138688 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 612/1208] 10.222.0.60 () {56 vars in 1102 bytes} [Sat Jul 2 03:19:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:19:46.144134 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c45df1-56af-4948-90d2-a5e206dd9da4 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:19:46.187626 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:19:46.253506 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c45df1-56af-4948-90d2-a5e206dd9da4 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:19:46.299852 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adddf081-c04f-4949-9684-0a3d770b6d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:19:46.300601 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adddf081-c04f-4949-9684-0a3d770b6d59 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:19:46.300849 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adddf081-c04f-4949-9684-0a3d770b6d59 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:19:46.301140 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adddf081-c04f-4949-9684-0a3d770b6d59 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:19:46.301988 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adddf081-c04f-4949-9684-0a3d770b6d59 None admin] RBAC: Adding query filter params (name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:19:46.302294 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adddf081-c04f-4949-9684-0a3d770b6d59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:19:46.303749 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adddf081-c04f-4949-9684-0a3d770b6d59 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:19:46.313193 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 597/1209] 10.222.0.60 () {56 vars in 1103 bytes} [Sat Jul 2 03:19:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:19:46.318768 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e418ed8-8fd1-4ad3-8bfd-25d29f8d7b96 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:19:46.381123 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:19:46.444487 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e418ed8-8fd1-4ad3-8bfd-25d29f8d7b96 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:19:46.483591 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcc6226-3221-424d-b5ca-41d64831f262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:19:46.484381 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc6226-3221-424d-b5ca-41d64831f262 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:19:46.484658 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc6226-3221-424d-b5ca-41d64831f262 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:19:46.484928 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc6226-3221-424d-b5ca-41d64831f262 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:19:46.497162 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcc6226-3221-424d-b5ca-41d64831f262 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:19:46.498697 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcc6226-3221-424d-b5ca-41d64831f262 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:19:46.516327 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-bbcc6226-3221-424d-b5ca-41d64831f262 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:19:46.516327 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:19:46.516327 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:19:46.516327 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:19:46.516327 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:19:46.516327 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:19:46.516327 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:19:46.516327 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:19:46.516327 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:19:46.516327 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:19:46.516327 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:19:46.516327 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:19:46.516327 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:19:46.516327 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:19:46.516327 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:19:46.517297 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:19:46.517297 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:19:46.517297 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:19:46.517297 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:19:46.517297 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:19:46.517297 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:19:46.517297 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:19:46.517297 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:19:46.517297 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:19:46.517297 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:19:46.517297 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:19:46.517297 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:19:46.517297 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:19:46.517297 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:19:46.517297 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:19:46.517297 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:19:46.517297 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:19:46.518203 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:19:46.518203 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:19:46.518203 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:19:46.518203 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:19:46.518203 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 613/1210] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:19:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:19:46.523980 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adddf081-c04f-4949-9684-0a3d770b6d59 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:19:46.631153 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:19:46.634117 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adddf081-c04f-4949-9684-0a3d770b6d59 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:19:46.672082 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116cc6b7-2f8e-4fad-bfba-293c156f11d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:19:46.672768 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116cc6b7-2f8e-4fad-bfba-293c156f11d3 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:19:46.673042 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116cc6b7-2f8e-4fad-bfba-293c156f11d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:19:46.673308 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116cc6b7-2f8e-4fad-bfba-293c156f11d3 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:19:46.674063 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116cc6b7-2f8e-4fad-bfba-293c156f11d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:19:46.674456 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116cc6b7-2f8e-4fad-bfba-293c156f11d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:19:46.675917 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116cc6b7-2f8e-4fad-bfba-293c156f11d3 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:19:46.688101 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 598/1211] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:19:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:19:46.693711 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcc6226-3221-424d-b5ca-41d64831f262 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:19:46.801937 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcc6226-3221-424d-b5ca-41d64831f262 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:19:46.803579 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:19:46.842443 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd30398-2e7a-4b99-bc38-cebda52ed194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:19:46.843306 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd30398-2e7a-4b99-bc38-cebda52ed194 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:19:46.843584 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd30398-2e7a-4b99-bc38-cebda52ed194 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:19:46.843869 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd30398-2e7a-4b99-bc38-cebda52ed194 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:19:46.852351 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd30398-2e7a-4b99-bc38-cebda52ed194 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:19:46.853789 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd30398-2e7a-4b99-bc38-cebda52ed194 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:19:46.870249 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-6fd30398-2e7a-4b99-bc38-cebda52ed194 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 02 03:19:46.870249 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:19:46.870249 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:19:46.870249 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:19:46.870249 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:19:46.870249 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:19:46.870249 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:19:46.870249 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:19:46.870249 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:19:46.870249 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:19:46.870249 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:19:46.870249 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:19:46.870249 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 03:19:46.870249 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 03:19:46.870249 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 03:19:46.870249 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 03:19:46.871329 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:19:46.871329 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:19:46.871329 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 03:19:46.871329 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 03:19:46.871329 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 03:19:46.871329 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 03:19:46.871329 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:19:46.871329 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:19:46.871329 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:19:46.871329 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:19:46.871329 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:19:46.871329 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:19:46.871329 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:19:46.871329 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:19:46.871329 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:19:46.871329 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:19:46.871329 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:19:46.871329 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:19:46.872302 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:19:46.872302 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:19:46.872302 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 03:19:46.872302 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 03:19:46.872302 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 03:19:46.872302 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 03:19:46.872302 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 03:19:46.872302 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 03:19:46.872302 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 02 03:19:46.872302 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:19:46.872302 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 614/1212] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:19:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:19:46.877451 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116cc6b7-2f8e-4fad-bfba-293c156f11d3 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:19:46.995934 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116cc6b7-2f8e-4fad-bfba-293c156f11d3 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:19:47.033545 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e97ac-2532-4b60-afa1-5ef45d8a9f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:19:47.034271 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e97ac-2532-4b60-afa1-5ef45d8a9f16 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:19:47.034869 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e97ac-2532-4b60-afa1-5ef45d8a9f16 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:19:47.035201 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e97ac-2532-4b60-afa1-5ef45d8a9f16 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:19:47.036222 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484e97ac-2532-4b60-afa1-5ef45d8a9f16 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:19:47.036570 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484e97ac-2532-4b60-afa1-5ef45d8a9f16 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:19:47.038164 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484e97ac-2532-4b60-afa1-5ef45d8a9f16 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:19:47.059020 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 599/1213] 10.222.0.60 () {56 vars in 1143 bytes} [Sat Jul 2 03:19:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:19:47.063404 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd30398-2e7a-4b99-bc38-cebda52ed194 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:19:47.190940 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd30398-2e7a-4b99-bc38-cebda52ed194 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:19:47.228230 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf69f94-bdb4-4c92-a942-5b44dea20c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:19:47.229047 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf69f94-bdb4-4c92-a942-5b44dea20c1d None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:19:47.229488 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf69f94-bdb4-4c92-a942-5b44dea20c1d None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:19:47.229729 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf69f94-bdb4-4c92-a942-5b44dea20c1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:19:47.273102 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:19:47.317718 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf69f94-bdb4-4c92-a942-5b44dea20c1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:19:47.319528 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf69f94-bdb4-4c92-a942-5b44dea20c1d None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:19:47.437615 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 615/1214] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Jul 2 03:19:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 02 03:19:47.443657 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e97ac-2532-4b60-afa1-5ef45d8a9f16 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:19:47.463564 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:19:47.556831 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e97ac-2532-4b60-afa1-5ef45d8a9f16 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:19:47.594269 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e586c6-c8dd-4674-aac4-ec94d394a50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:19:47.595234 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e586c6-c8dd-4674-aac4-ec94d394a50e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:19:47.596740 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e586c6-c8dd-4674-aac4-ec94d394a50e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:19:47.596740 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e586c6-c8dd-4674-aac4-ec94d394a50e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:19:47.606967 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e586c6-c8dd-4674-aac4-ec94d394a50e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:19:47.608749 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e586c6-c8dd-4674-aac4-ec94d394a50e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:19:47.634369 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-52e586c6-c8dd-4674-aac4-ec94d394a50e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:19:47.634369 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:19:47.634369 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:19:47.634369 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:19:47.634369 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:19:47.634369 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:19:47.634369 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:19:47.634369 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:19:47.634369 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:19:47.634369 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:19:47.634369 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:19:47.634369 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:19:47.634369 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:19:47.634369 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:19:47.634369 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:19:47.635707 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:19:47.635707 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:19:47.635707 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:19:47.635707 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:19:47.635707 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:19:47.635707 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:19:47.635707 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:19:47.635707 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:19:47.635707 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:19:47.635707 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:19:47.635707 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:19:47.635707 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:19:47.635707 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:19:47.635707 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:19:47.635707 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:19:47.635707 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:19:47.635707 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:19:47.636805 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:19:47.636805 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:19:47.636805 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:19:47.636805 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:19:47.636805 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 600/1215] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:19:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 03:19:47.641522 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf69f94-bdb4-4c92-a942-5b44dea20c1d None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:19:47.712406 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:19:47.752387 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf69f94-bdb4-4c92-a942-5b44dea20c1d None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:19:47.792784 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74d2a09-7f17-4352-9b5b-a075cb92f9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:19:47.793829 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d2a09-7f17-4352-9b5b-a075cb92f9ed None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:19:47.794310 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d2a09-7f17-4352-9b5b-a075cb92f9ed None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:19:47.794779 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d2a09-7f17-4352-9b5b-a075cb92f9ed None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:19:47.796134 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74d2a09-7f17-4352-9b5b-a075cb92f9ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:19:47.796667 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74d2a09-7f17-4352-9b5b-a075cb92f9ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:19:47.799050 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74d2a09-7f17-4352-9b5b-a075cb92f9ed None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:19:47.815788 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 616/1216] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:19:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:19:47.823252 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e586c6-c8dd-4674-aac4-ec94d394a50e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:19:47.907948 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:19:47.943419 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e586c6-c8dd-4674-aac4-ec94d394a50e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:19:47.980063 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39199ad4-9ae8-4d20-85c6-162079968360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:19:47.983459 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39199ad4-9ae8-4d20-85c6-162079968360 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:19:47.983459 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39199ad4-9ae8-4d20-85c6-162079968360 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:19:47.983459 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39199ad4-9ae8-4d20-85c6-162079968360 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:19:47.989075 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39199ad4-9ae8-4d20-85c6-162079968360 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:19:47.990792 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39199ad4-9ae8-4d20-85c6-162079968360 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:19:48.005468 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-39199ad4-9ae8-4d20-85c6-162079968360 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 03:19:48.005468 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:19:48.005468 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:19:48.005468 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:19:48.005468 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:19:48.005468 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:19:48.005468 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:19:48.005468 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:19:48.005468 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:19:48.005468 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:19:48.005468 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:19:48.005468 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:19:48.005468 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 03:19:48.005468 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 03:19:48.005468 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 03:19:48.006686 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 03:19:48.006686 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:19:48.006686 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:19:48.006686 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:19:48.006686 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:19:48.006686 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:19:48.006686 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:19:48.006686 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:19:48.006686 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:19:48.006686 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:19:48.006686 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:19:48.006686 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:19:48.006686 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:19:48.006686 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:19:48.006686 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:19:48.006686 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:19:48.006686 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:19:48.014650 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 03:19:48.014650 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 03:19:48.014650 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 03:19:48.014650 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 03:19:48.014650 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 03:19:48.014650 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 03:19:48.014650 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 03:19:48.014650 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:19:48.014650 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 601/1217] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Jul 2 03:19:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:19:48.015340 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74d2a09-7f17-4352-9b5b-a075cb92f9ed None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:19:48.128421 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74d2a09-7f17-4352-9b5b-a075cb92f9ed None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:19:48.160081 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:19:48.173402 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5f8a17-e217-495d-aee2-79bedbb1a698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:19:48.174233 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f8a17-e217-495d-aee2-79bedbb1a698 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:19:48.174605 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f8a17-e217-495d-aee2-79bedbb1a698 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:19:48.174967 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f8a17-e217-495d-aee2-79bedbb1a698 None admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:19:48.175875 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5f8a17-e217-495d-aee2-79bedbb1a698 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:19:48.176275 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5f8a17-e217-495d-aee2-79bedbb1a698 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:19:48.177819 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5f8a17-e217-495d-aee2-79bedbb1a698 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:19:48.195461 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 617/1218] 10.222.0.60 () {56 vars in 1148 bytes} [Sat Jul 2 03:19:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:19:48.196675 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39199ad4-9ae8-4d20-85c6-162079968360 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:19:48.317257 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39199ad4-9ae8-4d20-85c6-162079968360 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:19:48.347340 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:19:48.354431 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db18138-4e4d-4189-a863-1ea1ed3c13c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:19:48.355137 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db18138-4e4d-4189-a863-1ea1ed3c13c3 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:19:48.355526 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db18138-4e4d-4189-a863-1ea1ed3c13c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:19:48.355803 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db18138-4e4d-4189-a863-1ea1ed3c13c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:19:48.356699 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db18138-4e4d-4189-a863-1ea1ed3c13c3 None admin] RBAC: Adding query filter params (role.id=3c71d0e875cd4a00849f14227be8f7ed, scope.project.id=e09dc5d9d4904c2b89b0cabed237d55e, user.id=9dafc9be75a64db095fe08b9cbb04cbd) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:19:48.357015 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db18138-4e4d-4189-a863-1ea1ed3c13c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:19:48.358485 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db18138-4e4d-4189-a863-1ea1ed3c13c3 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:19:48.371176 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 602/1219] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Jul 2 03:19:48 2022] GET /identity/v3/role_assignments?user.id=9dafc9be75a64db095fe08b9cbb04cbd&scope.project.id=e09dc5d9d4904c2b89b0cabed237d55e&role.id=3c71d0e875cd4a00849f14227be8f7ed => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:19:50.500461 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94129174-47a5-4158-abc3-6b61f9c492e4 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:19:50.501025 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94129174-47a5-4158-abc3-6b61f9c492e4 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:19:50.501025 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94129174-47a5-4158-abc3-6b61f9c492e4 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:19:50.502384 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 618/1220] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:19:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:19:50.508236 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce12c02f-e2fa-4858-83dc-d211076ef568 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:19:50.508667 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce12c02f-e2fa-4858-83dc-d211076ef568 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:19:50.508786 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce12c02f-e2fa-4858-83dc-d211076ef568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:19:50.527319 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-ce12c02f-e2fa-4858-83dc-d211076ef568 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:19:50.528613 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ce12c02f-e2fa-4858-83dc-d211076ef568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:19:50.599776 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 603/1221] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:19:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 02 03:19:50.625172 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94129174-47a5-4158-abc3-6b61f9c492e4 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:19:50.739385 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94129174-47a5-4158-abc3-6b61f9c492e4 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:19:50.777369 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35041ff6-996e-4c40-bc8a-0a072ae6be6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:19:50.778155 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35041ff6-996e-4c40-bc8a-0a072ae6be6c None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:19:50.778431 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35041ff6-996e-4c40-bc8a-0a072ae6be6c None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:19:50.778700 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35041ff6-996e-4c40-bc8a-0a072ae6be6c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:19:50.789676 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35041ff6-996e-4c40-bc8a-0a072ae6be6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:19:50.797559 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-35041ff6-996e-4c40-bc8a-0a072ae6be6c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 02 03:19:50.797559 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:19:50.797559 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:19:50.797559 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:19:50.797559 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:19:50.797559 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:19:50.797559 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:19:50.797559 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:19:50.797559 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:19:50.797559 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:19:50.797559 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:19:50.797559 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:19:50.797559 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:19:50.797559 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:19:50.797559 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:19:50.797559 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:19:50.798957 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:19:50.798957 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:19:50.798957 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:19:50.798957 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:19:50.798957 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:19:50.798957 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:19:50.798957 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:19:50.798957 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:19:50.798957 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:19:50.798957 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:19:50.798957 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:19:50.798957 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:19:50.798957 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:19:50.798957 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:19:50.798957 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:19:50.798957 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:19:50.800048 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:19:50.800048 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:19:50.800048 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:19:50.800048 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:19:50.800048 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:19:50.800048 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:19:50.800048 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:19:50.800048 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:19:50.800048 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:19:50.800048 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:19:50.800048 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 02 03:19:50.800048 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:19:50.800048 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 619/1222] 10.222.0.60 () {56 vars in 1102 bytes} [Sat Jul 2 03:19:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:19:50.806139 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce12c02f-e2fa-4858-83dc-d211076ef568 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:19:50.910301 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce12c02f-e2fa-4858-83dc-d211076ef568 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:19:50.939054 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:19:50.951431 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8743bd-e4a3-4458-b269-1dc8957d91aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:19:50.952095 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8743bd-e4a3-4458-b269-1dc8957d91aa None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:19:50.952394 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8743bd-e4a3-4458-b269-1dc8957d91aa None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:19:50.952641 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8743bd-e4a3-4458-b269-1dc8957d91aa None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:19:50.953487 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8743bd-e4a3-4458-b269-1dc8957d91aa None admin] RBAC: Adding query filter params (name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:19:50.953788 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8743bd-e4a3-4458-b269-1dc8957d91aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:19:50.955256 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8743bd-e4a3-4458-b269-1dc8957d91aa None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:19:50.966033 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 604/1223] 10.222.0.60 () {56 vars in 1103 bytes} [Sat Jul 2 03:19:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:19:50.971935 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35041ff6-996e-4c40-bc8a-0a072ae6be6c None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:19:51.023080 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:19:51.091242 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35041ff6-996e-4c40-bc8a-0a072ae6be6c None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:19:51.129962 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254ecd3c-4d42-41dc-a1b2-3b5a2896f6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:19:51.130858 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ecd3c-4d42-41dc-a1b2-3b5a2896f6f0 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:19:51.131166 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ecd3c-4d42-41dc-a1b2-3b5a2896f6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:19:51.131467 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ecd3c-4d42-41dc-a1b2-3b5a2896f6f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:19:51.143641 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254ecd3c-4d42-41dc-a1b2-3b5a2896f6f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:19:51.145097 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254ecd3c-4d42-41dc-a1b2-3b5a2896f6f0 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:19:51.162332 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-254ecd3c-4d42-41dc-a1b2-3b5a2896f6f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:19:51.162332 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:19:51.162332 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:19:51.162332 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:19:51.162332 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:19:51.162332 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:19:51.162332 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:19:51.162332 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:19:51.162332 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:19:51.162332 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:19:51.162332 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:19:51.162332 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:19:51.162332 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:19:51.162332 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:19:51.162332 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:19:51.168310 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:19:51.168310 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:19:51.168310 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:19:51.168310 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:19:51.168310 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:19:51.168310 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:19:51.168310 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:19:51.168310 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:19:51.168310 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:19:51.168310 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:19:51.168310 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:19:51.168310 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:19:51.168310 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:19:51.168310 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:19:51.168310 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:19:51.168310 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:19:51.168310 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:19:51.169334 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:19:51.169334 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:19:51.169334 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:19:51.169334 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:19:51.169334 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 620/1224] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:19:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 03:19:51.169636 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8743bd-e4a3-4458-b269-1dc8957d91aa None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:19:51.276861 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8743bd-e4a3-4458-b269-1dc8957d91aa None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:19:51.312363 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f7a318-2b5e-4b6d-aaf9-f7f8273f8c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:19:51.313062 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7a318-2b5e-4b6d-aaf9-f7f8273f8c94 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:19:51.313375 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7a318-2b5e-4b6d-aaf9-f7f8273f8c94 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:19:51.313732 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7a318-2b5e-4b6d-aaf9-f7f8273f8c94 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:19:51.314519 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f7a318-2b5e-4b6d-aaf9-f7f8273f8c94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:19:51.314870 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f7a318-2b5e-4b6d-aaf9-f7f8273f8c94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:19:51.316447 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f7a318-2b5e-4b6d-aaf9-f7f8273f8c94 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:19:51.330617 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 605/1225] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:19:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:19:51.336588 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254ecd3c-4d42-41dc-a1b2-3b5a2896f6f0 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:19:51.438570 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:19:51.446129 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254ecd3c-4d42-41dc-a1b2-3b5a2896f6f0 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:19:51.482402 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5add1f-43a3-45c3-b1f1-6cbe8357e7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:19:51.483245 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5add1f-43a3-45c3-b1f1-6cbe8357e7b6 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:19:51.483528 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5add1f-43a3-45c3-b1f1-6cbe8357e7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:19:51.483804 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5add1f-43a3-45c3-b1f1-6cbe8357e7b6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:19:51.491752 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5add1f-43a3-45c3-b1f1-6cbe8357e7b6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:19:51.493238 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5add1f-43a3-45c3-b1f1-6cbe8357e7b6 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:19:51.507728 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-ab5add1f-43a3-45c3-b1f1-6cbe8357e7b6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 02 03:19:51.507728 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:19:51.507728 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:19:51.507728 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:19:51.507728 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:19:51.507728 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:19:51.507728 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:19:51.507728 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:19:51.507728 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:19:51.507728 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:19:51.507728 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:19:51.507728 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:19:51.507728 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 03:19:51.507728 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 03:19:51.507728 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 03:19:51.507728 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 03:19:51.509169 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:19:51.509169 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:19:51.509169 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 03:19:51.509169 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 03:19:51.509169 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 03:19:51.509169 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 03:19:51.509169 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:19:51.509169 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:19:51.509169 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:19:51.509169 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:19:51.509169 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:19:51.509169 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:19:51.509169 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:19:51.509169 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:19:51.509169 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:19:51.509169 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:19:51.509169 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:19:51.509169 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:19:51.510150 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:19:51.510150 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:19:51.510150 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 03:19:51.510150 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 03:19:51.510150 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 03:19:51.510150 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 03:19:51.510150 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 03:19:51.510150 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 03:19:51.510150 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 02 03:19:51.510150 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:19:51.510150 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 621/1226] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:19:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:19:51.514815 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f7a318-2b5e-4b6d-aaf9-f7f8273f8c94 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:19:51.565693 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:19:51.623975 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f7a318-2b5e-4b6d-aaf9-f7f8273f8c94 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:19:51.666900 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f051037-ea9b-4481-b0d8-eefb028c6707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:19:51.667598 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f051037-ea9b-4481-b0d8-eefb028c6707 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:19:51.667880 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f051037-ea9b-4481-b0d8-eefb028c6707 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:19:51.668148 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f051037-ea9b-4481-b0d8-eefb028c6707 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:19:51.669146 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f051037-ea9b-4481-b0d8-eefb028c6707 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:19:51.669553 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f051037-ea9b-4481-b0d8-eefb028c6707 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:19:51.671423 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f051037-ea9b-4481-b0d8-eefb028c6707 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:19:51.690796 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 606/1227] 10.222.0.60 () {56 vars in 1143 bytes} [Sat Jul 2 03:19:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:19:51.696541 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5add1f-43a3-45c3-b1f1-6cbe8357e7b6 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:19:51.805184 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5add1f-43a3-45c3-b1f1-6cbe8357e7b6 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:19:51.843771 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f56e113-044c-4f58-ac9b-988541dd6d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:19:51.844573 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f56e113-044c-4f58-ac9b-988541dd6d7c None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:19:51.844853 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f56e113-044c-4f58-ac9b-988541dd6d7c None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:19:51.845125 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f56e113-044c-4f58-ac9b-988541dd6d7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:19:51.858745 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f56e113-044c-4f58-ac9b-988541dd6d7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:19:51.860494 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f56e113-044c-4f58-ac9b-988541dd6d7c None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:19:51.880257 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-1f56e113-044c-4f58-ac9b-988541dd6d7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:19:51.880257 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:19:51.880257 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:19:51.880257 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:19:51.880257 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:19:51.880257 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:19:51.880257 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:19:51.880257 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:19:51.880257 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:19:51.880257 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:19:51.880257 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:19:51.880257 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:19:51.880257 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:19:51.880257 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:19:51.880257 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:19:51.881414 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:19:51.881414 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:19:51.881414 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:19:51.881414 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:19:51.881414 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:19:51.881414 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:19:51.881414 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:19:51.881414 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:19:51.881414 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:19:51.881414 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:19:51.881414 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:19:51.881414 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:19:51.881414 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:19:51.881414 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:19:51.881414 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:19:51.881414 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:19:51.881414 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:19:51.882360 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:19:51.882360 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:19:51.882360 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:19:51.882360 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:19:51.882360 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 622/1228] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:19:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:19:51.887684 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f051037-ea9b-4481-b0d8-eefb028c6707 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:19:51.993487 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f051037-ea9b-4481-b0d8-eefb028c6707 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:19:51.995910 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:19:52.030542 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb7d1ca-f710-4379-b3e9-f84dd47e2035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:19:52.031261 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb7d1ca-f710-4379-b3e9-f84dd47e2035 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:19:52.031601 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb7d1ca-f710-4379-b3e9-f84dd47e2035 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:19:52.031865 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb7d1ca-f710-4379-b3e9-f84dd47e2035 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:19:52.032640 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb7d1ca-f710-4379-b3e9-f84dd47e2035 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:19:52.032972 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb7d1ca-f710-4379-b3e9-f84dd47e2035 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:19:52.034818 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb7d1ca-f710-4379-b3e9-f84dd47e2035 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:19:52.052212 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 607/1229] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:19:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:19:52.053409 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f56e113-044c-4f58-ac9b-988541dd6d7c None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:19:52.064117 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:19:52.166737 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f56e113-044c-4f58-ac9b-988541dd6d7c None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:19:52.199877 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72abb75-200f-41af-bd94-92ebda3ca3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:19:52.200688 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72abb75-200f-41af-bd94-92ebda3ca3cc None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:19:52.200968 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72abb75-200f-41af-bd94-92ebda3ca3cc None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:19:52.201239 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72abb75-200f-41af-bd94-92ebda3ca3cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:19:52.208484 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72abb75-200f-41af-bd94-92ebda3ca3cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:19:52.209921 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72abb75-200f-41af-bd94-92ebda3ca3cc None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:19:52.224160 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-d72abb75-200f-41af-bd94-92ebda3ca3cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 03:19:52.224160 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:19:52.224160 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:19:52.224160 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:19:52.224160 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:19:52.224160 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:19:52.224160 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:19:52.224160 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:19:52.224160 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:19:52.224160 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:19:52.224160 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:19:52.224160 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:19:52.224160 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 03:19:52.224160 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 03:19:52.224160 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 03:19:52.225198 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 03:19:52.225198 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:19:52.225198 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:19:52.225198 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:19:52.225198 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:19:52.225198 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:19:52.225198 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:19:52.225198 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:19:52.225198 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:19:52.225198 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:19:52.225198 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:19:52.225198 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:19:52.225198 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:19:52.225198 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:19:52.225198 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:19:52.225198 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:19:52.225198 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:19:52.226084 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 03:19:52.226084 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 03:19:52.226084 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 03:19:52.226084 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 03:19:52.226084 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 03:19:52.226084 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 03:19:52.226084 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 03:19:52.226084 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:19:52.226084 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 623/1230] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Jul 2 03:19:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:19:52.231636 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb7d1ca-f710-4379-b3e9-f84dd47e2035 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:19:52.346861 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb7d1ca-f710-4379-b3e9-f84dd47e2035 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:19:52.384877 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165cd60a-171e-4634-856c-1055b3e759c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:19:52.385653 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165cd60a-171e-4634-856c-1055b3e759c6 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:19:52.386005 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165cd60a-171e-4634-856c-1055b3e759c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:19:52.386284 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165cd60a-171e-4634-856c-1055b3e759c6 None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:19:52.387181 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165cd60a-171e-4634-856c-1055b3e759c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:19:52.387578 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165cd60a-171e-4634-856c-1055b3e759c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:19:52.389321 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165cd60a-171e-4634-856c-1055b3e759c6 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:19:52.403500 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 608/1231] 10.222.0.60 () {56 vars in 1148 bytes} [Sat Jul 2 03:19:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:19:52.409985 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72abb75-200f-41af-bd94-92ebda3ca3cc None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:19:52.483046 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:19:52.521636 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72abb75-200f-41af-bd94-92ebda3ca3cc None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:19:52.556140 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d930e987-721f-49da-bd94-5d97f9dbe1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:19:52.557028 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930e987-721f-49da-bd94-5d97f9dbe1fb None admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:19:52.557306 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930e987-721f-49da-bd94-5d97f9dbe1fb None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:19:52.557579 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930e987-721f-49da-bd94-5d97f9dbe1fb None admin] PATH_INFO: `/v3/projects/e09dc5d9d4904c2b89b0cabed237d55e/users/9dafc9be75a64db095fe08b9cbb04cbd/roles/3c71d0e875cd4a00849f14227be8f7ed` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:19:52.572352 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d930e987-721f-49da-bd94-5d97f9dbe1fb None admin] RBAC: Authorizing `identity:create_grant(project_id=e09dc5d9d4904c2b89b0cabed237d55e, user_id=9dafc9be75a64db095fe08b9cbb04cbd, role_id=3c71d0e875cd4a00849f14227be8f7ed)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:19:52.573794 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d930e987-721f-49da-bd94-5d97f9dbe1fb None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:19:52.589165 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 624/1232] 10.222.0.60 () {58 vars in 1439 bytes} [Sat Jul 2 03:19:52 2022] PUT /identity/v3/projects/e09dc5d9d4904c2b89b0cabed237d55e/users/9dafc9be75a64db095fe08b9cbb04cbd/roles/3c71d0e875cd4a00849f14227be8f7ed => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:19:54.681247 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57928e6b-cef5-4afe-8eff-073b9f46cb07 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:19:54.681795 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57928e6b-cef5-4afe-8eff-073b9f46cb07 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:19:54.681795 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57928e6b-cef5-4afe-8eff-073b9f46cb07 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:19:54.683289 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 609/1233] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:19:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:19:54.688579 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6ee0c-88b2-4f43-ad65-1e7539a44f72 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:19:54.689062 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6ee0c-88b2-4f43-ad65-1e7539a44f72 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:19:54.689154 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6ee0c-88b2-4f43-ad65-1e7539a44f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:19:54.707226 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-a2b6ee0c-88b2-4f43-ad65-1e7539a44f72 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:19:54.708608 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-a2b6ee0c-88b2-4f43-ad65-1e7539a44f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:19:54.779110 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 625/1234] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:19:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 03:19:54.804852 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57928e6b-cef5-4afe-8eff-073b9f46cb07 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:19:54.829395 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:19:54.907218 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57928e6b-cef5-4afe-8eff-073b9f46cb07 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:19:54.942763 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0206c995-b334-4718-b38c-aeb49ab70311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:19:54.943514 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0206c995-b334-4718-b38c-aeb49ab70311 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:19:54.943801 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0206c995-b334-4718-b38c-aeb49ab70311 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:19:54.944074 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0206c995-b334-4718-b38c-aeb49ab70311 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:19:54.954674 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0206c995-b334-4718-b38c-aeb49ab70311 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:19:54.962456 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-0206c995-b334-4718-b38c-aeb49ab70311 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 02 03:19:54.962456 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:19:54.962456 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:19:54.962456 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:19:54.962456 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:19:54.962456 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:19:54.962456 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:19:54.962456 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:19:54.962456 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:19:54.962456 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:19:54.962456 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:19:54.962456 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:19:54.962456 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:19:54.962456 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:19:54.962456 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:19:54.962456 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:19:54.963597 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:19:54.963597 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:19:54.963597 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:19:54.963597 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:19:54.963597 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:19:54.963597 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:19:54.963597 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:19:54.963597 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:19:54.963597 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:19:54.963597 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:19:54.963597 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:19:54.963597 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:19:54.963597 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:19:54.963597 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:19:54.963597 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:19:54.963597 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:19:54.964497 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:19:54.964497 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:19:54.964497 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:19:54.964497 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:19:54.964497 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:19:54.964497 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:19:54.964497 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:19:54.964497 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:19:54.964497 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:19:54.964497 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:19:54.964497 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 02 03:19:54.964497 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:19:54.964497 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 610/1235] 10.222.0.60 () {56 vars in 1102 bytes} [Sat Jul 2 03:19:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 03:19:54.969947 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b6ee0c-88b2-4f43-ad65-1e7539a44f72 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:19:55.018154 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:19:55.076245 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b6ee0c-88b2-4f43-ad65-1e7539a44f72 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:19:55.113109 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88093ad6-764d-4b50-bf33-e49f159debca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:19:55.114178 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88093ad6-764d-4b50-bf33-e49f159debca None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:19:55.114472 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88093ad6-764d-4b50-bf33-e49f159debca None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:19:55.114767 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88093ad6-764d-4b50-bf33-e49f159debca None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:19:55.115574 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88093ad6-764d-4b50-bf33-e49f159debca None admin] RBAC: Adding query filter params (name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:19:55.115912 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88093ad6-764d-4b50-bf33-e49f159debca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:19:55.117403 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88093ad6-764d-4b50-bf33-e49f159debca None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:19:55.126164 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 626/1236] 10.222.0.60 () {56 vars in 1103 bytes} [Sat Jul 2 03:19:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:19:55.132493 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0206c995-b334-4718-b38c-aeb49ab70311 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:19:55.227296 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:19:55.246733 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0206c995-b334-4718-b38c-aeb49ab70311 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:19:55.285475 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfef23b-b322-40a8-aed4-0fd1a7b40f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:19:55.286437 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfef23b-b322-40a8-aed4-0fd1a7b40f97 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:19:55.286721 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfef23b-b322-40a8-aed4-0fd1a7b40f97 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:19:55.286985 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfef23b-b322-40a8-aed4-0fd1a7b40f97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:19:55.298705 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfef23b-b322-40a8-aed4-0fd1a7b40f97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:19:55.300206 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfef23b-b322-40a8-aed4-0fd1a7b40f97 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:19:55.319730 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-7dfef23b-b322-40a8-aed4-0fd1a7b40f97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:19:55.319730 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:19:55.319730 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:19:55.319730 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:19:55.319730 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:19:55.319730 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:19:55.319730 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:19:55.319730 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:19:55.319730 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:19:55.319730 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:19:55.319730 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:19:55.319730 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:19:55.319730 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:19:55.319730 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:19:55.319730 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:19:55.320879 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:19:55.320879 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:19:55.320879 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:19:55.320879 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:19:55.320879 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:19:55.320879 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:19:55.320879 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:19:55.320879 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:19:55.320879 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:19:55.320879 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:19:55.320879 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:19:55.320879 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:19:55.320879 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:19:55.320879 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:19:55.320879 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:19:55.320879 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:19:55.320879 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:19:55.321881 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:19:55.321881 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:19:55.321881 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:19:55.321881 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:19:55.321881 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 611/1237] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:19:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:19:55.327066 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88093ad6-764d-4b50-bf33-e49f159debca None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:19:55.437863 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88093ad6-764d-4b50-bf33-e49f159debca None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:19:55.447576 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:19:55.473738 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693a8bcf-4319-4058-b9a5-c40697a49996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:19:55.474437 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693a8bcf-4319-4058-b9a5-c40697a49996 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:19:55.474738 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693a8bcf-4319-4058-b9a5-c40697a49996 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:19:55.475008 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693a8bcf-4319-4058-b9a5-c40697a49996 None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:19:55.475761 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693a8bcf-4319-4058-b9a5-c40697a49996 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:19:55.476109 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693a8bcf-4319-4058-b9a5-c40697a49996 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:19:55.477680 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693a8bcf-4319-4058-b9a5-c40697a49996 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:19:55.490161 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 627/1238] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:19:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:19:55.496842 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfef23b-b322-40a8-aed4-0fd1a7b40f97 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:19:55.603962 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfef23b-b322-40a8-aed4-0fd1a7b40f97 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:19:55.647538 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1280ff-7515-47f4-827e-a7555fbc8454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:19:55.648425 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1280ff-7515-47f4-827e-a7555fbc8454 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:19:55.648703 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1280ff-7515-47f4-827e-a7555fbc8454 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:19:55.648975 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1280ff-7515-47f4-827e-a7555fbc8454 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:19:55.652344 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:19:55.658555 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1280ff-7515-47f4-827e-a7555fbc8454 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:19:55.660443 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1280ff-7515-47f4-827e-a7555fbc8454 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:19:55.675598 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-1c1280ff-7515-47f4-827e-a7555fbc8454 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 02 03:19:55.675598 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:19:55.675598 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:19:55.675598 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:19:55.675598 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:19:55.675598 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:19:55.675598 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:19:55.675598 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:19:55.675598 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:19:55.675598 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:19:55.675598 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:19:55.675598 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:19:55.675598 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 03:19:55.675598 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 03:19:55.675598 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 03:19:55.675598 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 03:19:55.676728 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:19:55.676728 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:19:55.676728 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 03:19:55.676728 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 03:19:55.676728 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 03:19:55.676728 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 03:19:55.676728 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:19:55.676728 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:19:55.676728 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:19:55.676728 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:19:55.676728 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:19:55.676728 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:19:55.676728 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:19:55.676728 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:19:55.676728 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:19:55.676728 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:19:55.676728 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:19:55.676728 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:19:55.677884 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:19:55.677884 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:19:55.677884 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 03:19:55.677884 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 03:19:55.677884 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 03:19:55.677884 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 03:19:55.677884 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 03:19:55.677884 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 03:19:55.677884 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 02 03:19:55.677884 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:19:55.677884 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 612/1239] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:19:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:19:55.683147 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693a8bcf-4319-4058-b9a5-c40697a49996 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:19:55.797725 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693a8bcf-4319-4058-b9a5-c40697a49996 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:19:55.833821 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a686cf23-375e-4c80-8dc2-761542810c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:19:55.834508 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686cf23-375e-4c80-8dc2-761542810c0c None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:19:55.834790 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686cf23-375e-4c80-8dc2-761542810c0c None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:19:55.835078 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686cf23-375e-4c80-8dc2-761542810c0c None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:19:55.836031 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a686cf23-375e-4c80-8dc2-761542810c0c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:19:55.836368 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a686cf23-375e-4c80-8dc2-761542810c0c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:19:55.837928 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a686cf23-375e-4c80-8dc2-761542810c0c None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:19:55.856724 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 628/1240] 10.222.0.60 () {56 vars in 1143 bytes} [Sat Jul 2 03:19:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:19:55.862880 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1280ff-7515-47f4-827e-a7555fbc8454 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:19:55.980547 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1280ff-7515-47f4-827e-a7555fbc8454 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:19:56.017029 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e7fa7e-7879-4e17-a34d-9bccf9880062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:19:56.017840 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e7fa7e-7879-4e17-a34d-9bccf9880062 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:19:56.018185 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e7fa7e-7879-4e17-a34d-9bccf9880062 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:19:56.018476 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e7fa7e-7879-4e17-a34d-9bccf9880062 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:19:56.088783 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:19:56.096289 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e7fa7e-7879-4e17-a34d-9bccf9880062 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:19:56.097891 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e7fa7e-7879-4e17-a34d-9bccf9880062 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:19:56.217639 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 613/1241] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Jul 2 03:19:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 02 03:19:56.224265 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a686cf23-375e-4c80-8dc2-761542810c0c None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:19:56.255275 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:19:56.339053 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a686cf23-375e-4c80-8dc2-761542810c0c None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:19:56.375317 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea11c29-7331-4354-aa40-4a58ea3368a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:19:56.376158 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea11c29-7331-4354-aa40-4a58ea3368a6 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:19:56.376487 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea11c29-7331-4354-aa40-4a58ea3368a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:19:56.376758 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea11c29-7331-4354-aa40-4a58ea3368a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:19:56.387709 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea11c29-7331-4354-aa40-4a58ea3368a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:19:56.389163 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea11c29-7331-4354-aa40-4a58ea3368a6 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:19:56.406466 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-fea11c29-7331-4354-aa40-4a58ea3368a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:19:56.406466 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:19:56.406466 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:19:56.406466 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:19:56.406466 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:19:56.406466 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:19:56.406466 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:19:56.406466 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:19:56.406466 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:19:56.406466 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:19:56.406466 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:19:56.406466 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:19:56.406466 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:19:56.406466 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:19:56.406466 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:19:56.407503 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:19:56.407503 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:19:56.407503 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:19:56.407503 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:19:56.407503 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:19:56.407503 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:19:56.407503 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:19:56.407503 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:19:56.407503 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:19:56.407503 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:19:56.407503 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:19:56.407503 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:19:56.407503 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:19:56.407503 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:19:56.407503 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:19:56.407503 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:19:56.407503 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:19:56.408428 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:19:56.408428 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:19:56.408428 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:19:56.408428 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:19:56.408896 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 629/1242] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:19:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:19:56.415370 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e7fa7e-7879-4e17-a34d-9bccf9880062 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:19:56.514360 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:19:56.521424 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e7fa7e-7879-4e17-a34d-9bccf9880062 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:19:56.561539 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3a583b-86fe-48ee-bfe3-13ad3a41e443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:19:56.562298 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a583b-86fe-48ee-bfe3-13ad3a41e443 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:19:56.562578 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a583b-86fe-48ee-bfe3-13ad3a41e443 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:19:56.562854 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a583b-86fe-48ee-bfe3-13ad3a41e443 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:19:56.564444 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3a583b-86fe-48ee-bfe3-13ad3a41e443 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:19:56.564444 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3a583b-86fe-48ee-bfe3-13ad3a41e443 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:19:56.565258 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3a583b-86fe-48ee-bfe3-13ad3a41e443 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:19:56.578600 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 614/1243] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:19:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:19:56.584899 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea11c29-7331-4354-aa40-4a58ea3368a6 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:19:56.673443 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:19:56.700787 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea11c29-7331-4354-aa40-4a58ea3368a6 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:19:56.737603 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2546337-78df-4b62-a06b-58c7fa575a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:19:56.738704 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2546337-78df-4b62-a06b-58c7fa575a28 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:19:56.738995 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2546337-78df-4b62-a06b-58c7fa575a28 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:19:56.739297 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2546337-78df-4b62-a06b-58c7fa575a28 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:19:56.746325 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2546337-78df-4b62-a06b-58c7fa575a28 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:19:56.747854 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2546337-78df-4b62-a06b-58c7fa575a28 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:19:56.761848 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-c2546337-78df-4b62-a06b-58c7fa575a28 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 03:19:56.761848 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:19:56.761848 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:19:56.761848 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:19:56.761848 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:19:56.761848 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:19:56.761848 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:19:56.761848 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:19:56.761848 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:19:56.761848 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:19:56.761848 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:19:56.761848 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:19:56.761848 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 03:19:56.761848 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 03:19:56.761848 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 03:19:56.769149 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 03:19:56.769149 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:19:56.769149 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:19:56.769149 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:19:56.769149 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:19:56.769149 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:19:56.769149 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:19:56.769149 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:19:56.769149 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:19:56.769149 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:19:56.769149 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:19:56.769149 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:19:56.769149 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:19:56.769149 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:19:56.769149 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:19:56.769149 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:19:56.769149 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:19:56.770246 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 03:19:56.770246 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 03:19:56.770246 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 03:19:56.770246 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 03:19:56.770246 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 03:19:56.770246 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 03:19:56.770246 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 03:19:56.770246 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:19:56.770246 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 630/1244] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Jul 2 03:19:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:19:56.770786 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3a583b-86fe-48ee-bfe3-13ad3a41e443 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:19:56.879266 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3a583b-86fe-48ee-bfe3-13ad3a41e443 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:19:56.917050 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9938ae-3f47-4f2e-bde6-2d7e861b3830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:19:56.917796 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9938ae-3f47-4f2e-bde6-2d7e861b3830 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:19:56.918108 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9938ae-3f47-4f2e-bde6-2d7e861b3830 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:19:56.918385 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9938ae-3f47-4f2e-bde6-2d7e861b3830 None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:19:56.919178 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9938ae-3f47-4f2e-bde6-2d7e861b3830 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:19:56.919512 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9938ae-3f47-4f2e-bde6-2d7e861b3830 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:19:56.921102 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9938ae-3f47-4f2e-bde6-2d7e861b3830 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:19:56.933522 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 615/1245] 10.222.0.60 () {56 vars in 1148 bytes} [Sat Jul 2 03:19:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:19:56.939615 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2546337-78df-4b62-a06b-58c7fa575a28 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:19:57.047790 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2546337-78df-4b62-a06b-58c7fa575a28 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:19:57.090549 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eebcdf-2a7b-4cd6-b1bd-360382f6888b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:19:57.091226 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eebcdf-2a7b-4cd6-b1bd-360382f6888b None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:19:57.091511 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eebcdf-2a7b-4cd6-b1bd-360382f6888b None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:19:57.091790 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eebcdf-2a7b-4cd6-b1bd-360382f6888b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:19:57.092625 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eebcdf-2a7b-4cd6-b1bd-360382f6888b None admin] RBAC: Adding query filter params (role.id=3c71d0e875cd4a00849f14227be8f7ed, scope.project.id=e09dc5d9d4904c2b89b0cabed237d55e, user.id=9dafc9be75a64db095fe08b9cbb04cbd) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:19:57.092936 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eebcdf-2a7b-4cd6-b1bd-360382f6888b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:19:57.094354 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eebcdf-2a7b-4cd6-b1bd-360382f6888b None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:19:57.108760 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 631/1246] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Jul 2 03:19:56 2022] GET /identity/v3/role_assignments?user.id=9dafc9be75a64db095fe08b9cbb04cbd&scope.project.id=e09dc5d9d4904c2b89b0cabed237d55e&role.id=3c71d0e875cd4a00849f14227be8f7ed => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:19:59.302640 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcdb72d-7392-4b8b-a85a-da3b89860887 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:19:59.303217 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcdb72d-7392-4b8b-a85a-da3b89860887 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:19:59.303217 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcdb72d-7392-4b8b-a85a-da3b89860887 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:19:59.304579 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 616/1247] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:19:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:19:59.310387 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd5701-bb33-4568-8ed0-afcdebddb297 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:19:59.310829 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd5701-bb33-4568-8ed0-afcdebddb297 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:19:59.310935 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd5701-bb33-4568-8ed0-afcdebddb297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:19:59.316683 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:19:59.331289 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-93bd5701-bb33-4568-8ed0-afcdebddb297 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:19:59.332625 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-93bd5701-bb33-4568-8ed0-afcdebddb297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:19:59.411503 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 632/1248] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:19:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 03:19:59.436988 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcdb72d-7392-4b8b-a85a-da3b89860887 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:19:59.459155 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:19:59.555972 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcdb72d-7392-4b8b-a85a-da3b89860887 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:19:59.592583 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc448bb-12ec-4443-8ad7-5b60eb1fffe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:19:59.593464 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc448bb-12ec-4443-8ad7-5b60eb1fffe1 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:19:59.593788 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc448bb-12ec-4443-8ad7-5b60eb1fffe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:19:59.594103 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc448bb-12ec-4443-8ad7-5b60eb1fffe1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:19:59.605855 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc448bb-12ec-4443-8ad7-5b60eb1fffe1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:19:59.613903 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-9cc448bb-12ec-4443-8ad7-5b60eb1fffe1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 03:19:59.613903 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:19:59.613903 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:19:59.613903 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:19:59.613903 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:19:59.613903 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:19:59.613903 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:19:59.613903 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:19:59.613903 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:19:59.613903 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:19:59.613903 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:19:59.613903 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:19:59.613903 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:19:59.613903 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:19:59.613903 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:19:59.613903 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:19:59.614985 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:19:59.614985 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:19:59.614985 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:19:59.614985 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:19:59.614985 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:19:59.614985 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:19:59.614985 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:19:59.614985 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:19:59.614985 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:19:59.614985 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:19:59.614985 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:19:59.614985 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:19:59.614985 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:19:59.614985 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:19:59.614985 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:19:59.614985 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:19:59.615858 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:19:59.615858 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:19:59.615858 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:19:59.615858 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:19:59.615858 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:19:59.615858 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:19:59.615858 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:19:59.615858 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:19:59.615858 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:19:59.615858 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:19:59.615858 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 03:19:59.615858 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:19:59.615858 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 617/1249] 10.222.0.60 () {56 vars in 1096 bytes} [Sat Jul 2 03:19:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:19:59.621699 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bd5701-bb33-4568-8ed0-afcdebddb297 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:19:59.726549 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bd5701-bb33-4568-8ed0-afcdebddb297 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:19:59.759479 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:19:59.765649 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f2d6b6-298c-40d8-9010-5b41ea8ff992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:19:59.766392 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2d6b6-298c-40d8-9010-5b41ea8ff992 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:19:59.766672 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2d6b6-298c-40d8-9010-5b41ea8ff992 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:19:59.766944 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2d6b6-298c-40d8-9010-5b41ea8ff992 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:19:59.767820 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f2d6b6-298c-40d8-9010-5b41ea8ff992 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:19:59.768097 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f2d6b6-298c-40d8-9010-5b41ea8ff992 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:19:59.769574 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f2d6b6-298c-40d8-9010-5b41ea8ff992 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:19:59.784318 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 633/1250] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Jul 2 03:19:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:19:59.785708 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc448bb-12ec-4443-8ad7-5b60eb1fffe1 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:19:59.871816 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:19:59.896286 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc448bb-12ec-4443-8ad7-5b60eb1fffe1 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:19:59.936179 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52425fcd-12cf-4deb-8b90-c04715061d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:19:59.936961 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52425fcd-12cf-4deb-8b90-c04715061d4c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:19:59.937241 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52425fcd-12cf-4deb-8b90-c04715061d4c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:19:59.937516 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52425fcd-12cf-4deb-8b90-c04715061d4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:19:59.949385 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52425fcd-12cf-4deb-8b90-c04715061d4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:19:59.950895 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52425fcd-12cf-4deb-8b90-c04715061d4c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:19:59.971189 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-52425fcd-12cf-4deb-8b90-c04715061d4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:19:59.971189 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:19:59.971189 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:19:59.971189 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:19:59.971189 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:19:59.971189 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:19:59.971189 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:19:59.971189 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:19:59.971189 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:19:59.971189 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:19:59.971189 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:19:59.971189 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:19:59.971189 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:19:59.971189 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:19:59.971189 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:19:59.972351 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:19:59.972351 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:19:59.972351 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:19:59.972351 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:19:59.972351 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:19:59.972351 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:19:59.972351 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:19:59.972351 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:19:59.972351 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:19:59.972351 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:19:59.972351 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:19:59.972351 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:19:59.972351 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:19:59.972351 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:19:59.972351 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:19:59.972351 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:19:59.972351 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:19:59.978172 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:19:59.978172 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:19:59.978172 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:19:59.978172 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:19:59.978172 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 618/1251] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:19:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:19:59.978528 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f2d6b6-298c-40d8-9010-5b41ea8ff992 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:20:00.087948 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f2d6b6-298c-40d8-9010-5b41ea8ff992 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:20:00.127150 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9b6c0e-ed1c-4ee3-bec0-f3cf8bb31800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:20:00.127829 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b6c0e-ed1c-4ee3-bec0-f3cf8bb31800 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:20:00.128229 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b6c0e-ed1c-4ee3-bec0-f3cf8bb31800 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:20:00.128577 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b6c0e-ed1c-4ee3-bec0-f3cf8bb31800 None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:20:00.129654 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9b6c0e-ed1c-4ee3-bec0-f3cf8bb31800 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:20:00.130048 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9b6c0e-ed1c-4ee3-bec0-f3cf8bb31800 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:20:00.131916 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9b6c0e-ed1c-4ee3-bec0-f3cf8bb31800 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:20:00.147907 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 634/1252] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:19:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:20:00.154661 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52425fcd-12cf-4deb-8b90-c04715061d4c None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:20:00.274633 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52425fcd-12cf-4deb-8b90-c04715061d4c None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:20:00.304400 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:20:00.313826 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2aef0e-5564-442c-852e-93c0e2763219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:20:00.314623 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2aef0e-5564-442c-852e-93c0e2763219 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:20:00.314902 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2aef0e-5564-442c-852e-93c0e2763219 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:20:00.315218 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2aef0e-5564-442c-852e-93c0e2763219 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:20:00.323513 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2aef0e-5564-442c-852e-93c0e2763219 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:20:00.325107 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2aef0e-5564-442c-852e-93c0e2763219 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:20:00.340344 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-1c2aef0e-5564-442c-852e-93c0e2763219 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 02 03:20:00.340344 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:20:00.340344 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:20:00.340344 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:20:00.340344 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:20:00.340344 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:20:00.340344 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:20:00.340344 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:20:00.340344 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:20:00.340344 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:20:00.340344 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:20:00.340344 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:20:00.340344 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 03:20:00.340344 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 03:20:00.340344 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 03:20:00.340344 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 03:20:00.341778 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:20:00.341778 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:20:00.341778 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 03:20:00.341778 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 03:20:00.341778 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 03:20:00.341778 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 03:20:00.341778 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:20:00.341778 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:20:00.341778 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:20:00.341778 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:20:00.341778 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:20:00.341778 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:20:00.341778 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:20:00.341778 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:20:00.341778 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:20:00.341778 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:20:00.341778 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:20:00.341778 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:20:00.342880 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:20:00.342880 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:20:00.342880 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 03:20:00.342880 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 03:20:00.342880 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 03:20:00.342880 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 03:20:00.342880 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 03:20:00.342880 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 03:20:00.342880 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 02 03:20:00.342880 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:20:00.342880 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 619/1253] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:20:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:20:00.348075 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9b6c0e-ed1c-4ee3-bec0-f3cf8bb31800 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:20:00.413022 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:20:00.465168 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9b6c0e-ed1c-4ee3-bec0-f3cf8bb31800 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:20:00.500498 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6974775d-c5d6-423e-a513-cefa6f368839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:20:00.501252 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974775d-c5d6-423e-a513-cefa6f368839 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:20:00.501538 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974775d-c5d6-423e-a513-cefa6f368839 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:20:00.501813 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974775d-c5d6-423e-a513-cefa6f368839 None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:20:00.502755 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6974775d-c5d6-423e-a513-cefa6f368839 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:20:00.503064 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6974775d-c5d6-423e-a513-cefa6f368839 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:20:00.504647 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6974775d-c5d6-423e-a513-cefa6f368839 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:20:00.524270 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 635/1254] 10.222.0.60 () {56 vars in 1143 bytes} [Sat Jul 2 03:20:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:20:00.530110 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2aef0e-5564-442c-852e-93c0e2763219 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:20:00.634654 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2aef0e-5564-442c-852e-93c0e2763219 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:20:00.669890 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eccd45f-11f4-4d57-91bb-2164f6254a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:20:00.670471 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eccd45f-11f4-4d57-91bb-2164f6254a11 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:20:00.670751 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eccd45f-11f4-4d57-91bb-2164f6254a11 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:20:00.671019 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eccd45f-11f4-4d57-91bb-2164f6254a11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:20:00.728914 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:20:00.742797 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eccd45f-11f4-4d57-91bb-2164f6254a11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:20:00.744325 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eccd45f-11f4-4d57-91bb-2164f6254a11 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:20:00.860783 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 620/1255] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Jul 2 03:20:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 02 03:20:00.866645 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6974775d-c5d6-423e-a513-cefa6f368839 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:20:00.972806 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6974775d-c5d6-423e-a513-cefa6f368839 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:20:00.986173 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:20:01.008422 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a0fec-d079-4175-b691-0d1cb8e600e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:20:01.009230 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a0fec-d079-4175-b691-0d1cb8e600e8 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:20:01.009580 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a0fec-d079-4175-b691-0d1cb8e600e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:20:01.009872 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a0fec-d079-4175-b691-0d1cb8e600e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:20:01.021084 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043a0fec-d079-4175-b691-0d1cb8e600e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:20:01.022528 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043a0fec-d079-4175-b691-0d1cb8e600e8 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:20:01.042984 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-043a0fec-d079-4175-b691-0d1cb8e600e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:20:01.042984 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:20:01.042984 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:20:01.042984 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:20:01.042984 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:20:01.042984 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:20:01.042984 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:20:01.042984 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:20:01.042984 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:20:01.042984 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:20:01.042984 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:20:01.042984 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:20:01.042984 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:20:01.042984 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:20:01.042984 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:20:01.044174 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:20:01.044174 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:20:01.044174 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:20:01.044174 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:20:01.044174 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:20:01.044174 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:20:01.044174 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:20:01.044174 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:20:01.044174 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:20:01.044174 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:20:01.044174 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:20:01.044174 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:20:01.044174 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:20:01.044174 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:20:01.044174 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:20:01.044174 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:20:01.044174 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:20:01.049781 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:20:01.049781 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:20:01.049781 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:20:01.049781 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:20:01.049781 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 636/1256] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:20:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 03:20:01.050131 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eccd45f-11f4-4d57-91bb-2164f6254a11 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:20:01.154674 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:20:01.170334 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eccd45f-11f4-4d57-91bb-2164f6254a11 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:20:01.209038 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a81310-4141-4de1-99cb-ba94d05cfbb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:20:01.209713 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a81310-4141-4de1-99cb-ba94d05cfbb1 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:20:01.209983 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a81310-4141-4de1-99cb-ba94d05cfbb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:20:01.210258 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a81310-4141-4de1-99cb-ba94d05cfbb1 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:20:01.210985 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a81310-4141-4de1-99cb-ba94d05cfbb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:20:01.211353 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a81310-4141-4de1-99cb-ba94d05cfbb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:20:01.212713 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a81310-4141-4de1-99cb-ba94d05cfbb1 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:20:01.224279 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 621/1257] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:20:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:20:01.230003 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a0fec-d079-4175-b691-0d1cb8e600e8 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:20:01.333736 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a0fec-d079-4175-b691-0d1cb8e600e8 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:20:01.372594 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4910a41-b380-4ed3-a48f-65539323c184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:20:01.373570 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4910a41-b380-4ed3-a48f-65539323c184 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:20:01.373853 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4910a41-b380-4ed3-a48f-65539323c184 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:20:01.374130 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4910a41-b380-4ed3-a48f-65539323c184 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:20:01.382163 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4910a41-b380-4ed3-a48f-65539323c184 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:20:01.383667 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4910a41-b380-4ed3-a48f-65539323c184 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:20:01.397561 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-c4910a41-b380-4ed3-a48f-65539323c184 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 03:20:01.397561 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:20:01.397561 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:20:01.397561 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:20:01.397561 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:20:01.397561 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:20:01.397561 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:20:01.397561 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:20:01.397561 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:20:01.397561 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:20:01.397561 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:20:01.397561 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:20:01.397561 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 03:20:01.397561 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 03:20:01.397561 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 03:20:01.398614 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 03:20:01.398614 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:20:01.398614 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:20:01.398614 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:20:01.398614 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:20:01.398614 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:20:01.398614 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:20:01.398614 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:20:01.398614 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:20:01.398614 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:20:01.398614 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:20:01.398614 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:20:01.398614 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:20:01.398614 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:20:01.398614 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:20:01.398614 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:20:01.398614 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:20:01.399920 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 03:20:01.399920 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 03:20:01.399920 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 03:20:01.399920 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 03:20:01.399920 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 03:20:01.399920 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 03:20:01.399920 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 03:20:01.399920 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:20:01.399920 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 637/1258] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Jul 2 03:20:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:20:01.405789 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a81310-4141-4de1-99cb-ba94d05cfbb1 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:20:01.516280 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a81310-4141-4de1-99cb-ba94d05cfbb1 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:20:01.555323 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaba554-c22a-49f4-af08-20f47b96bbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:20:01.555996 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaba554-c22a-49f4-af08-20f47b96bbb3 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:20:01.556279 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaba554-c22a-49f4-af08-20f47b96bbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:20:01.556551 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaba554-c22a-49f4-af08-20f47b96bbb3 None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:20:01.557341 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaba554-c22a-49f4-af08-20f47b96bbb3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:20:01.557648 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaba554-c22a-49f4-af08-20f47b96bbb3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:20:01.559086 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaba554-c22a-49f4-af08-20f47b96bbb3 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:20:01.579151 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 622/1259] 10.222.0.60 () {56 vars in 1148 bytes} [Sat Jul 2 03:20:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:20:01.582276 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4910a41-b380-4ed3-a48f-65539323c184 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:20:01.609439 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:20:01.688905 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4910a41-b380-4ed3-a48f-65539323c184 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:20:01.722389 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc14e0b7-8998-4f53-a1f4-acbddfd6c907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:20:01.723175 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14e0b7-8998-4f53-a1f4-acbddfd6c907 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:20:01.723462 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14e0b7-8998-4f53-a1f4-acbddfd6c907 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:20:01.723739 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14e0b7-8998-4f53-a1f4-acbddfd6c907 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:20:01.724568 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc14e0b7-8998-4f53-a1f4-acbddfd6c907 None admin] RBAC: Adding query filter params (role.id=5dcd130cda6c490595e862dc2348e83d, scope.project.id=e09dc5d9d4904c2b89b0cabed237d55e, user.id=9dafc9be75a64db095fe08b9cbb04cbd) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:20:01.724879 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc14e0b7-8998-4f53-a1f4-acbddfd6c907 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:20:01.726311 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc14e0b7-8998-4f53-a1f4-acbddfd6c907 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:20:01.731944 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 638/1260] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Jul 2 03:20:01 2022] GET /identity/v3/role_assignments?user.id=9dafc9be75a64db095fe08b9cbb04cbd&scope.project.id=e09dc5d9d4904c2b89b0cabed237d55e&role.id=5dcd130cda6c490595e862dc2348e83d => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:20:03.798012 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433bf3cd-ee9d-4323-991b-8262cda45473 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:20:03.798605 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433bf3cd-ee9d-4323-991b-8262cda45473 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:20:03.798605 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433bf3cd-ee9d-4323-991b-8262cda45473 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:20:03.799983 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 623/1261] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:20:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:20:03.807198 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b1b08-2bef-4bad-a6f5-0909b63a8409 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:20:03.807895 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b1b08-2bef-4bad-a6f5-0909b63a8409 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:20:03.808474 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b1b08-2bef-4bad-a6f5-0909b63a8409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:20:03.836762 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-504b1b08-2bef-4bad-a6f5-0909b63a8409 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:20:03.837948 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-504b1b08-2bef-4bad-a6f5-0909b63a8409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:20:03.920249 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 639/1262] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:20:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 03:20:03.943228 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433bf3cd-ee9d-4323-991b-8262cda45473 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:20:03.955939 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:20:04.052523 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433bf3cd-ee9d-4323-991b-8262cda45473 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:20:04.087104 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381ced5d-505f-49de-aff7-9b3e01d40197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:20:04.087912 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ced5d-505f-49de-aff7-9b3e01d40197 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:20:04.088188 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ced5d-505f-49de-aff7-9b3e01d40197 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:20:04.088464 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ced5d-505f-49de-aff7-9b3e01d40197 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:20:04.099375 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381ced5d-505f-49de-aff7-9b3e01d40197 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:20:04.107481 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-381ced5d-505f-49de-aff7-9b3e01d40197 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 03:20:04.107481 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:20:04.107481 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:20:04.107481 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:20:04.107481 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:20:04.107481 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:20:04.107481 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:20:04.107481 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:20:04.107481 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:20:04.107481 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:20:04.107481 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:20:04.107481 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:20:04.107481 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:20:04.107481 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:20:04.107481 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:20:04.107481 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:20:04.108581 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:20:04.108581 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:20:04.108581 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:20:04.108581 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:20:04.108581 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:20:04.108581 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:20:04.108581 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:20:04.108581 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:20:04.108581 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:20:04.108581 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:20:04.108581 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:20:04.108581 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:20:04.108581 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:20:04.108581 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:20:04.108581 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:20:04.108581 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:20:04.109407 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:20:04.109407 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:20:04.109407 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:20:04.109407 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:20:04.109407 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:20:04.109407 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:20:04.109407 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:20:04.109407 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:20:04.109407 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:20:04.109407 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:20:04.109407 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 03:20:04.109407 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:20:04.109407 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 624/1263] 10.222.0.60 () {56 vars in 1096 bytes} [Sat Jul 2 03:20:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 03:20:04.116923 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504b1b08-2bef-4bad-a6f5-0909b63a8409 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:20:04.140653 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:20:04.231950 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504b1b08-2bef-4bad-a6f5-0909b63a8409 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:20:04.267009 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f25df3-81e9-4103-8b72-1e5d49f51c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:20:04.267704 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f25df3-81e9-4103-8b72-1e5d49f51c0b None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:20:04.268011 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f25df3-81e9-4103-8b72-1e5d49f51c0b None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:20:04.268284 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f25df3-81e9-4103-8b72-1e5d49f51c0b None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:20:04.269032 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f25df3-81e9-4103-8b72-1e5d49f51c0b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:20:04.269329 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f25df3-81e9-4103-8b72-1e5d49f51c0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:20:04.270731 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f25df3-81e9-4103-8b72-1e5d49f51c0b None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:20:04.284395 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 640/1264] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Jul 2 03:20:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:20:04.290838 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381ced5d-505f-49de-aff7-9b3e01d40197 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:20:04.360010 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:20:04.395094 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381ced5d-505f-49de-aff7-9b3e01d40197 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:20:04.430245 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248872b1-fbe9-476d-ba0a-684ea36f85bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:20:04.431031 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248872b1-fbe9-476d-ba0a-684ea36f85bd None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:20:04.431344 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248872b1-fbe9-476d-ba0a-684ea36f85bd None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:20:04.431625 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248872b1-fbe9-476d-ba0a-684ea36f85bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:20:04.442319 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248872b1-fbe9-476d-ba0a-684ea36f85bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:20:04.443816 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248872b1-fbe9-476d-ba0a-684ea36f85bd None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:20:04.461258 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-248872b1-fbe9-476d-ba0a-684ea36f85bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:20:04.461258 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:20:04.461258 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:20:04.461258 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:20:04.461258 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:20:04.461258 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:20:04.461258 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:20:04.461258 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:20:04.461258 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:20:04.461258 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:20:04.461258 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:20:04.461258 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:20:04.461258 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:20:04.461258 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:20:04.461258 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:20:04.462254 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:20:04.462254 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:20:04.462254 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:20:04.462254 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:20:04.462254 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:20:04.462254 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:20:04.462254 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:20:04.462254 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:20:04.462254 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:20:04.462254 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:20:04.462254 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:20:04.462254 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:20:04.462254 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:20:04.462254 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:20:04.462254 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:20:04.462254 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:20:04.462254 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:20:04.467802 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:20:04.467802 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:20:04.467802 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:20:04.467802 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:20:04.467802 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 625/1265] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:20:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 03:20:04.468449 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f25df3-81e9-4103-8b72-1e5d49f51c0b None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:20:04.562282 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:20:04.585730 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f25df3-81e9-4103-8b72-1e5d49f51c0b None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:20:04.624230 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd81f03-d022-4023-8c3c-386b61d656f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:20:04.624813 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd81f03-d022-4023-8c3c-386b61d656f4 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:20:04.625095 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd81f03-d022-4023-8c3c-386b61d656f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:20:04.625367 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd81f03-d022-4023-8c3c-386b61d656f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:20:04.626092 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd81f03-d022-4023-8c3c-386b61d656f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:20:04.626393 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd81f03-d022-4023-8c3c-386b61d656f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:20:04.627834 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd81f03-d022-4023-8c3c-386b61d656f4 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:20:04.639702 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 641/1266] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:20:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:20:04.645786 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248872b1-fbe9-476d-ba0a-684ea36f85bd None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:20:04.750047 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248872b1-fbe9-476d-ba0a-684ea36f85bd None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:20:04.769802 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:20:04.785881 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd56094-6997-4c6e-86b0-4562b17bf25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:20:04.786666 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd56094-6997-4c6e-86b0-4562b17bf25c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:20:04.786944 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd56094-6997-4c6e-86b0-4562b17bf25c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:20:04.787254 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd56094-6997-4c6e-86b0-4562b17bf25c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:20:04.795447 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd56094-6997-4c6e-86b0-4562b17bf25c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:20:04.796886 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd56094-6997-4c6e-86b0-4562b17bf25c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:20:04.811851 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-cbd56094-6997-4c6e-86b0-4562b17bf25c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 02 03:20:04.811851 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:20:04.811851 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:20:04.811851 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:20:04.811851 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:20:04.811851 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:20:04.811851 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:20:04.811851 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:20:04.811851 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:20:04.811851 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:20:04.811851 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:20:04.811851 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:20:04.811851 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 03:20:04.811851 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 03:20:04.811851 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 03:20:04.811851 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 03:20:04.813412 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:20:04.813412 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:20:04.813412 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 03:20:04.813412 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 03:20:04.813412 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 03:20:04.813412 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 03:20:04.813412 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:20:04.813412 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:20:04.813412 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:20:04.813412 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:20:04.813412 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:20:04.813412 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:20:04.813412 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:20:04.813412 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:20:04.813412 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:20:04.813412 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:20:04.813412 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:20:04.813412 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:20:04.814365 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:20:04.814365 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:20:04.814365 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 03:20:04.814365 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 03:20:04.814365 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 03:20:04.814365 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 03:20:04.814365 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 03:20:04.814365 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 03:20:04.814365 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 02 03:20:04.814365 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:20:04.814365 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 626/1267] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:20:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:20:04.819279 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd81f03-d022-4023-8c3c-386b61d656f4 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:20:04.933395 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd81f03-d022-4023-8c3c-386b61d656f4 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:20:04.968855 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e547e0-27f2-418f-9c8a-18de5b600a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:20:04.969507 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e547e0-27f2-418f-9c8a-18de5b600a5e None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:20:04.969785 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e547e0-27f2-418f-9c8a-18de5b600a5e None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:20:04.970056 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e547e0-27f2-418f-9c8a-18de5b600a5e None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:20:04.970889 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e547e0-27f2-418f-9c8a-18de5b600a5e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:20:04.971227 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e547e0-27f2-418f-9c8a-18de5b600a5e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:20:04.972709 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e547e0-27f2-418f-9c8a-18de5b600a5e None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:20:04.981393 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:20:04.990438 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 642/1268] 10.222.0.60 () {56 vars in 1143 bytes} [Sat Jul 2 03:20:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:20:04.996165 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd56094-6997-4c6e-86b0-4562b17bf25c None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:20:05.104879 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd56094-6997-4c6e-86b0-4562b17bf25c None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:20:05.141997 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ffc649-91d6-4085-9190-611553e3862f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:20:05.142918 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ffc649-91d6-4085-9190-611553e3862f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:20:05.143282 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ffc649-91d6-4085-9190-611553e3862f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:20:05.143561 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ffc649-91d6-4085-9190-611553e3862f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:20:05.155097 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ffc649-91d6-4085-9190-611553e3862f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:20:05.156593 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ffc649-91d6-4085-9190-611553e3862f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:20:05.173797 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-a6ffc649-91d6-4085-9190-611553e3862f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:20:05.173797 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:20:05.173797 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:20:05.173797 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:20:05.173797 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:20:05.173797 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:20:05.173797 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:20:05.173797 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:20:05.173797 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:20:05.173797 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:20:05.173797 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:20:05.173797 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:20:05.173797 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:20:05.173797 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:20:05.173797 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:20:05.174785 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:20:05.174785 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:20:05.174785 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:20:05.174785 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:20:05.174785 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:20:05.174785 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:20:05.174785 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:20:05.174785 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:20:05.174785 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:20:05.174785 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:20:05.174785 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:20:05.174785 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:20:05.174785 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:20:05.174785 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:20:05.174785 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:20:05.174785 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:20:05.174785 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:20:05.176009 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:20:05.176009 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:20:05.176009 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:20:05.176009 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:20:05.176009 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 627/1269] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:20:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:20:05.181569 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e547e0-27f2-418f-9c8a-18de5b600a5e None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:20:05.302047 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e547e0-27f2-418f-9c8a-18de5b600a5e None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:20:05.337301 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec8333d-2b98-49b2-b161-e95794d7e454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:20:05.337951 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8333d-2b98-49b2-b161-e95794d7e454 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:20:05.338234 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8333d-2b98-49b2-b161-e95794d7e454 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:20:05.338503 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8333d-2b98-49b2-b161-e95794d7e454 None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:20:05.339264 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec8333d-2b98-49b2-b161-e95794d7e454 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:20:05.339566 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec8333d-2b98-49b2-b161-e95794d7e454 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:20:05.340935 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec8333d-2b98-49b2-b161-e95794d7e454 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:20:05.352482 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 643/1270] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:20:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:20:05.359080 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ffc649-91d6-4085-9190-611553e3862f None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:20:05.393629 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:20:05.466207 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ffc649-91d6-4085-9190-611553e3862f None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:20:05.500507 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6182ff81-fcb0-4f1c-91f3-4e2c9c8f2041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:20:05.501300 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6182ff81-fcb0-4f1c-91f3-4e2c9c8f2041 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:20:05.501580 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6182ff81-fcb0-4f1c-91f3-4e2c9c8f2041 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:20:05.501853 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6182ff81-fcb0-4f1c-91f3-4e2c9c8f2041 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:20:05.508761 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6182ff81-fcb0-4f1c-91f3-4e2c9c8f2041 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:20:05.510211 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6182ff81-fcb0-4f1c-91f3-4e2c9c8f2041 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:20:05.524406 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-6182ff81-fcb0-4f1c-91f3-4e2c9c8f2041 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 03:20:05.524406 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:20:05.524406 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:20:05.524406 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:20:05.524406 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:20:05.524406 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:20:05.524406 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:20:05.524406 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:20:05.524406 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:20:05.524406 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:20:05.524406 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:20:05.524406 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:20:05.524406 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 03:20:05.524406 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 03:20:05.524406 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 03:20:05.525427 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 03:20:05.525427 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:20:05.525427 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:20:05.525427 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:20:05.525427 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:20:05.525427 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:20:05.525427 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:20:05.525427 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:20:05.525427 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:20:05.525427 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:20:05.525427 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:20:05.525427 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:20:05.525427 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:20:05.525427 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:20:05.525427 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:20:05.525427 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:20:05.525427 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:20:05.526450 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 03:20:05.526450 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 03:20:05.526450 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 03:20:05.526450 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 03:20:05.526450 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 03:20:05.526450 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 03:20:05.526450 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 03:20:05.526450 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:20:05.526450 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 628/1271] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Jul 2 03:20:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:20:05.533387 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec8333d-2b98-49b2-b161-e95794d7e454 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:20:05.600659 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:20:05.644137 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec8333d-2b98-49b2-b161-e95794d7e454 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:20:05.680460 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e9cf21-78b4-4844-a912-b192764a4b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:20:05.681110 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e9cf21-78b4-4844-a912-b192764a4b5d None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:20:05.681391 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e9cf21-78b4-4844-a912-b192764a4b5d None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:20:05.681666 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e9cf21-78b4-4844-a912-b192764a4b5d None admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:20:05.682451 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e9cf21-78b4-4844-a912-b192764a4b5d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:20:05.682763 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e9cf21-78b4-4844-a912-b192764a4b5d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:20:05.684221 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e9cf21-78b4-4844-a912-b192764a4b5d None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:20:05.696511 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 644/1272] 10.222.0.60 () {56 vars in 1148 bytes} [Sat Jul 2 03:20:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:20:05.702841 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6182ff81-fcb0-4f1c-91f3-4e2c9c8f2041 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:20:05.801383 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:20:05.811732 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6182ff81-fcb0-4f1c-91f3-4e2c9c8f2041 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:20:05.849501 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804bda03-1b13-4899-9a2b-6d7d124fbf3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:20:05.850375 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804bda03-1b13-4899-9a2b-6d7d124fbf3f None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:20:05.850735 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804bda03-1b13-4899-9a2b-6d7d124fbf3f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:20:05.850954 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804bda03-1b13-4899-9a2b-6d7d124fbf3f None admin] PATH_INFO: `/v3/projects/e09dc5d9d4904c2b89b0cabed237d55e/users/9dafc9be75a64db095fe08b9cbb04cbd/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:20:05.853051 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804bda03-1b13-4899-9a2b-6d7d124fbf3f None admin] RBAC: Authorizing `identity:create_grant(project_id=e09dc5d9d4904c2b89b0cabed237d55e, user_id=9dafc9be75a64db095fe08b9cbb04cbd, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:20:05.854491 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804bda03-1b13-4899-9a2b-6d7d124fbf3f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:20:05.870369 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 629/1273] 10.222.0.60 () {58 vars in 1439 bytes} [Sat Jul 2 03:20:05 2022] PUT /identity/v3/projects/e09dc5d9d4904c2b89b0cabed237d55e/users/9dafc9be75a64db095fe08b9cbb04cbd/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:20:07.873061 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f29b3-00d1-4cbd-90ad-b1a9893f66b5 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:20:07.873650 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f29b3-00d1-4cbd-90ad-b1a9893f66b5 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:20:07.874031 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f29b3-00d1-4cbd-90ad-b1a9893f66b5 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:20:07.876288 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 645/1274] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:20:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:20:07.882273 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865b97f-e86f-4f19-a648-174fa6395d95 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:20:07.883010 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865b97f-e86f-4f19-a648-174fa6395d95 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:20:07.883198 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865b97f-e86f-4f19-a648-174fa6395d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:20:07.911358 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-e865b97f-e86f-4f19-a648-174fa6395d95 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:20:07.912550 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e865b97f-e86f-4f19-a648-174fa6395d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:20:07.988289 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 630/1275] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:20:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 03:20:08.017747 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80f29b3-00d1-4cbd-90ad-b1a9893f66b5 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:20:08.134710 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80f29b3-00d1-4cbd-90ad-b1a9893f66b5 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:20:08.163137 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:20:08.181224 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb8ad3c-f62f-4d49-b4f7-7690ec51bd99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:20:08.182002 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8ad3c-f62f-4d49-b4f7-7690ec51bd99 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:20:08.182276 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8ad3c-f62f-4d49-b4f7-7690ec51bd99 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:20:08.182541 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8ad3c-f62f-4d49-b4f7-7690ec51bd99 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:20:08.193213 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb8ad3c-f62f-4d49-b4f7-7690ec51bd99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 03:20:08.200789 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-ebb8ad3c-f62f-4d49-b4f7-7690ec51bd99 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 03:20:08.200789 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:20:08.200789 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:20:08.200789 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:20:08.200789 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:20:08.200789 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:20:08.200789 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:20:08.200789 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:20:08.200789 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:20:08.200789 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:20:08.200789 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:20:08.200789 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:20:08.200789 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 03:20:08.200789 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 03:20:08.200789 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 03:20:08.200789 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 03:20:08.201835 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 03:20:08.201835 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 03:20:08.201835 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 03:20:08.201835 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 03:20:08.201835 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:20:08.201835 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:20:08.201835 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:20:08.201835 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:20:08.201835 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:20:08.201835 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:20:08.201835 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:20:08.201835 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:20:08.201835 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:20:08.201835 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:20:08.201835 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:20:08.201835 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:20:08.202779 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:20:08.202779 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:20:08.202779 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:20:08.202779 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:20:08.202779 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 03:20:08.202779 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 03:20:08.202779 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 03:20:08.202779 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 03:20:08.202779 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 03:20:08.202779 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 03:20:08.202779 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 03:20:08.202779 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:20:08.202779 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 646/1276] 10.222.0.60 () {56 vars in 1096 bytes} [Sat Jul 2 03:20:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:20:08.208213 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e865b97f-e86f-4f19-a648-174fa6395d95 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:20:08.292141 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:20:08.313889 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e865b97f-e86f-4f19-a648-174fa6395d95 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:20:08.348279 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfea218-0927-4174-9aa2-fb9a9c7376af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:20:08.348931 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfea218-0927-4174-9aa2-fb9a9c7376af None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:20:08.349210 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfea218-0927-4174-9aa2-fb9a9c7376af None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:20:08.349480 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfea218-0927-4174-9aa2-fb9a9c7376af None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:20:08.350230 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfea218-0927-4174-9aa2-fb9a9c7376af None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:20:08.350535 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfea218-0927-4174-9aa2-fb9a9c7376af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:20:08.351931 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfea218-0927-4174-9aa2-fb9a9c7376af None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:20:08.360043 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 631/1277] 10.222.0.60 () {56 vars in 1099 bytes} [Sat Jul 2 03:20:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:20:08.366994 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb8ad3c-f62f-4d49-b4f7-7690ec51bd99 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:20:08.479798 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb8ad3c-f62f-4d49-b4f7-7690ec51bd99 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:20:08.524173 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cdc3bc-1ebd-4ea6-9c4f-14a3ad5c13a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:20:08.524969 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cdc3bc-1ebd-4ea6-9c4f-14a3ad5c13a1 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:20:08.525247 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cdc3bc-1ebd-4ea6-9c4f-14a3ad5c13a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:20:08.525521 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cdc3bc-1ebd-4ea6-9c4f-14a3ad5c13a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:20:08.537675 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cdc3bc-1ebd-4ea6-9c4f-14a3ad5c13a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:20:08.539149 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cdc3bc-1ebd-4ea6-9c4f-14a3ad5c13a1 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:20:08.556052 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-36cdc3bc-1ebd-4ea6-9c4f-14a3ad5c13a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:20:08.556052 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:20:08.556052 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:20:08.556052 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:20:08.556052 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:20:08.556052 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:20:08.556052 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:20:08.556052 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:20:08.556052 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:20:08.556052 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:20:08.556052 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:20:08.556052 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:20:08.556052 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:20:08.556052 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:20:08.556052 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:20:08.557061 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:20:08.557061 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:20:08.557061 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:20:08.557061 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:20:08.557061 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:20:08.557061 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:20:08.557061 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:20:08.557061 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:20:08.557061 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:20:08.557061 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:20:08.557061 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:20:08.557061 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:20:08.557061 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:20:08.557061 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:20:08.557061 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:20:08.557061 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:20:08.557061 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:20:08.558230 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:20:08.558230 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:20:08.558230 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:20:08.558230 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:20:08.558230 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 647/1278] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:20:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:20:08.563165 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfea218-0927-4174-9aa2-fb9a9c7376af None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:20:08.670796 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfea218-0927-4174-9aa2-fb9a9c7376af None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:20:08.705452 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e63ebd1-4e05-4ee0-ab35-620b32805ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:20:08.706096 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63ebd1-4e05-4ee0-ab35-620b32805ecf None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:20:08.706370 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63ebd1-4e05-4ee0-ab35-620b32805ecf None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:20:08.706637 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63ebd1-4e05-4ee0-ab35-620b32805ecf None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:20:08.707408 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e63ebd1-4e05-4ee0-ab35-620b32805ecf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:20:08.707706 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e63ebd1-4e05-4ee0-ab35-620b32805ecf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:20:08.709091 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e63ebd1-4e05-4ee0-ab35-620b32805ecf None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:20:08.721378 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 632/1279] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:20:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:20:08.728019 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cdc3bc-1ebd-4ea6-9c4f-14a3ad5c13a1 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:20:08.769958 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:20:08.841345 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cdc3bc-1ebd-4ea6-9c4f-14a3ad5c13a1 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:20:08.876506 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29045c85-e51a-46c4-9b15-0215261aca39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:20:08.877280 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29045c85-e51a-46c4-9b15-0215261aca39 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:20:08.877561 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29045c85-e51a-46c4-9b15-0215261aca39 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:20:08.877834 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29045c85-e51a-46c4-9b15-0215261aca39 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:20:08.889907 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29045c85-e51a-46c4-9b15-0215261aca39 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:20:08.892167 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29045c85-e51a-46c4-9b15-0215261aca39 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:20:08.907743 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-29045c85-e51a-46c4-9b15-0215261aca39 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 02 03:20:08.907743 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:20:08.907743 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:20:08.907743 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:20:08.907743 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:20:08.907743 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:20:08.907743 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:20:08.907743 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:20:08.907743 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:20:08.907743 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:20:08.907743 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:20:08.907743 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:20:08.907743 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 03:20:08.907743 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 03:20:08.907743 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 03:20:08.907743 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 03:20:08.909119 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:20:08.909119 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:20:08.909119 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 03:20:08.909119 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 03:20:08.909119 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 03:20:08.909119 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 03:20:08.909119 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:20:08.909119 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:20:08.909119 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:20:08.909119 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:20:08.909119 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:20:08.909119 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:20:08.909119 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:20:08.909119 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:20:08.909119 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:20:08.909119 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:20:08.909119 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:20:08.909119 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:20:08.910400 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:20:08.910400 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:20:08.910400 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 03:20:08.910400 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 03:20:08.910400 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 03:20:08.910400 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 03:20:08.910400 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 03:20:08.910400 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 03:20:08.910400 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 02 03:20:08.910400 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:20:08.910400 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 648/1280] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:20:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:20:08.915111 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e63ebd1-4e05-4ee0-ab35-620b32805ecf None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:20:08.919096 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:20:09.020948 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e63ebd1-4e05-4ee0-ab35-620b32805ecf None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:20:09.055714 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689c7584-df64-4322-9e0e-0deb857fdcf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:20:09.056371 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689c7584-df64-4322-9e0e-0deb857fdcf7 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:20:09.056652 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689c7584-df64-4322-9e0e-0deb857fdcf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:20:09.056926 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689c7584-df64-4322-9e0e-0deb857fdcf7 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:20:09.057756 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689c7584-df64-4322-9e0e-0deb857fdcf7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:20:09.058063 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689c7584-df64-4322-9e0e-0deb857fdcf7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:20:09.059537 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689c7584-df64-4322-9e0e-0deb857fdcf7 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:20:09.076502 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 633/1281] 10.222.0.60 () {56 vars in 1143 bytes} [Sat Jul 2 03:20:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:20:09.082432 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29045c85-e51a-46c4-9b15-0215261aca39 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:20:09.186687 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:20:09.196860 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29045c85-e51a-46c4-9b15-0215261aca39 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:20:09.235208 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f22b9-bdf1-474a-a25d-eecb45b153d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:20:09.235846 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f22b9-bdf1-474a-a25d-eecb45b153d7 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:20:09.236125 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f22b9-bdf1-474a-a25d-eecb45b153d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:20:09.236393 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f22b9-bdf1-474a-a25d-eecb45b153d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:20:09.308629 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864f22b9-bdf1-474a-a25d-eecb45b153d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:20:09.309987 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864f22b9-bdf1-474a-a25d-eecb45b153d7 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:20:09.405722 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:20:09.417446 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 649/1282] 10.222.0.60 () {58 vars in 1282 bytes} [Sat Jul 2 03:20:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 02 03:20:09.424048 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689c7584-df64-4322-9e0e-0deb857fdcf7 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:20:09.494684 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:20:09.534296 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689c7584-df64-4322-9e0e-0deb857fdcf7 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:20:09.571577 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b4446e-fb5e-4262-8fae-3122ffa2b7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:20:09.572308 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4446e-fb5e-4262-8fae-3122ffa2b7ec None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:20:09.572590 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4446e-fb5e-4262-8fae-3122ffa2b7ec None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:20:09.572863 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4446e-fb5e-4262-8fae-3122ffa2b7ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:20:09.583750 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b4446e-fb5e-4262-8fae-3122ffa2b7ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:20:09.585198 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b4446e-fb5e-4262-8fae-3122ffa2b7ec None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:20:09.602862 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-f4b4446e-fb5e-4262-8fae-3122ffa2b7ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:20:09.602862 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:20:09.602862 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:20:09.602862 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:20:09.602862 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:20:09.602862 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:20:09.602862 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:20:09.602862 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:20:09.602862 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:20:09.602862 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:20:09.602862 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:20:09.602862 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:20:09.602862 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 03:20:09.602862 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 03:20:09.602862 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 03:20:09.603884 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 03:20:09.603884 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:20:09.603884 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:20:09.603884 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:20:09.603884 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:20:09.603884 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:20:09.603884 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:20:09.603884 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:20:09.603884 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:20:09.603884 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:20:09.603884 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:20:09.603884 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:20:09.603884 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:20:09.603884 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:20:09.603884 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:20:09.603884 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:20:09.603884 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:20:09.604797 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 03:20:09.604797 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 03:20:09.604797 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 03:20:09.604797 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:20:09.604797 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 634/1283] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:20:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:20:09.609898 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f22b9-bdf1-474a-a25d-eecb45b153d7 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:20:09.719567 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f22b9-bdf1-474a-a25d-eecb45b153d7 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:20:09.757038 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7385a00-0677-4714-9392-066299fa935c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:20:09.757687 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7385a00-0677-4714-9392-066299fa935c None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:20:09.757964 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7385a00-0677-4714-9392-066299fa935c None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:20:09.758235 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7385a00-0677-4714-9392-066299fa935c None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:20:09.758970 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7385a00-0677-4714-9392-066299fa935c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:20:09.759307 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7385a00-0677-4714-9392-066299fa935c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:20:09.760681 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7385a00-0677-4714-9392-066299fa935c None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:20:09.772254 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 650/1284] 10.222.0.60 () {56 vars in 1109 bytes} [Sat Jul 2 03:20:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:20:09.780607 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b4446e-fb5e-4262-8fae-3122ffa2b7ec None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:20:09.893843 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b4446e-fb5e-4262-8fae-3122ffa2b7ec None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:20:09.908152 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:20:09.931876 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ae76ab-18f3-4ae1-8f39-e4c0fb6afc5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:20:09.932660 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae76ab-18f3-4ae1-8f39-e4c0fb6afc5f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:20:09.932940 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae76ab-18f3-4ae1-8f39-e4c0fb6afc5f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:20:09.933219 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae76ab-18f3-4ae1-8f39-e4c0fb6afc5f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:20:09.940225 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ae76ab-18f3-4ae1-8f39-e4c0fb6afc5f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:20:09.941760 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ae76ab-18f3-4ae1-8f39-e4c0fb6afc5f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:20:09.955397 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-c7ae76ab-18f3-4ae1-8f39-e4c0fb6afc5f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 03:20:09.955397 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:20:09.955397 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:20:09.955397 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:20:09.955397 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:20:09.955397 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:20:09.955397 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:20:09.955397 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:20:09.955397 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:20:09.955397 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:20:09.955397 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:20:09.955397 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:20:09.955397 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 03:20:09.955397 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 03:20:09.955397 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 03:20:09.956354 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 03:20:09.956354 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:20:09.956354 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:20:09.956354 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:20:09.956354 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:20:09.956354 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:20:09.956354 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:20:09.956354 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:20:09.956354 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 02 03:20:09.956354 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:20:09.956354 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:20:09.956354 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:20:09.956354 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:20:09.956354 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:20:09.956354 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:20:09.956354 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:20:09.956354 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:20:09.957374 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 03:20:09.957374 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 03:20:09.957374 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 03:20:09.957374 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 03:20:09.957374 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 03:20:09.957374 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 03:20:09.957374 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 03:20:09.957374 dv-cinder-846842-9-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 02 03:20:09.957374 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 635/1285] 10.222.0.60 () {56 vars in 1111 bytes} [Sat Jul 2 03:20:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:20:09.964546 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7385a00-0677-4714-9392-066299fa935c None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:20:10.016114 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:20:10.069013 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7385a00-0677-4714-9392-066299fa935c None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:20:10.104728 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ee6da-eb77-4801-a6d2-eb393204f1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:20:10.105479 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ee6da-eb77-4801-a6d2-eb393204f1b7 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:20:10.105718 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ee6da-eb77-4801-a6d2-eb393204f1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:20:10.106059 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ee6da-eb77-4801-a6d2-eb393204f1b7 None admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:20:10.106922 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727ee6da-eb77-4801-a6d2-eb393204f1b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:20:10.107306 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727ee6da-eb77-4801-a6d2-eb393204f1b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:20:10.108893 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727ee6da-eb77-4801-a6d2-eb393204f1b7 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:20:10.123305 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 651/1286] 10.222.0.60 () {56 vars in 1148 bytes} [Sat Jul 2 03:20:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:20:10.130467 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ae76ab-18f3-4ae1-8f39-e4c0fb6afc5f None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:20:10.242050 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ae76ab-18f3-4ae1-8f39-e4c0fb6afc5f None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:20:10.283163 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6022598e-2923-4547-a682-fdbaaf07687b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:20:10.284150 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022598e-2923-4547-a682-fdbaaf07687b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:20:10.284402 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022598e-2923-4547-a682-fdbaaf07687b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:20:10.284686 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022598e-2923-4547-a682-fdbaaf07687b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:20:10.285580 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6022598e-2923-4547-a682-fdbaaf07687b None admin] RBAC: Adding query filter params (role.id=5dcd130cda6c490595e862dc2348e83d, scope.project.id=e09dc5d9d4904c2b89b0cabed237d55e, user.id=9dafc9be75a64db095fe08b9cbb04cbd) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:20:10.285888 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6022598e-2923-4547-a682-fdbaaf07687b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:20:10.287351 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6022598e-2923-4547-a682-fdbaaf07687b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:20:10.293528 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 636/1287] 10.222.0.60 () {56 vars in 1374 bytes} [Sat Jul 2 03:20:10 2022] GET /identity/v3/role_assignments?user.id=9dafc9be75a64db095fe08b9cbb04cbd&scope.project.id=e09dc5d9d4904c2b89b0cabed237d55e&role.id=5dcd130cda6c490595e862dc2348e83d => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:20:12.340044 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867dedbe-051c-41f8-8b27-29ae838658cb None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:20:12.340623 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867dedbe-051c-41f8-8b27-29ae838658cb None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:20:12.340719 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867dedbe-051c-41f8-8b27-29ae838658cb None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:20:12.342060 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 652/1288] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:20:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:20:12.347938 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a9dec-29d9-4a3b-833f-45ab7cb4bdd8 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:20:12.348346 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a9dec-29d9-4a3b-833f-45ab7cb4bdd8 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:20:12.348480 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a9dec-29d9-4a3b-833f-45ab7cb4bdd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:20:12.366732 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-1c0a9dec-29d9-4a3b-833f-45ab7cb4bdd8 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:20:12.367971 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1c0a9dec-29d9-4a3b-833f-45ab7cb4bdd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:20:12.398449 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:20:12.439714 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 637/1289] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:20:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 03:20:12.474817 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867dedbe-051c-41f8-8b27-29ae838658cb None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:20:12.588611 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867dedbe-051c-41f8-8b27-29ae838658cb None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:20:12.599181 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:20:12.623492 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347aa987-1d91-44a7-878c-8c2679351f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:20:12.624271 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347aa987-1d91-44a7-878c-8c2679351f7d None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:20:12.624547 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347aa987-1d91-44a7-878c-8c2679351f7d None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:20:12.624818 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347aa987-1d91-44a7-878c-8c2679351f7d None admin] PATH_INFO: `/v3/services/placement` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:20:12.625458 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347aa987-1d91-44a7-878c-8c2679351f7d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:20:12.626810 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347aa987-1d91-44a7-878c-8c2679351f7d None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:20:12.641275 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-347aa987-1d91-44a7-878c-8c2679351f7d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 02 03:20:12.641275 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:20:12.641275 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 02 03:20:12.641275 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 02 03:20:12.641275 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 02 03:20:12.641275 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 02 03:20:12.641275 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 02 03:20:12.641275 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 03:20:12.641275 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 02 03:20:12.641275 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:20:12.641275 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 03:20:12.641275 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:20:12.641275 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:20:12.641275 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:20:12.641275 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:20:12.641275 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:20:12.641275 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:20:12.642351 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:20:12.642351 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:20:12.642351 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:20:12.642351 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:20:12.642351 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:20:12.642351 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:20:12.642351 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 02 03:20:12.642351 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 02 03:20:12.642351 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 02 03:20:12.642351 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 02 03:20:12.642351 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:20:12.642351 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:20:12.642351 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:20:12.642351 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:20:12.642351 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:20:12.642351 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:20:12.643284 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:20:12.643284 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:20:12.643284 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:20:12.643284 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:20:12.643284 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:20:12.643284 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:20:12.643284 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:20:12.643284 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:20:12.643284 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:20:12.643284 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:20:12.643284 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 02 03:20:12.643284 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 03:20:12.643284 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 02 03:20:12.643284 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:20:12.643284 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 653/1290] 10.222.0.60 () {56 vars in 1117 bytes} [Sat Jul 2 03:20:12 2022] GET /identity/v3/services/placement => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:20:12.651238 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a9dec-29d9-4a3b-833f-45ab7cb4bdd8 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:20:12.762434 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a9dec-29d9-4a3b-833f-45ab7cb4bdd8 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:20:12.797773 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21798320-7d9d-4436-8857-0649e1d88549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:20:12.798419 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21798320-7d9d-4436-8857-0649e1d88549 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:20:12.798700 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21798320-7d9d-4436-8857-0649e1d88549 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:20:12.798974 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21798320-7d9d-4436-8857-0649e1d88549 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:20:12.799700 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21798320-7d9d-4436-8857-0649e1d88549 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:20:12.800005 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21798320-7d9d-4436-8857-0649e1d88549 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:20:12.801453 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21798320-7d9d-4436-8857-0649e1d88549 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:20:12.806293 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 638/1291] 10.222.0.60 () {56 vars in 1116 bytes} [Sat Jul 2 03:20:12 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:20:12.814793 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347aa987-1d91-44a7-878c-8c2679351f7d None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:20:12.918068 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347aa987-1d91-44a7-878c-8c2679351f7d None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:20:12.953379 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9e997-d394-494c-97eb-6ad8f413b352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:20:12.954027 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9e997-d394-494c-97eb-6ad8f413b352 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:20:12.954306 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9e997-d394-494c-97eb-6ad8f413b352 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:20:12.954582 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9e997-d394-494c-97eb-6ad8f413b352 None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:20:12.955280 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b9e997-d394-494c-97eb-6ad8f413b352 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:20:12.955616 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b9e997-d394-494c-97eb-6ad8f413b352 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:20:12.957011 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b9e997-d394-494c-97eb-6ad8f413b352 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:20:12.962283 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 654/1292] 10.222.0.60 () {56 vars in 1116 bytes} [Sat Jul 2 03:20:12 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:20:14.948304 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e7082-31ca-4714-ab1a-b4681b5f8658 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:20:14.949199 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e7082-31ca-4714-ab1a-b4681b5f8658 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:20:14.949199 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e7082-31ca-4714-ab1a-b4681b5f8658 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:20:14.951372 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 639/1293] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:20:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:20:14.956666 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b2b4f6-de3e-46a3-b301-85b8966bed19 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:20:14.957116 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b2b4f6-de3e-46a3-b301-85b8966bed19 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:20:14.957221 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b2b4f6-de3e-46a3-b301-85b8966bed19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:20:14.975150 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-d6b2b4f6-de3e-46a3-b301-85b8966bed19 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:20:14.976317 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-d6b2b4f6-de3e-46a3-b301-85b8966bed19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:20:15.007450 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:20:15.049867 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 655/1294] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:20:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 03:20:15.072795 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600e7082-31ca-4714-ab1a-b4681b5f8658 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:20:15.109122 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:20:15.193360 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600e7082-31ca-4714-ab1a-b4681b5f8658 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:20:15.229825 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19faf7c0-d96d-4891-b9f5-85f77948bd09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:20:15.230422 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19faf7c0-d96d-4891-b9f5-85f77948bd09 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:20:15.230704 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19faf7c0-d96d-4891-b9f5-85f77948bd09 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:20:15.230980 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19faf7c0-d96d-4891-b9f5-85f77948bd09 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:20:15.231737 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19faf7c0-d96d-4891-b9f5-85f77948bd09 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:20:15.233130 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19faf7c0-d96d-4891-b9f5-85f77948bd09 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:20:15.248950 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 640/1295] 10.222.0.60 () {60 vars in 1141 bytes} [Sat Jul 2 03:20:15 2022] POST /identity/v3/services => generated 246 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:20:17.256324 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a44e7b-5bbf-4ca7-9ad8-5ad41d51d467 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:20:17.256887 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a44e7b-5bbf-4ca7-9ad8-5ad41d51d467 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:20:17.256887 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a44e7b-5bbf-4ca7-9ad8-5ad41d51d467 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:20:17.258278 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 656/1296] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:20:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:20:17.264564 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35c4e4-e870-4bf3-8509-94c4607a3010 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:20:17.265271 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35c4e4-e870-4bf3-8509-94c4607a3010 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:20:17.265417 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35c4e4-e870-4bf3-8509-94c4607a3010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:20:17.285932 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-df35c4e4-e870-4bf3-8509-94c4607a3010 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:20:17.287103 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-df35c4e4-e870-4bf3-8509-94c4607a3010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:20:17.364092 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 641/1297] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:20:17 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 03:20:17.394857 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a44e7b-5bbf-4ca7-9ad8-5ad41d51d467 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:20:17.503194 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a44e7b-5bbf-4ca7-9ad8-5ad41d51d467 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:20:17.541552 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce811a6-a7d6-4d33-987d-eb046e84f15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:20:17.542301 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce811a6-a7d6-4d33-987d-eb046e84f15c None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:20:17.542580 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce811a6-a7d6-4d33-987d-eb046e84f15c None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:20:17.542856 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce811a6-a7d6-4d33-987d-eb046e84f15c None admin] PATH_INFO: `/v3/services/placement` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:20:17.543663 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce811a6-a7d6-4d33-987d-eb046e84f15c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:20:17.545205 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce811a6-a7d6-4d33-987d-eb046e84f15c None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:20:17.557780 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-4ce811a6-a7d6-4d33-987d-eb046e84f15c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 02 03:20:17.557780 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:20:17.557780 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 02 03:20:17.557780 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 02 03:20:17.557780 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 02 03:20:17.557780 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 02 03:20:17.557780 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 02 03:20:17.557780 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 03:20:17.557780 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 02 03:20:17.557780 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:20:17.557780 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 03:20:17.557780 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:20:17.557780 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:20:17.557780 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:20:17.557780 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:20:17.557780 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:20:17.557780 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:20:17.558930 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:20:17.558930 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:20:17.558930 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:20:17.558930 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:20:17.558930 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:20:17.558930 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:20:17.558930 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 02 03:20:17.558930 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 02 03:20:17.558930 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 02 03:20:17.558930 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 02 03:20:17.558930 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:20:17.558930 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:20:17.558930 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:20:17.558930 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:20:17.558930 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:20:17.558930 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:20:17.559985 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:20:17.559985 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:20:17.559985 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:20:17.559985 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:20:17.559985 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:20:17.559985 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:20:17.559985 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:20:17.559985 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:20:17.559985 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:20:17.559985 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:20:17.559985 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 02 03:20:17.559985 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 03:20:17.559985 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 02 03:20:17.559985 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:20:17.563286 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 657/1298] 10.222.0.60 () {56 vars in 1117 bytes} [Sat Jul 2 03:20:17 2022] GET /identity/v3/services/placement => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:20:17.565118 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df35c4e4-e870-4bf3-8509-94c4607a3010 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:20:17.585318 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:20:17.680970 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df35c4e4-e870-4bf3-8509-94c4607a3010 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:20:17.723790 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b137dda-b1f7-4694-9b58-9fe20d9da48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:20:17.724444 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b137dda-b1f7-4694-9b58-9fe20d9da48d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:20:17.724725 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b137dda-b1f7-4694-9b58-9fe20d9da48d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:20:17.724996 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b137dda-b1f7-4694-9b58-9fe20d9da48d None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:20:17.725708 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b137dda-b1f7-4694-9b58-9fe20d9da48d None admin] RBAC: Adding query filter params (name=placement) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:20:17.726013 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b137dda-b1f7-4694-9b58-9fe20d9da48d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:20:17.727417 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b137dda-b1f7-4694-9b58-9fe20d9da48d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:20:17.733051 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 642/1299] 10.222.0.60 () {56 vars in 1116 bytes} [Sat Jul 2 03:20:17 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:20:17.742316 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce811a6-a7d6-4d33-987d-eb046e84f15c None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:20:17.782219 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:20:17.861819 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce811a6-a7d6-4d33-987d-eb046e84f15c None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:20:17.899132 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c1b560-70a9-4009-8b61-9ccc0f418565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:20:17.899804 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c1b560-70a9-4009-8b61-9ccc0f418565 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:20:17.900091 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c1b560-70a9-4009-8b61-9ccc0f418565 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:20:17.900400 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c1b560-70a9-4009-8b61-9ccc0f418565 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:20:17.901162 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c1b560-70a9-4009-8b61-9ccc0f418565 None admin] RBAC: Adding query filter params (interface=public, service_id=dd04b2e10ed6469a9c54e9542227ffad, region_id=RegionOne) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:20:17.901472 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c1b560-70a9-4009-8b61-9ccc0f418565 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:20:17.902864 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c1b560-70a9-4009-8b61-9ccc0f418565 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:20:17.908592 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 658/1300] 10.222.0.60 () {56 vars in 1251 bytes} [Sat Jul 2 03:20:17 2022] GET /identity/v3/endpoints?service_id=dd04b2e10ed6469a9c54e9542227ffad&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:20:17.917664 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b137dda-b1f7-4694-9b58-9fe20d9da48d None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:20:18.018769 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:20:18.040792 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b137dda-b1f7-4694-9b58-9fe20d9da48d None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:20:18.079073 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ada2228-f03b-4987-83b3-ecebabb2c49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:20:18.079765 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ada2228-f03b-4987-83b3-ecebabb2c49c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:20:18.080037 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ada2228-f03b-4987-83b3-ecebabb2c49c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:20:18.080306 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ada2228-f03b-4987-83b3-ecebabb2c49c None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:20:18.080990 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ada2228-f03b-4987-83b3-ecebabb2c49c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:20:18.082417 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ada2228-f03b-4987-83b3-ecebabb2c49c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:20:18.089648 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 643/1301] 10.222.0.60 () {56 vars in 1087 bytes} [Sat Jul 2 03:20:17 2022] GET /identity/v3/services => generated 2191 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:20:20.102743 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0297f64d-1eb2-4e4d-b3d3-99371b1ee45e None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:20:20.103711 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0297f64d-1eb2-4e4d-b3d3-99371b1ee45e None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:20:20.103711 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0297f64d-1eb2-4e4d-b3d3-99371b1ee45e None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:20:20.105864 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 659/1302] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:20:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:20:20.114058 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff462f-fb1b-4c29-8a6a-a9060c6983bc None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:20:20.114495 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff462f-fb1b-4c29-8a6a-a9060c6983bc None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:20:20.114595 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff462f-fb1b-4c29-8a6a-a9060c6983bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:20:20.133541 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-c4ff462f-fb1b-4c29-8a6a-a9060c6983bc None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:20:20.134729 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c4ff462f-fb1b-4c29-8a6a-a9060c6983bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:20:20.208222 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 644/1303] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:20:20 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 03:20:20.243362 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0297f64d-1eb2-4e4d-b3d3-99371b1ee45e None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:20:20.342821 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:20:20.350637 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0297f64d-1eb2-4e4d-b3d3-99371b1ee45e None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:20:20.388048 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba223e-8366-4b54-981c-a02e76963da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:20:20.388924 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba223e-8366-4b54-981c-a02e76963da2 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:20:20.389207 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba223e-8366-4b54-981c-a02e76963da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:20:20.389481 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba223e-8366-4b54-981c-a02e76963da2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:20:20.390147 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ba223e-8366-4b54-981c-a02e76963da2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:20:20.391556 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ba223e-8366-4b54-981c-a02e76963da2 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:20:20.403823 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-46ba223e-8366-4b54-981c-a02e76963da2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 02 03:20:20.403823 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:20:20.403823 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 02 03:20:20.403823 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 02 03:20:20.403823 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 02 03:20:20.403823 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 02 03:20:20.403823 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 02 03:20:20.403823 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 03:20:20.403823 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 02 03:20:20.403823 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:20:20.403823 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 03:20:20.403823 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:20:20.403823 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 03:20:20.403823 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 03:20:20.403823 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 03:20:20.403823 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 03:20:20.403823 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 03:20:20.404988 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 03:20:20.404988 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 03:20:20.404988 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 03:20:20.404988 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 03:20:20.404988 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 03:20:20.404988 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 03:20:20.404988 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 02 03:20:20.404988 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 02 03:20:20.404988 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 02 03:20:20.404988 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 02 03:20:20.404988 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 03:20:20.404988 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 03:20:20.404988 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 03:20:20.404988 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 03:20:20.404988 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 03:20:20.404988 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 03:20:20.411669 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 03:20:20.411669 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 02 03:20:20.411669 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 03:20:20.411669 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 02 03:20:20.411669 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 03:20:20.411669 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 03:20:20.411669 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 03:20:20.411669 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 02 03:20:20.411669 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 03:20:20.411669 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 02 03:20:20.411669 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 02 03:20:20.411669 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 03:20:20.411669 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 02 03:20:20.411669 dv-cinder-846842-9-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 02 03:20:20.411669 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 660/1304] 10.222.0.60 () {56 vars in 1117 bytes} [Sat Jul 2 03:20:20 2022] GET /identity/v3/services/placement => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 03:20:20.412738 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff462f-fb1b-4c29-8a6a-a9060c6983bc None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:20:20.491299 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:20:20.517035 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff462f-fb1b-4c29-8a6a-a9060c6983bc None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:20:20.552103 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd96c1f-a0ff-416d-852f-418616c5710f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:20:20.552763 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd96c1f-a0ff-416d-852f-418616c5710f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:20:20.553045 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd96c1f-a0ff-416d-852f-418616c5710f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:20:20.553319 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd96c1f-a0ff-416d-852f-418616c5710f None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:20:20.554025 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd96c1f-a0ff-416d-852f-418616c5710f None admin] RBAC: Adding query filter params (name=placement) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:20:20.554330 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd96c1f-a0ff-416d-852f-418616c5710f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:20:20.555773 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd96c1f-a0ff-416d-852f-418616c5710f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:20:20.561830 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 645/1305] 10.222.0.60 () {56 vars in 1116 bytes} [Sat Jul 2 03:20:20 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:20:20.568620 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba223e-8366-4b54-981c-a02e76963da2 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:20:20.702104 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba223e-8366-4b54-981c-a02e76963da2 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:20:20.742093 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95cbc90-ac21-45fb-a6e3-ed5502b7ad8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:20:20.742739 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95cbc90-ac21-45fb-a6e3-ed5502b7ad8c None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:20:20.743022 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95cbc90-ac21-45fb-a6e3-ed5502b7ad8c None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:20:20.743329 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95cbc90-ac21-45fb-a6e3-ed5502b7ad8c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:20:20.744069 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95cbc90-ac21-45fb-a6e3-ed5502b7ad8c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:20:20.745442 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95cbc90-ac21-45fb-a6e3-ed5502b7ad8c None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:20:20.771932 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 661/1306] 10.222.0.60 () {60 vars in 1144 bytes} [Sat Jul 2 03:20:20 2022] POST /identity/v3/endpoints => generated 331 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:20:30.558685 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=30 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:20:30.763948 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:21:23.400131 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9de7d-d0b3-4365-855a-8585dae8040f None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:21:23.401743 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9de7d-d0b3-4365-855a-8585dae8040f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:21:23.402620 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9de7d-d0b3-4365-855a-8585dae8040f None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:21:23.406916 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 646/1307] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:21:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:21:23.412569 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f441e-bfdd-4173-b7d2-07f737e5ddca None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:21:23.412999 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f441e-bfdd-4173-b7d2-07f737e5ddca None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:21:23.413133 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f441e-bfdd-4173-b7d2-07f737e5ddca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:21:23.574247 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-732f441e-bfdd-4173-b7d2-07f737e5ddca None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:21:23.575491 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-732f441e-bfdd-4173-b7d2-07f737e5ddca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:21:23.689278 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 662/1308] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:21:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:21:23.737341 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f0b61-7ba2-4638-a326-1d6685ab28b9 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:21:23.737530 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f0b61-7ba2-4638-a326-1d6685ab28b9 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:21:23.737951 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f0b61-7ba2-4638-a326-1d6685ab28b9 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:21:23.739553 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 647/1309] 10.222.0.60 () {54 vars in 964 bytes} [Sat Jul 2 03:21:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:21:23.745547 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b43f54-4717-4f02-84ac-797db4f71ba3 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:21:23.746207 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b43f54-4717-4f02-84ac-797db4f71ba3 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:21:23.746555 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b43f54-4717-4f02-84ac-797db4f71ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:21:23.834241 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-34b43f54-4717-4f02-84ac-797db4f71ba3 None None] MFA Rules not processed for user `b0e8a3ba6f84477bb9b4780918f357c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:21:23.835600 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-34b43f54-4717-4f02-84ac-797db4f71ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:21:23.857497 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:21:23.916947 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 663/1310] 10.222.0.60 () {58 vars in 1061 bytes} [Sat Jul 2 03:21:23 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:21:23.925940 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4f0b61-7ba2-4638-a326-1d6685ab28b9 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:21:23.927776 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ec4f0b61-7ba2-4638-a326-1d6685ab28b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:21:24.035310 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4f0b61-7ba2-4638-a326-1d6685ab28b9 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:21:24.110048 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b01f6-da7d-4764-96f4-f1f690bde0d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:21:24.110938 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b01f6-da7d-4764-96f4-f1f690bde0d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:21:24.111216 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b01f6-da7d-4764-96f4-f1f690bde0d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:21:24.111502 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b01f6-da7d-4764-96f4-f1f690bde0d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:21:24.113102 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-dc0b01f6-da7d-4764-96f4-f1f690bde0d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:21:24.170829 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:21:24.227267 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b01f6-da7d-4764-96f4-f1f690bde0d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:21:24.228711 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b01f6-da7d-4764-96f4-f1f690bde0d0 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:21:24.251097 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 648/1311] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:21:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:21:26.568722 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0885517-0479-424a-890d-155dcde522ae None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:21:26.569331 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0885517-0479-424a-890d-155dcde522ae None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:21:26.569331 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0885517-0479-424a-890d-155dcde522ae None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:21:26.570852 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 664/1312] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:21:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:21:26.576110 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814ef44-a840-47fe-b7ca-bb945c099162 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:21:26.576575 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814ef44-a840-47fe-b7ca-bb945c099162 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:21:26.576678 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814ef44-a840-47fe-b7ca-bb945c099162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:21:26.648303 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-2814ef44-a840-47fe-b7ca-bb945c099162 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:21:26.649451 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2814ef44-a840-47fe-b7ca-bb945c099162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:21:26.757097 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 649/1313] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:21:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:21:26.810429 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2b736-9276-4033-9b1f-8c26db5d3ec8 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:21:26.810718 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2b736-9276-4033-9b1f-8c26db5d3ec8 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:21:26.810998 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2b736-9276-4033-9b1f-8c26db5d3ec8 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:21:26.812481 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 665/1314] 10.222.0.60 () {54 vars in 964 bytes} [Sat Jul 2 03:21:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:21:26.818877 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef89251-9ec0-4a9e-8a26-6094fb9cabb2 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:21:26.819269 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef89251-9ec0-4a9e-8a26-6094fb9cabb2 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:21:26.819610 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef89251-9ec0-4a9e-8a26-6094fb9cabb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:21:26.830395 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:21:26.896125 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-7ef89251-9ec0-4a9e-8a26-6094fb9cabb2 None None] MFA Rules not processed for user `b0e8a3ba6f84477bb9b4780918f357c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:21:26.897321 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7ef89251-9ec0-4a9e-8a26-6094fb9cabb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:21:26.978770 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 650/1315] 10.222.0.60 () {58 vars in 1061 bytes} [Sat Jul 2 03:21:26 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:21:26.991165 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2b736-9276-4033-9b1f-8c26db5d3ec8 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:21:26.992726 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-4be2b736-9276-4033-9b1f-8c26db5d3ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:21:27.099420 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2b736-9276-4033-9b1f-8c26db5d3ec8 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:21:27.169840 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:21:27.172852 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c14153-7ff5-4deb-bf4c-447452dbf628 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:21:27.173694 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c14153-7ff5-4deb-bf4c-447452dbf628 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:21:27.174147 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c14153-7ff5-4deb-bf4c-447452dbf628 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:21:27.174903 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c14153-7ff5-4deb-bf4c-447452dbf628 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:21:27.177252 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-63c14153-7ff5-4deb-bf4c-447452dbf628 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:21:27.299152 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c14153-7ff5-4deb-bf4c-447452dbf628 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:21:27.300590 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c14153-7ff5-4deb-bf4c-447452dbf628 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:21:27.319100 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 666/1316] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:21:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:21:29.874135 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c363590-0453-4f32-8ff3-e6710c13b3eb None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:21:29.874688 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c363590-0453-4f32-8ff3-e6710c13b3eb None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:21:29.874688 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c363590-0453-4f32-8ff3-e6710c13b3eb None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:21:29.876208 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 651/1317] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:21:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:21:29.881491 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98e07b-3bcd-4c70-b714-13915e225a3c None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:21:29.881951 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98e07b-3bcd-4c70-b714-13915e225a3c None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:21:29.882050 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98e07b-3bcd-4c70-b714-13915e225a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:21:29.947875 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-4e98e07b-3bcd-4c70-b714-13915e225a3c None None] MFA Rules not processed for user `f1c7660050c245549b3aa8237868945a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:21:29.949082 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-4e98e07b-3bcd-4c70-b714-13915e225a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:21:30.002080 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:21:30.054846 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 667/1318] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:21:29 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:21:30.097712 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c363590-0453-4f32-8ff3-e6710c13b3eb None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:21:30.100162 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1c363590-0453-4f32-8ff3-e6710c13b3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:21:30.215372 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c363590-0453-4f32-8ff3-e6710c13b3eb None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:21:30.220051 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:21:30.292980 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d40b656-0685-4475-991e-7176b0e87dbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:21:30.293618 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40b656-0685-4475-991e-7176b0e87dbe service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:21:30.293904 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40b656-0685-4475-991e-7176b0e87dbe service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:21:30.294177 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40b656-0685-4475-991e-7176b0e87dbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:21:30.295859 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1d40b656-0685-4475-991e-7176b0e87dbe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:21:30.423366 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d40b656-0685-4475-991e-7176b0e87dbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:21:30.424826 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d40b656-0685-4475-991e-7176b0e87dbe service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:21:30.444620 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 652/1319] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:21:30 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:21:33.007348 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa4d8e-cce2-4f2a-a1a1-d5ce2d24f4f1 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:21:33.008185 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa4d8e-cce2-4f2a-a1a1-d5ce2d24f4f1 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:21:33.008185 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa4d8e-cce2-4f2a-a1a1-d5ce2d24f4f1 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:21:33.010272 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 668/1320] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:21:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:21:33.015678 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a091a96-511c-4d9f-ba14-286b19efaba0 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:21:33.016163 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a091a96-511c-4d9f-ba14-286b19efaba0 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:21:33.016163 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a091a96-511c-4d9f-ba14-286b19efaba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:21:33.057350 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:21:33.082360 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-1a091a96-511c-4d9f-ba14-286b19efaba0 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:21:33.083604 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1a091a96-511c-4d9f-ba14-286b19efaba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:21:33.182533 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 653/1321] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:21:33 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:21:33.221154 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa4d8e-cce2-4f2a-a1a1-d5ce2d24f4f1 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:21:33.222693 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-dcaa4d8e-cce2-4f2a-a1a1-d5ce2d24f4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:21:33.327506 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa4d8e-cce2-4f2a-a1a1-d5ce2d24f4f1 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:21:33.407289 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1e668b-5844-4d29-bd34-2cfbcc357d61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:21:33.408246 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e668b-5844-4d29-bd34-2cfbcc357d61 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:21:33.408520 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e668b-5844-4d29-bd34-2cfbcc357d61 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:21:33.408785 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e668b-5844-4d29-bd34-2cfbcc357d61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:21:33.410453 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-fa1e668b-5844-4d29-bd34-2cfbcc357d61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:21:33.418123 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:21:33.524333 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1e668b-5844-4d29-bd34-2cfbcc357d61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:21:33.525759 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1e668b-5844-4d29-bd34-2cfbcc357d61 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:21:33.545904 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 669/1322] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:21:33 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:21:36.460511 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8156c6f-df5b-4977-b1b3-ee9ec03f8982 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:21:36.461085 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8156c6f-df5b-4977-b1b3-ee9ec03f8982 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:21:36.461085 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8156c6f-df5b-4977-b1b3-ee9ec03f8982 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:21:36.462450 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 654/1323] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:21:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:21:36.467981 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f26d1a-b0cf-46a8-9b90-9d2c5f365b4d None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:21:36.468411 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f26d1a-b0cf-46a8-9b90-9d2c5f365b4d None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:21:36.468498 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f26d1a-b0cf-46a8-9b90-9d2c5f365b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:21:36.537199 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-e4f26d1a-b0cf-46a8-9b90-9d2c5f365b4d None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:21:36.538443 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-e4f26d1a-b0cf-46a8-9b90-9d2c5f365b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:21:36.608245 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:21:36.654617 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 670/1324] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:21:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:21:36.691834 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8156c6f-df5b-4977-b1b3-ee9ec03f8982 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:21:36.693380 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b8156c6f-df5b-4977-b1b3-ee9ec03f8982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:21:36.803527 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8156c6f-df5b-4977-b1b3-ee9ec03f8982 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:21:36.816104 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:21:36.878553 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef28e4-6f53-455e-a19a-58c801aa81b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:21:36.879224 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef28e4-6f53-455e-a19a-58c801aa81b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:21:36.879510 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef28e4-6f53-455e-a19a-58c801aa81b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:21:36.879744 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef28e4-6f53-455e-a19a-58c801aa81b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:21:36.881392 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-91ef28e4-6f53-455e-a19a-58c801aa81b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:21:36.995746 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ef28e4-6f53-455e-a19a-58c801aa81b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:21:36.997168 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ef28e4-6f53-455e-a19a-58c801aa81b6 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:21:37.018411 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 655/1325] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:21:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:21:39.086670 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c16bb-8af5-4620-b617-f49ce991e554 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:21:39.087243 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c16bb-8af5-4620-b617-f49ce991e554 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:21:39.087243 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c16bb-8af5-4620-b617-f49ce991e554 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:21:39.088535 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 671/1326] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:21:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:21:39.093862 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5a36d-b04d-46be-b24c-7c8c2af535b5 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:21:39.094282 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5a36d-b04d-46be-b24c-7c8c2af535b5 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:21:39.094371 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5a36d-b04d-46be-b24c-7c8c2af535b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:21:39.146608 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:21:39.166032 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-cbe5a36d-b04d-46be-b24c-7c8c2af535b5 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:21:39.167290 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-cbe5a36d-b04d-46be-b24c-7c8c2af535b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:21:39.264625 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 656/1327] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:21:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:21:39.300639 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c16bb-8af5-4620-b617-f49ce991e554 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:21:39.302155 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-364c16bb-8af5-4620-b617-f49ce991e554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:21:39.418630 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c16bb-8af5-4620-b617-f49ce991e554 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:21:39.495029 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf17d2d-6afe-45b5-aacb-401784d17c2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:21:39.495720 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf17d2d-6afe-45b5-aacb-401784d17c2c service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:21:39.495978 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf17d2d-6afe-45b5-aacb-401784d17c2c service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:21:39.496256 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf17d2d-6afe-45b5-aacb-401784d17c2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:21:39.497871 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-2bf17d2d-6afe-45b5-aacb-401784d17c2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:21:39.515042 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:21:39.616712 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf17d2d-6afe-45b5-aacb-401784d17c2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:21:39.618158 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf17d2d-6afe-45b5-aacb-401784d17c2c service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:21:39.637004 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 672/1328] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:21:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:21:41.707206 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0c848-58fd-4baf-9433-aadff6135b17 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:21:41.707775 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0c848-58fd-4baf-9433-aadff6135b17 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:21:41.707775 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0c848-58fd-4baf-9433-aadff6135b17 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:21:41.709163 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 657/1329] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:21:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:21:41.714657 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd3ae3-ef09-4ff1-a400-2e47afd8acd3 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:21:41.715108 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd3ae3-ef09-4ff1-a400-2e47afd8acd3 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:21:41.715252 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd3ae3-ef09-4ff1-a400-2e47afd8acd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:21:41.787743 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-f2bd3ae3-ef09-4ff1-a400-2e47afd8acd3 None None] MFA Rules not processed for user `f1c7660050c245549b3aa8237868945a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:21:41.788959 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-f2bd3ae3-ef09-4ff1-a400-2e47afd8acd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:21:41.860638 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:21:41.895001 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 673/1330] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:21:41 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:21:41.932899 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f0c848-58fd-4baf-9433-aadff6135b17 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:21:41.934337 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f2f0c848-58fd-4baf-9433-aadff6135b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:21:42.042886 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f0c848-58fd-4baf-9433-aadff6135b17 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:21:42.063133 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:21:42.122653 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20c49d4-c4e9-48ec-9ba2-f71098865d0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:21:42.124221 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c49d4-c4e9-48ec-9ba2-f71098865d0e service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:21:42.124221 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c49d4-c4e9-48ec-9ba2-f71098865d0e service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:21:42.124221 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c49d4-c4e9-48ec-9ba2-f71098865d0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:21:42.126209 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c20c49d4-c4e9-48ec-9ba2-f71098865d0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:21:42.242140 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20c49d4-c4e9-48ec-9ba2-f71098865d0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:21:42.243636 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20c49d4-c4e9-48ec-9ba2-f71098865d0e service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:21:42.262210 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 658/1331] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:21:41 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:21:44.531168 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc874abc-e759-41f9-be0c-2dbce901cd31 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:21:44.531850 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc874abc-e759-41f9-be0c-2dbce901cd31 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:21:44.531850 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc874abc-e759-41f9-be0c-2dbce901cd31 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:21:44.533180 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 674/1332] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:21:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:21:44.539962 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03580658-ba58-4883-99cf-51e316d25429 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:21:44.540695 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03580658-ba58-4883-99cf-51e316d25429 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:21:44.540842 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03580658-ba58-4883-99cf-51e316d25429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:21:44.610650 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:21:44.614446 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-03580658-ba58-4883-99cf-51e316d25429 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:21:44.616883 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-03580658-ba58-4883-99cf-51e316d25429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:21:44.733374 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 659/1333] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:21:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:21:44.772654 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc874abc-e759-41f9-be0c-2dbce901cd31 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:21:44.775160 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-bc874abc-e759-41f9-be0c-2dbce901cd31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:21:44.896387 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc874abc-e759-41f9-be0c-2dbce901cd31 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:21:44.976287 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81eed5c-9e82-4cfa-984d-356d68779b82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:21:44.976932 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81eed5c-9e82-4cfa-984d-356d68779b82 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:21:44.977215 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81eed5c-9e82-4cfa-984d-356d68779b82 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:21:44.977486 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81eed5c-9e82-4cfa-984d-356d68779b82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:21:44.979154 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-d81eed5c-9e82-4cfa-984d-356d68779b82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:21:45.010125 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:21:45.107955 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81eed5c-9e82-4cfa-984d-356d68779b82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:21:45.109383 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81eed5c-9e82-4cfa-984d-356d68779b82 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:21:45.133564 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 675/1334] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:21:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:21:47.187704 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced65d55-f29e-4b34-b017-69f1ec77b8ae None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:21:47.188580 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced65d55-f29e-4b34-b017-69f1ec77b8ae None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:21:47.188580 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced65d55-f29e-4b34-b017-69f1ec77b8ae None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:21:47.190256 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 660/1335] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:21:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:21:47.195630 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d9850e-6637-4f7a-87f1-8f3ad0716598 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:21:47.196052 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d9850e-6637-4f7a-87f1-8f3ad0716598 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:21:47.196160 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d9850e-6637-4f7a-87f1-8f3ad0716598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:21:47.261920 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-c4d9850e-6637-4f7a-87f1-8f3ad0716598 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:21:47.263111 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-c4d9850e-6637-4f7a-87f1-8f3ad0716598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:21:47.338943 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:21:47.362111 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 676/1336] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:21:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:21:47.405398 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced65d55-f29e-4b34-b017-69f1ec77b8ae None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:21:47.407894 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ced65d55-f29e-4b34-b017-69f1ec77b8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:21:47.527703 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced65d55-f29e-4b34-b017-69f1ec77b8ae None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:21:47.557954 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:21:47.613688 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342efc96-6f5b-4df4-9765-cb0f02cf0c64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:21:47.614260 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342efc96-6f5b-4df4-9765-cb0f02cf0c64 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:21:47.614541 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342efc96-6f5b-4df4-9765-cb0f02cf0c64 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:21:47.614811 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342efc96-6f5b-4df4-9765-cb0f02cf0c64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:21:47.616473 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-342efc96-6f5b-4df4-9765-cb0f02cf0c64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:21:47.733641 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342efc96-6f5b-4df4-9765-cb0f02cf0c64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:21:47.735084 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342efc96-6f5b-4df4-9765-cb0f02cf0c64 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:21:47.754909 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 661/1337] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:21:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:21:50.122063 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052787eb-ecd7-4d68-ab5b-8a76372750ff None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:21:50.122723 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052787eb-ecd7-4d68-ab5b-8a76372750ff None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:21:50.122723 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052787eb-ecd7-4d68-ab5b-8a76372750ff None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:21:50.124076 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 677/1338] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:21:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:21:50.129663 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4072b2d3-19fd-4dbe-96c2-218d979feff8 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:21:50.130045 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4072b2d3-19fd-4dbe-96c2-218d979feff8 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:21:50.130218 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4072b2d3-19fd-4dbe-96c2-218d979feff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:21:50.208686 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-4072b2d3-19fd-4dbe-96c2-218d979feff8 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:21:50.210026 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4072b2d3-19fd-4dbe-96c2-218d979feff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:21:50.219086 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:21:50.322500 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 662/1339] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:21:50 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:21:50.367638 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052787eb-ecd7-4d68-ab5b-8a76372750ff None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:21:50.369268 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-052787eb-ecd7-4d68-ab5b-8a76372750ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:21:50.479564 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052787eb-ecd7-4d68-ab5b-8a76372750ff None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:21:50.564714 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0309b6-dbc8-457b-907c-cae9187c6594 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:21:50.565358 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0309b6-dbc8-457b-907c-cae9187c6594 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:21:50.565640 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0309b6-dbc8-457b-907c-cae9187c6594 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:21:50.565915 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0309b6-dbc8-457b-907c-cae9187c6594 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:21:50.567594 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-2a0309b6-dbc8-457b-907c-cae9187c6594 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:21:50.610239 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:21:50.688892 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0309b6-dbc8-457b-907c-cae9187c6594 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:21:50.690282 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0309b6-dbc8-457b-907c-cae9187c6594 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:21:50.708739 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 678/1340] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:21:50 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:21:54.661497 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef2c0f-8f8f-4bb1-ae8d-45a3404d8fc5 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:21:54.662079 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef2c0f-8f8f-4bb1-ae8d-45a3404d8fc5 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:21:54.662079 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef2c0f-8f8f-4bb1-ae8d-45a3404d8fc5 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:21:54.663443 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 663/1341] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:21:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:21:54.668891 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf0c93-2402-48ff-a2fb-f330448c676f None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:21:54.669336 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf0c93-2402-48ff-a2fb-f330448c676f None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:21:54.669517 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf0c93-2402-48ff-a2fb-f330448c676f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:21:54.746072 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-2bdf0c93-2402-48ff-a2fb-f330448c676f None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:21:54.747296 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-2bdf0c93-2402-48ff-a2fb-f330448c676f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:21:54.845694 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:21:54.860272 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 679/1342] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:21:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 03:21:54.898816 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef2c0f-8f8f-4bb1-ae8d-45a3404d8fc5 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:21:54.901117 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d7ef2c0f-8f8f-4bb1-ae8d-45a3404d8fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:21:55.001955 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef2c0f-8f8f-4bb1-ae8d-45a3404d8fc5 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:21:55.005759 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2aba95-da5a-4633-a150-07c628d975bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:21:55.006480 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2aba95-da5a-4633-a150-07c628d975bf service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:21:55.006822 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2aba95-da5a-4633-a150-07c628d975bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:21:55.007185 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2aba95-da5a-4633-a150-07c628d975bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:21:55.016848 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2aba95-da5a-4633-a150-07c628d975bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:21:55.018403 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2aba95-da5a-4633-a150-07c628d975bf service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:21:55.028061 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 664/1343] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:21:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:21:57.623316 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d299c9d7-79a1-41a8-afa3-caebc86bce40 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:21:57.623862 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d299c9d7-79a1-41a8-afa3-caebc86bce40 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:21:57.623862 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d299c9d7-79a1-41a8-afa3-caebc86bce40 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:21:57.625145 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 680/1344] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:21:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:21:57.630587 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e19eae-de10-4a22-ba01-bd2cdc7a482a None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:21:57.631036 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e19eae-de10-4a22-ba01-bd2cdc7a482a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:21:57.631258 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e19eae-de10-4a22-ba01-bd2cdc7a482a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:21:57.662379 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-e3e19eae-de10-4a22-ba01-bd2cdc7a482a None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:21:57.663612 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e3e19eae-de10-4a22-ba01-bd2cdc7a482a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:21:57.692826 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:21:57.747239 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 665/1345] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:21:57 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:21:57.781945 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d299c9d7-79a1-41a8-afa3-caebc86bce40 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:21:57.794108 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d299c9d7-79a1-41a8-afa3-caebc86bce40 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:21:57.797901 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e94c912-e2ab-4e5e-bfc2-ccf6b38c0ce7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:21:57.798560 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e94c912-e2ab-4e5e-bfc2-ccf6b38c0ce7 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:21:57.798883 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e94c912-e2ab-4e5e-bfc2-ccf6b38c0ce7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:21:57.799263 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e94c912-e2ab-4e5e-bfc2-ccf6b38c0ce7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:21:57.809654 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e94c912-e2ab-4e5e-bfc2-ccf6b38c0ce7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:21:57.811146 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e94c912-e2ab-4e5e-bfc2-ccf6b38c0ce7 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:21:57.822042 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 681/1346] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:21:57 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:22:01.889570 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee83690-e0e9-4aa1-ae78-cba474888ff8 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:22:01.890101 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee83690-e0e9-4aa1-ae78-cba474888ff8 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:22:01.890101 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee83690-e0e9-4aa1-ae78-cba474888ff8 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:22:01.891550 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 666/1347] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:22:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:22:01.896928 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffbc64c-c87b-4824-ac38-42dc9234774a None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:22:01.897370 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffbc64c-c87b-4824-ac38-42dc9234774a None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:22:01.897600 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffbc64c-c87b-4824-ac38-42dc9234774a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:22:01.916291 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-5ffbc64c-c87b-4824-ac38-42dc9234774a None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:22:01.917494 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-5ffbc64c-c87b-4824-ac38-42dc9234774a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:22:01.926641 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 682/1348] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:22:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:22:01.965458 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee83690-e0e9-4aa1-ae78-cba474888ff8 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:22:01.967403 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7ee83690-e0e9-4aa1-ae78-cba474888ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:22:01.980365 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee83690-e0e9-4aa1-ae78-cba474888ff8 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:22:01.983929 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635d3cec-54fc-40a6-be81-14d15e2f42a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:22:01.984662 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d3cec-54fc-40a6-be81-14d15e2f42a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:22:01.985007 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d3cec-54fc-40a6-be81-14d15e2f42a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:22:01.985341 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d3cec-54fc-40a6-be81-14d15e2f42a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:22:01.994918 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635d3cec-54fc-40a6-be81-14d15e2f42a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:22:01.996381 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635d3cec-54fc-40a6-be81-14d15e2f42a1 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:22:02.006766 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 667/1349] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:22:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:22:07.018820 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a697020e-8ef5-480a-a9a0-e94014d12a20 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:22:07.019395 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a697020e-8ef5-480a-a9a0-e94014d12a20 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:22:07.019680 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a697020e-8ef5-480a-a9a0-e94014d12a20 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:22:07.021195 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 683/1350] 10.222.0.60 () {54 vars in 921 bytes} [Sat Jul 2 03:22:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:22:07.026393 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5402ec-2e4d-4698-910f-af06bac3023e None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:22:07.026810 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5402ec-2e4d-4698-910f-af06bac3023e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:22:07.026941 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5402ec-2e4d-4698-910f-af06bac3023e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:22:07.110737 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-1c5402ec-2e4d-4698-910f-af06bac3023e None None] MFA Rules not processed for user `9dafc9be75a64db095fe08b9cbb04cbd`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:22:07.112363 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1c5402ec-2e4d-4698-910f-af06bac3023e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:22:07.199499 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 668/1351] 10.222.0.60 () {58 vars in 1018 bytes} [Sat Jul 2 03:22:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:22:11.343659 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c6666-eb9e-46bf-ac81-0270e262d80f None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:22:11.344686 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c6666-eb9e-46bf-ac81-0270e262d80f None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:22:11.344912 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c6666-eb9e-46bf-ac81-0270e262d80f None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:22:11.346584 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 684/1352] 10.222.0.60 () {54 vars in 921 bytes} [Sat Jul 2 03:22:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:22:11.351585 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc5365-f299-47e4-8d76-e1733168c749 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:22:11.352013 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc5365-f299-47e4-8d76-e1733168c749 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:22:11.352145 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc5365-f299-47e4-8d76-e1733168c749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:22:11.370708 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-e9cc5365-f299-47e4-8d76-e1733168c749 None None] MFA Rules not processed for user `9dafc9be75a64db095fe08b9cbb04cbd`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:22:11.372275 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e9cc5365-f299-47e4-8d76-e1733168c749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:22:11.382292 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 669/1353] 10.222.0.60 () {58 vars in 1018 bytes} [Sat Jul 2 03:22:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:22:11.910917 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=13 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:22:12.863328 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad8881-239b-402f-b131-ac344d5c3a4f None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:22:12.863989 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad8881-239b-402f-b131-ac344d5c3a4f None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:22:12.863989 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad8881-239b-402f-b131-ac344d5c3a4f None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:22:12.865293 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 685/1354] 10.222.0.60 () {54 vars in 921 bytes} [Sat Jul 2 03:22:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:22:12.870785 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c812c-6e45-43f3-84bd-f41ca997d358 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:22:12.871251 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c812c-6e45-43f3-84bd-f41ca997d358 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:22:12.871380 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c812c-6e45-43f3-84bd-f41ca997d358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:22:12.890372 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-c01c812c-6e45-43f3-84bd-f41ca997d358 None None] MFA Rules not processed for user `9dafc9be75a64db095fe08b9cbb04cbd`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:22:12.891580 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c01c812c-6e45-43f3-84bd-f41ca997d358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:22:12.900272 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 670/1355] 10.222.0.60 () {58 vars in 1018 bytes} [Sat Jul 2 03:22:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:22:16.409692 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6740c3-d923-4c11-82f0-0b26604b3cfa None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:22:16.410218 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6740c3-d923-4c11-82f0-0b26604b3cfa None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:22:16.410218 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6740c3-d923-4c11-82f0-0b26604b3cfa None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:22:16.416701 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 686/1356] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:22:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:22:16.418240 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d06879-cd1d-4282-8ead-32325269ccf0 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:22:16.418697 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d06879-cd1d-4282-8ead-32325269ccf0 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:22:16.418792 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d06879-cd1d-4282-8ead-32325269ccf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:22:16.437486 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-62d06879-cd1d-4282-8ead-32325269ccf0 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:22:16.438894 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-62d06879-cd1d-4282-8ead-32325269ccf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:22:16.450470 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 671/1357] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:22:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:22:16.502892 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89f680-43cd-46c3-b06b-92f3c8597101 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:22:16.503575 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89f680-43cd-46c3-b06b-92f3c8597101 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:22:16.504027 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89f680-43cd-46c3-b06b-92f3c8597101 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:22:16.506197 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 687/1358] 10.222.0.60 () {54 vars in 961 bytes} [Sat Jul 2 03:22:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:22:16.517322 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547fb8e9-857d-4645-b212-ad0e0ed0e5e7 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:22:16.517600 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547fb8e9-857d-4645-b212-ad0e0ed0e5e7 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:22:16.518097 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547fb8e9-857d-4645-b212-ad0e0ed0e5e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:22:16.564286 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:22:16.574279 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-547fb8e9-857d-4645-b212-ad0e0ed0e5e7 None None] MFA Rules not processed for user `13530240e2d446b6bf26a431d001362a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:22:16.575537 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-547fb8e9-857d-4645-b212-ad0e0ed0e5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:22:16.664073 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 672/1359] 10.222.0.60 () {58 vars in 1058 bytes} [Sat Jul 2 03:22:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:22:16.672702 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a89f680-43cd-46c3-b06b-92f3c8597101 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:22:16.688026 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a89f680-43cd-46c3-b06b-92f3c8597101 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:22:16.693738 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e5b3b4-17be-4648-84bf-2dcb7afaa415 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13530240e2d446b6bf26a431d001362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:22:16.694808 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5b3b4-17be-4648-84bf-2dcb7afaa415 service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:22:16.696734 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5b3b4-17be-4648-84bf-2dcb7afaa415 service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:22:16.697049 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5b3b4-17be-4648-84bf-2dcb7afaa415 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:22:16.706168 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e5b3b4-17be-4648-84bf-2dcb7afaa415 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:22:16.707817 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e5b3b4-17be-4648-84bf-2dcb7afaa415 service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:22:16.717964 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 688/1360] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:22:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:22:18.926373 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e998df-65e4-4210-83b9-ae5a182d90fd None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:22:18.926913 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e998df-65e4-4210-83b9-ae5a182d90fd None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:22:18.926913 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e998df-65e4-4210-83b9-ae5a182d90fd None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:22:18.928425 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 673/1361] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:22:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:22:18.933524 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d83bf79-6c26-46ee-a9dc-013408a56681 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:22:18.934027 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d83bf79-6c26-46ee-a9dc-013408a56681 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:22:18.934027 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d83bf79-6c26-46ee-a9dc-013408a56681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:22:18.951838 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-9d83bf79-6c26-46ee-a9dc-013408a56681 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:22:18.953018 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-9d83bf79-6c26-46ee-a9dc-013408a56681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:22:18.961409 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 689/1362] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:22:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:22:19.004649 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e998df-65e4-4210-83b9-ae5a182d90fd None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:22:19.019506 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e998df-65e4-4210-83b9-ae5a182d90fd None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:22:19.025354 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b394dbf4-4ac3-4a94-a0c5-6c10e96d3dcc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13530240e2d446b6bf26a431d001362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:22:19.025993 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b394dbf4-4ac3-4a94-a0c5-6c10e96d3dcc service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:22:19.026255 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b394dbf4-4ac3-4a94-a0c5-6c10e96d3dcc service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:22:19.026511 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b394dbf4-4ac3-4a94-a0c5-6c10e96d3dcc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:22:19.035276 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b394dbf4-4ac3-4a94-a0c5-6c10e96d3dcc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:22:19.037184 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b394dbf4-4ac3-4a94-a0c5-6c10e96d3dcc service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:22:19.047066 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 674/1363] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:22:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:22:21.403147 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b90aee-8c2a-496a-ad7c-76c84f944fd0 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:22:21.403147 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b90aee-8c2a-496a-ad7c-76c84f944fd0 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:22:21.403147 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b90aee-8c2a-496a-ad7c-76c84f944fd0 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:22:21.410020 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 690/1364] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:22:21 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:22:21.415960 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278886a-e743-4b5a-adf5-f7a4297dbc64 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:22:21.416462 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278886a-e743-4b5a-adf5-f7a4297dbc64 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:22:21.416560 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278886a-e743-4b5a-adf5-f7a4297dbc64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:22:21.440721 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-9278886a-e743-4b5a-adf5-f7a4297dbc64 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:22:21.441795 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9278886a-e743-4b5a-adf5-f7a4297dbc64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:22:21.449563 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 675/1365] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:22:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:22:21.500462 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1bd1f1-fb4c-42f3-a49d-589917dc214d None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:22:21.500875 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1bd1f1-fb4c-42f3-a49d-589917dc214d None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:22:21.501007 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1bd1f1-fb4c-42f3-a49d-589917dc214d None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:22:21.502363 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 691/1366] 10.222.0.60 () {54 vars in 961 bytes} [Sat Jul 2 03:22:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:22:21.507920 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453050d-3b72-4ec8-9fef-ad19358e41ca None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:22:21.508183 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453050d-3b72-4ec8-9fef-ad19358e41ca None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:22:21.508477 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453050d-3b72-4ec8-9fef-ad19358e41ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:22:21.526411 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-1453050d-3b72-4ec8-9fef-ad19358e41ca None None] MFA Rules not processed for user `13530240e2d446b6bf26a431d001362a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:22:21.527601 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1453050d-3b72-4ec8-9fef-ad19358e41ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:22:21.537199 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 676/1367] 10.222.0.60 () {58 vars in 1058 bytes} [Sat Jul 2 03:22:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:22:21.544951 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1bd1f1-fb4c-42f3-a49d-589917dc214d None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:22:21.560943 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1bd1f1-fb4c-42f3-a49d-589917dc214d None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:22:21.566992 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ded619-0495-4945-8a5c-8a68444aed48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13530240e2d446b6bf26a431d001362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:22:21.567716 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ded619-0495-4945-8a5c-8a68444aed48 service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:22:21.567999 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ded619-0495-4945-8a5c-8a68444aed48 service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:22:21.568275 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ded619-0495-4945-8a5c-8a68444aed48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:22:21.576692 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ded619-0495-4945-8a5c-8a68444aed48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:22:21.578308 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ded619-0495-4945-8a5c-8a68444aed48 service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:22:21.587810 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 692/1368] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:22:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:22:23.650922 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102fd784-5bc0-4048-8e06-306f7526b0f7 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:22:23.651539 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102fd784-5bc0-4048-8e06-306f7526b0f7 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:22:23.651539 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102fd784-5bc0-4048-8e06-306f7526b0f7 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:22:23.652750 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 677/1369] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:22:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:22:23.658397 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a2b39-358c-4f91-b14f-a28bf8276aac None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:22:23.658972 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a2b39-358c-4f91-b14f-a28bf8276aac None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:22:23.658972 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a2b39-358c-4f91-b14f-a28bf8276aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:22:23.678542 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-8f2a2b39-358c-4f91-b14f-a28bf8276aac None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:22:23.679992 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-8f2a2b39-358c-4f91-b14f-a28bf8276aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:22:23.689286 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 693/1370] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:22:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:22:23.733031 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102fd784-5bc0-4048-8e06-306f7526b0f7 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:22:23.748204 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102fd784-5bc0-4048-8e06-306f7526b0f7 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:22:23.753843 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb76059-77d8-4847-b5b5-ccdecad2f966 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13530240e2d446b6bf26a431d001362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:22:23.754586 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb76059-77d8-4847-b5b5-ccdecad2f966 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:22:23.754959 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb76059-77d8-4847-b5b5-ccdecad2f966 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:22:23.755420 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb76059-77d8-4847-b5b5-ccdecad2f966 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:22:23.764083 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb76059-77d8-4847-b5b5-ccdecad2f966 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:22:23.765796 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb76059-77d8-4847-b5b5-ccdecad2f966 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:22:23.775939 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 678/1371] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:22:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:22:24.358540 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a939c8b-34e1-48bb-8de7-1010ad968bc3 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:22:24.358799 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a939c8b-34e1-48bb-8de7-1010ad968bc3 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:22:24.359425 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a939c8b-34e1-48bb-8de7-1010ad968bc3 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:22:24.360787 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 694/1372] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:22:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:22:24.366145 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb5d94-ddf1-42c9-832d-d00353ef0f0c None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:22:24.366668 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb5d94-ddf1-42c9-832d-d00353ef0f0c None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:22:24.366912 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb5d94-ddf1-42c9-832d-d00353ef0f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:22:24.394604 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-c7fb5d94-ddf1-42c9-832d-d00353ef0f0c None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:22:24.396017 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c7fb5d94-ddf1-42c9-832d-d00353ef0f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:22:24.407183 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 679/1373] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:22:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:22:24.709317 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5919ee1-ed23-4b2f-af22-5890ce1555a6 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:22:24.709751 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5919ee1-ed23-4b2f-af22-5890ce1555a6 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:22:24.709862 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5919ee1-ed23-4b2f-af22-5890ce1555a6 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:22:24.711468 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 695/1374] 10.222.0.60 () {54 vars in 963 bytes} [Sat Jul 2 03:22:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:22:24.716696 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774780e-c395-4864-b4dc-e89909ff2a8a None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:22:24.717137 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774780e-c395-4864-b4dc-e89909ff2a8a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:22:24.717219 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774780e-c395-4864-b4dc-e89909ff2a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:22:24.777422 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-c774780e-c395-4864-b4dc-e89909ff2a8a None None] MFA Rules not processed for user `c7c2bef2013546cd882013cdcb4cd929`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:22:24.778773 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c774780e-c395-4864-b4dc-e89909ff2a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:22:24.853625 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 680/1375] 10.222.0.60 () {58 vars in 1060 bytes} [Sat Jul 2 03:22:24 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:22:24.862019 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5919ee1-ed23-4b2f-af22-5890ce1555a6 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:22:24.873932 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5919ee1-ed23-4b2f-af22-5890ce1555a6 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:22:24.878028 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f8c0d-a42a-4b79-80dd-974f7dfd38ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:22:24.878915 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f8c0d-a42a-4b79-80dd-974f7dfd38ae service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:22:24.879234 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f8c0d-a42a-4b79-80dd-974f7dfd38ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:22:24.879526 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f8c0d-a42a-4b79-80dd-974f7dfd38ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:22:24.890426 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9f8c0d-a42a-4b79-80dd-974f7dfd38ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:22:24.891957 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9f8c0d-a42a-4b79-80dd-974f7dfd38ae service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:22:24.903088 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 696/1376] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:22:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:22:25.795999 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657284df-1772-4e93-9a2f-86fc98567ba4 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:22:25.795999 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657284df-1772-4e93-9a2f-86fc98567ba4 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:22:25.795999 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657284df-1772-4e93-9a2f-86fc98567ba4 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:22:25.795999 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 681/1377] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:22:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:22:25.801309 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7ebfa-6f53-4443-b047-698b67c5a503 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:22:25.801807 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7ebfa-6f53-4443-b047-698b67c5a503 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:22:25.802087 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7ebfa-6f53-4443-b047-698b67c5a503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:22:25.823702 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-2cf7ebfa-6f53-4443-b047-698b67c5a503 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:22:25.825405 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-2cf7ebfa-6f53-4443-b047-698b67c5a503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:22:25.833792 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 697/1378] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:22:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:22:25.877063 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657284df-1772-4e93-9a2f-86fc98567ba4 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:22:25.892394 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657284df-1772-4e93-9a2f-86fc98567ba4 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:22:25.899380 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4c7b3c-212a-4c41-9c25-064702893cbc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13530240e2d446b6bf26a431d001362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:22:25.900020 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c7b3c-212a-4c41-9c25-064702893cbc service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:22:25.900299 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c7b3c-212a-4c41-9c25-064702893cbc service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:22:25.900614 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c7b3c-212a-4c41-9c25-064702893cbc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:22:25.909510 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4c7b3c-212a-4c41-9c25-064702893cbc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:22:25.911517 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4c7b3c-212a-4c41-9c25-064702893cbc service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:22:25.915482 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:22:25.922448 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 682/1379] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:22:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:22:27.933432 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b25e2-da88-4f80-a0f0-6a5f8df3ff67 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:22:27.934008 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b25e2-da88-4f80-a0f0-6a5f8df3ff67 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:22:27.934008 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b25e2-da88-4f80-a0f0-6a5f8df3ff67 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:22:27.935347 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 698/1380] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:22:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:22:27.941917 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72e150-700e-4a6a-8d07-48eb9478561f None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:22:27.942684 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72e150-700e-4a6a-8d07-48eb9478561f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:22:27.943159 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72e150-700e-4a6a-8d07-48eb9478561f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:22:27.968183 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-ac72e150-700e-4a6a-8d07-48eb9478561f None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:22:27.969988 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ac72e150-700e-4a6a-8d07-48eb9478561f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:22:27.984501 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 683/1381] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:22:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:22:28.028523 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b25e2-da88-4f80-a0f0-6a5f8df3ff67 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:22:28.045252 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b25e2-da88-4f80-a0f0-6a5f8df3ff67 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:22:28.051530 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e2633a-16ff-4365-bd5f-9004bfd4ecd0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13530240e2d446b6bf26a431d001362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:22:28.052175 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2633a-16ff-4365-bd5f-9004bfd4ecd0 service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:22:28.052459 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2633a-16ff-4365-bd5f-9004bfd4ecd0 service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:22:28.052731 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2633a-16ff-4365-bd5f-9004bfd4ecd0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:22:28.061530 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e2633a-16ff-4365-bd5f-9004bfd4ecd0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:22:28.063192 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e2633a-16ff-4365-bd5f-9004bfd4ecd0 service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:22:28.073090 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 699/1382] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:22:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:22:30.125024 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c792a4b-b87e-404c-bbaf-c0938a750d00 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:22:30.125613 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c792a4b-b87e-404c-bbaf-c0938a750d00 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:22:30.125613 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c792a4b-b87e-404c-bbaf-c0938a750d00 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:22:30.127134 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 684/1383] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:22:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:22:30.132662 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8136b6-6f45-44e3-a4b9-38e59a55ac81 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:22:30.133086 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8136b6-6f45-44e3-a4b9-38e59a55ac81 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:22:30.133408 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8136b6-6f45-44e3-a4b9-38e59a55ac81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:22:30.153081 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-7a8136b6-6f45-44e3-a4b9-38e59a55ac81 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:22:30.154286 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-7a8136b6-6f45-44e3-a4b9-38e59a55ac81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:22:30.164083 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 700/1384] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:22:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:22:30.206758 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c792a4b-b87e-404c-bbaf-c0938a750d00 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:22:30.221989 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c792a4b-b87e-404c-bbaf-c0938a750d00 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:22:30.227871 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1530b088-fcff-4085-9722-14ea1f53e820 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13530240e2d446b6bf26a431d001362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:22:30.228638 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1530b088-fcff-4085-9722-14ea1f53e820 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:22:30.229020 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1530b088-fcff-4085-9722-14ea1f53e820 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:22:30.229393 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1530b088-fcff-4085-9722-14ea1f53e820 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:22:30.238438 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1530b088-fcff-4085-9722-14ea1f53e820 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:22:30.240177 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1530b088-fcff-4085-9722-14ea1f53e820 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:22:30.250528 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 685/1385] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:22:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:22:32.265535 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456e25d-b4a8-4ad7-8002-0e0867af3ab3 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:22:32.266186 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456e25d-b4a8-4ad7-8002-0e0867af3ab3 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:22:32.266186 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456e25d-b4a8-4ad7-8002-0e0867af3ab3 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:22:32.272699 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f514e-c74a-49e4-9c1c-fd367607c24d None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:22:32.273288 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f514e-c74a-49e4-9c1c-fd367607c24d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:22:32.273288 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f514e-c74a-49e4-9c1c-fd367607c24d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:22:32.275279 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 701/1386] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:22:32 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:22:32.292445 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-8f6f514e-c74a-49e4-9c1c-fd367607c24d None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:22:32.293638 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8f6f514e-c74a-49e4-9c1c-fd367607c24d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:22:32.315947 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 686/1387] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:22:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:22:32.346882 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c456e25d-b4a8-4ad7-8002-0e0867af3ab3 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:22:32.364804 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c456e25d-b4a8-4ad7-8002-0e0867af3ab3 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:22:32.371014 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd6aeb9-cc88-476a-afa8-fb26d3d3770a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13530240e2d446b6bf26a431d001362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:22:32.371704 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd6aeb9-cc88-476a-afa8-fb26d3d3770a service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:22:32.371986 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd6aeb9-cc88-476a-afa8-fb26d3d3770a service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:22:32.372260 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd6aeb9-cc88-476a-afa8-fb26d3d3770a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:22:32.383351 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd6aeb9-cc88-476a-afa8-fb26d3d3770a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:22:32.385033 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd6aeb9-cc88-476a-afa8-fb26d3d3770a service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:22:32.396209 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 702/1388] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:22:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:22:34.436920 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1ea06-ba47-482a-b33c-d037c75c84d2 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:22:34.437633 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1ea06-ba47-482a-b33c-d037c75c84d2 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:22:34.437633 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1ea06-ba47-482a-b33c-d037c75c84d2 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:22:34.438871 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 687/1389] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:22:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:22:34.444368 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb6531-b7da-4999-8bc6-3a80020f75d4 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:22:34.444872 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb6531-b7da-4999-8bc6-3a80020f75d4 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:22:34.444966 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb6531-b7da-4999-8bc6-3a80020f75d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:22:34.464098 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-c5eb6531-b7da-4999-8bc6-3a80020f75d4 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:22:34.465301 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-c5eb6531-b7da-4999-8bc6-3a80020f75d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:22:34.475432 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 703/1390] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:22:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:22:34.519696 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc1ea06-ba47-482a-b33c-d037c75c84d2 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:22:34.536921 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc1ea06-ba47-482a-b33c-d037c75c84d2 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:22:34.543186 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901a57c-370e-4d33-903a-f6a1e6a67ecd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13530240e2d446b6bf26a431d001362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:22:34.543832 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901a57c-370e-4d33-903a-f6a1e6a67ecd service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:22:34.544139 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901a57c-370e-4d33-903a-f6a1e6a67ecd service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:22:34.544385 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901a57c-370e-4d33-903a-f6a1e6a67ecd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:22:34.553583 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2901a57c-370e-4d33-903a-f6a1e6a67ecd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:22:34.555214 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2901a57c-370e-4d33-903a-f6a1e6a67ecd service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:22:34.565575 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 688/1391] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:22:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:22:36.616019 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb1d0e-a9fd-4001-9dc5-3611b504974b None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:22:36.616556 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb1d0e-a9fd-4001-9dc5-3611b504974b None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:22:36.616740 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb1d0e-a9fd-4001-9dc5-3611b504974b None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:22:36.618592 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 704/1392] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:22:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:22:36.625134 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc319e-7161-44de-9330-d4adbd9ade75 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:22:36.625570 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc319e-7161-44de-9330-d4adbd9ade75 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:22:36.625673 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc319e-7161-44de-9330-d4adbd9ade75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:22:36.643940 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-06bc319e-7161-44de-9330-d4adbd9ade75 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:22:36.645297 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-06bc319e-7161-44de-9330-d4adbd9ade75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:22:36.653458 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 689/1393] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:22:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:22:36.699535 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fb1d0e-a9fd-4001-9dc5-3611b504974b None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:22:36.718255 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fb1d0e-a9fd-4001-9dc5-3611b504974b None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:22:36.726707 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199021cd-1830-4be5-abf6-aed0e465368e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13530240e2d446b6bf26a431d001362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:22:36.727590 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199021cd-1830-4be5-abf6-aed0e465368e service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:22:36.727958 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199021cd-1830-4be5-abf6-aed0e465368e service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:22:36.728307 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199021cd-1830-4be5-abf6-aed0e465368e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:22:36.739456 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199021cd-1830-4be5-abf6-aed0e465368e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:22:36.741117 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199021cd-1830-4be5-abf6-aed0e465368e service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:22:36.752012 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 705/1394] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:22:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:22:38.821004 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b377fd7-ba5a-4a1c-8194-46f30a2e5afa None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:22:38.821580 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b377fd7-ba5a-4a1c-8194-46f30a2e5afa None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:22:38.821580 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b377fd7-ba5a-4a1c-8194-46f30a2e5afa None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:22:38.822963 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 690/1395] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:22:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:22:38.828482 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc98bab-d9c1-42de-943c-333a200eca6f None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:22:38.828869 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc98bab-d9c1-42de-943c-333a200eca6f None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:22:38.829018 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc98bab-d9c1-42de-943c-333a200eca6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:22:38.847655 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-3fc98bab-d9c1-42de-943c-333a200eca6f None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:22:38.848843 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-3fc98bab-d9c1-42de-943c-333a200eca6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:22:38.857460 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 706/1396] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:22:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:22:38.900715 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b377fd7-ba5a-4a1c-8194-46f30a2e5afa None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:22:38.916875 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b377fd7-ba5a-4a1c-8194-46f30a2e5afa None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:22:38.922576 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c29f340-3045-4eb3-b215-2ecb3ade59bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13530240e2d446b6bf26a431d001362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:22:38.923291 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c29f340-3045-4eb3-b215-2ecb3ade59bf service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:22:38.923546 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c29f340-3045-4eb3-b215-2ecb3ade59bf service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:22:38.923844 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c29f340-3045-4eb3-b215-2ecb3ade59bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:22:38.932423 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c29f340-3045-4eb3-b215-2ecb3ade59bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:22:38.934010 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c29f340-3045-4eb3-b215-2ecb3ade59bf service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:22:38.943757 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 691/1397] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:22:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:22:39.965568 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe2793-64ea-4f65-8618-3a62b1b9c8b6 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:22:39.966186 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe2793-64ea-4f65-8618-3a62b1b9c8b6 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:22:39.966186 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe2793-64ea-4f65-8618-3a62b1b9c8b6 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:22:39.967543 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 707/1398] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:22:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:22:39.972999 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4991d26b-3580-45e8-a80e-02569df3926d None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:22:39.973411 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4991d26b-3580-45e8-a80e-02569df3926d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:22:39.973594 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4991d26b-3580-45e8-a80e-02569df3926d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:22:39.992584 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-4991d26b-3580-45e8-a80e-02569df3926d None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:22:39.993777 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4991d26b-3580-45e8-a80e-02569df3926d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:22:40.002049 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 692/1399] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:22:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:22:40.057668 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b0d22-597f-45e7-8633-74bdbe657af8 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:22:40.057956 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b0d22-597f-45e7-8633-74bdbe657af8 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:22:40.058230 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b0d22-597f-45e7-8633-74bdbe657af8 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:22:40.059684 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 708/1400] 10.222.0.60 () {54 vars in 962 bytes} [Sat Jul 2 03:22:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:22:40.064687 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fff9b7-4c2c-46a5-8f4c-5891d8d33bce None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:22:40.064978 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fff9b7-4c2c-46a5-8f4c-5891d8d33bce None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:22:40.065258 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fff9b7-4c2c-46a5-8f4c-5891d8d33bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:22:40.119622 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-48fff9b7-4c2c-46a5-8f4c-5891d8d33bce None None] MFA Rules not processed for user `6470ccbf858f47bf9bb884476bf4235e`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:22:40.120892 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-48fff9b7-4c2c-46a5-8f4c-5891d8d33bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:22:40.181719 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 693/1401] 10.222.0.60 () {58 vars in 1059 bytes} [Sat Jul 2 03:22:40 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:22:40.189775 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9b0d22-597f-45e7-8633-74bdbe657af8 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:22:40.201098 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9b0d22-597f-45e7-8633-74bdbe657af8 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:22:40.204911 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f6e79d-e952-4c8d-b575-6ec763a1a2c5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6470ccbf858f47bf9bb884476bf4235e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:22:40.205549 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6e79d-e952-4c8d-b575-6ec763a1a2c5 service glance] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:22:40.205828 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6e79d-e952-4c8d-b575-6ec763a1a2c5 service glance] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:22:40.206123 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6e79d-e952-4c8d-b575-6ec763a1a2c5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:22:40.215224 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f6e79d-e952-4c8d-b575-6ec763a1a2c5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:22:40.216721 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f6e79d-e952-4c8d-b575-6ec763a1a2c5 service glance] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:22:40.226285 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 709/1402] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:22:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:22:40.934921 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe0c23-f2f0-4dcf-91c6-7e9c1dab8ffa None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:22:40.935236 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe0c23-f2f0-4dcf-91c6-7e9c1dab8ffa None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:22:40.935513 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe0c23-f2f0-4dcf-91c6-7e9c1dab8ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:22:40.984157 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-00fe0c23-f2f0-4dcf-91c6-7e9c1dab8ffa None None] MFA Rules not processed for user `3333e7495b9546d882e2a2211ff8875c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:22:40.985340 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-00fe0c23-f2f0-4dcf-91c6-7e9c1dab8ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:22:41.025837 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f09d73b-52a2-421d-8ac4-279fb12a29fe None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:22:41.026372 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f09d73b-52a2-421d-8ac4-279fb12a29fe None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:22:41.026372 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f09d73b-52a2-421d-8ac4-279fb12a29fe None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:22:41.027536 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:22:41.027826 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 710/1403] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:22:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:22:41.033127 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea63857-192f-4a93-99a2-d5468db83624 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:22:41.033418 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea63857-192f-4a93-99a2-d5468db83624 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:22:41.033694 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea63857-192f-4a93-99a2-d5468db83624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:22:41.051615 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-cea63857-192f-4a93-99a2-d5468db83624 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:22:41.052812 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-cea63857-192f-4a93-99a2-d5468db83624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:22:41.053486 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 694/1404] 10.222.0.60 () {58 vars in 1009 bytes} [Sat Jul 2 03:22:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:22:41.061117 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 711/1405] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:22:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 03:22:41.093979 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa14671b-6efa-4385-a508-657c8d12fe27 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:22:41.094104 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa14671b-6efa-4385-a508-657c8d12fe27 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:22:41.094405 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa14671b-6efa-4385-a508-657c8d12fe27 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:22:41.095888 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 695/1406] 10.222.0.60 () {54 vars in 942 bytes} [Sat Jul 2 03:22:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:22:41.105017 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea63857-192f-4a93-99a2-d5468db83624 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:22:41.105517 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b7383-152d-4ec7-b4fa-7df945003d0e None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:22:41.105829 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b7383-152d-4ec7-b4fa-7df945003d0e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:22:41.106102 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b7383-152d-4ec7-b4fa-7df945003d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:22:41.117681 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea63857-192f-4a93-99a2-d5468db83624 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:22:41.124164 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce55624-7359-42ae-8b0e-f973fd1c72af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13530240e2d446b6bf26a431d001362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:22:41.125015 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce55624-7359-42ae-8b0e-f973fd1c72af service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:22:41.125341 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce55624-7359-42ae-8b0e-f973fd1c72af service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:22:41.125612 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce55624-7359-42ae-8b0e-f973fd1c72af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:22:41.134684 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce55624-7359-42ae-8b0e-f973fd1c72af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:22:41.136299 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce55624-7359-42ae-8b0e-f973fd1c72af service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:22:41.145906 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 712/1407] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:22:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:22:41.154167 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-6c2b7383-152d-4ec7-b4fa-7df945003d0e None None] MFA Rules not processed for user `692ec343bf9f4339ba691440f55a6c37`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:22:41.155389 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-6c2b7383-152d-4ec7-b4fa-7df945003d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:22:41.236782 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 696/1408] 10.222.0.60 () {58 vars in 1039 bytes} [Sat Jul 2 03:22:41 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:22:41.246597 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce55624-7359-42ae-8b0e-f973fd1c72af service nova] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:22:41.259305 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce55624-7359-42ae-8b0e-f973fd1c72af service nova] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:22:41.265353 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67db4b-6150-4cd3-8da7-3d70dac32f77 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '692ec343bf9f4339ba691440f55a6c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:22:41.266193 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67db4b-6150-4cd3-8da7-3d70dac32f77 service swift] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:22:41.266477 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67db4b-6150-4cd3-8da7-3d70dac32f77 service swift] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:22:41.266748 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67db4b-6150-4cd3-8da7-3d70dac32f77 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:22:41.276468 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed67db4b-6150-4cd3-8da7-3d70dac32f77 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:22:41.278082 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed67db4b-6150-4cd3-8da7-3d70dac32f77 service swift] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:22:41.287999 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 713/1409] 10.222.0.60 () {60 vars in 1384 bytes} [Sat Jul 2 03:22:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 03:22:51.233327 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=53 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:22:51.283749 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=75 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:23:03.208886 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab914be1-39c0-4c6c-8327-2f2e5acf13f3 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:23:03.209469 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab914be1-39c0-4c6c-8327-2f2e5acf13f3 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:23:03.209469 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab914be1-39c0-4c6c-8327-2f2e5acf13f3 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:23:03.210816 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 697/1410] 10.222.0.60 () {54 vars in 918 bytes} [Sat Jul 2 03:23:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:23:03.216824 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3643ac-9401-4a57-a7a8-c348d72c929e None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:23:03.217281 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3643ac-9401-4a57-a7a8-c348d72c929e None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:23:03.217387 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3643ac-9401-4a57-a7a8-c348d72c929e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:23:03.240668 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-2f3643ac-9401-4a57-a7a8-c348d72c929e None None] MFA Rules not processed for user `9dafc9be75a64db095fe08b9cbb04cbd`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:23:03.241878 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-2f3643ac-9401-4a57-a7a8-c348d72c929e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:23:03.252416 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 714/1411] 10.222.0.60 () {58 vars in 1015 bytes} [Sat Jul 2 03:23:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:23:03.266973 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60481d81-e04b-48e8-93e4-c66a9e305b09 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:23:03.267230 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60481d81-e04b-48e8-93e4-c66a9e305b09 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:23:03.267518 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60481d81-e04b-48e8-93e4-c66a9e305b09 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:23:03.268885 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 698/1412] 10.222.0.60 () {54 vars in 918 bytes} [Sat Jul 2 03:23:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:23:03.273613 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116a05c-5b58-4f6b-9772-097962e98e25 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:23:03.273932 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116a05c-5b58-4f6b-9772-097962e98e25 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:23:03.274202 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116a05c-5b58-4f6b-9772-097962e98e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:23:03.293990 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-2116a05c-5b58-4f6b-9772-097962e98e25 None None] MFA Rules not processed for user `13530240e2d446b6bf26a431d001362a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:23:03.295227 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-2116a05c-5b58-4f6b-9772-097962e98e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:23:03.306437 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 715/1413] 10.222.0.60 () {58 vars in 1015 bytes} [Sat Jul 2 03:23:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:23:05.821282 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea2d90a-a15d-4214-ae53-61900040e7a1 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:23:05.822098 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea2d90a-a15d-4214-ae53-61900040e7a1 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:23:05.822098 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea2d90a-a15d-4214-ae53-61900040e7a1 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:23:05.824361 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 699/1414] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 2 03:23:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:23:05.833194 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cc1307-563c-49be-b3c1-c4abf2c58535 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:23:05.833906 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cc1307-563c-49be-b3c1-c4abf2c58535 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:23:05.834099 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cc1307-563c-49be-b3c1-c4abf2c58535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:23:05.858265 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-f2cc1307-563c-49be-b3c1-c4abf2c58535 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:23:05.859497 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-f2cc1307-563c-49be-b3c1-c4abf2c58535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:23:05.868969 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 716/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 2 03:23:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:23:05.917129 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea2d90a-a15d-4214-ae53-61900040e7a1 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:23:05.932396 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea2d90a-a15d-4214-ae53-61900040e7a1 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:23:05.937642 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e5b41-93f4-4d57-8488-10e1e3bf6bfb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13530240e2d446b6bf26a431d001362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:23:05.938267 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e5b41-93f4-4d57-8488-10e1e3bf6bfb service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:23:05.938545 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e5b41-93f4-4d57-8488-10e1e3bf6bfb service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:23:05.938847 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e5b41-93f4-4d57-8488-10e1e3bf6bfb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:23:05.947421 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64e5b41-93f4-4d57-8488-10e1e3bf6bfb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:23:05.949019 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64e5b41-93f4-4d57-8488-10e1e3bf6bfb service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:23:05.958571 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 700/1416] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:23:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:23:06.863990 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd95a88-8fd8-408e-a7ad-cd8eaaeeec6c None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:23:06.864848 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd95a88-8fd8-408e-a7ad-cd8eaaeeec6c None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:23:06.864848 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd95a88-8fd8-408e-a7ad-cd8eaaeeec6c None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:23:06.867104 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 717/1417] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 2 03:23:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:23:06.873241 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2974cdd-ab38-4932-9419-af0683665f0a None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:23:06.873687 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2974cdd-ab38-4932-9419-af0683665f0a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:23:06.873801 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2974cdd-ab38-4932-9419-af0683665f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:23:06.896129 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-f2974cdd-ab38-4932-9419-af0683665f0a None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:23:06.897348 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f2974cdd-ab38-4932-9419-af0683665f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:23:06.906068 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 701/1418] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 2 03:23:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:23:07.056446 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd95a88-8fd8-408e-a7ad-cd8eaaeeec6c None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:23:07.077454 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd95a88-8fd8-408e-a7ad-cd8eaaeeec6c None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:23:07.084472 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25788ea-fa68-406c-8a14-d6b495756a01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13530240e2d446b6bf26a431d001362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:23:07.085134 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25788ea-fa68-406c-8a14-d6b495756a01 service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:23:07.085409 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25788ea-fa68-406c-8a14-d6b495756a01 service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:23:07.085676 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25788ea-fa68-406c-8a14-d6b495756a01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:23:07.094410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25788ea-fa68-406c-8a14-d6b495756a01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:23:07.096028 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25788ea-fa68-406c-8a14-d6b495756a01 service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:23:07.105873 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 718/1419] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:23:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:23:07.974879 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55eb650-d843-470b-82f3-b3478d78b839 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:23:07.975790 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55eb650-d843-470b-82f3-b3478d78b839 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:23:07.975892 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55eb650-d843-470b-82f3-b3478d78b839 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:23:07.978163 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 702/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 2 03:23:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:23:07.984279 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f049e-be30-47e0-a558-efebf3ae507d None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:23:07.984742 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f049e-be30-47e0-a558-efebf3ae507d None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:23:07.984844 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f049e-be30-47e0-a558-efebf3ae507d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:23:08.005489 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-e86f049e-be30-47e0-a558-efebf3ae507d None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:23:08.006705 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-e86f049e-be30-47e0-a558-efebf3ae507d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:23:08.015887 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 719/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 2 03:23:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:23:08.166477 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55eb650-d843-470b-82f3-b3478d78b839 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:23:08.189497 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55eb650-d843-470b-82f3-b3478d78b839 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:23:08.196167 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e02066-4666-4988-8cda-07c858285208 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13530240e2d446b6bf26a431d001362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:23:08.196799 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e02066-4666-4988-8cda-07c858285208 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:23:08.197081 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e02066-4666-4988-8cda-07c858285208 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:23:08.197383 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e02066-4666-4988-8cda-07c858285208 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:23:08.206649 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e02066-4666-4988-8cda-07c858285208 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:23:08.208316 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e02066-4666-4988-8cda-07c858285208 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:23:08.219007 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 703/1422] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:23:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:23:09.088019 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb280c8-7ce8-4f13-be36-d1c2e5734cf7 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:23:09.088883 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb280c8-7ce8-4f13-be36-d1c2e5734cf7 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:23:09.088883 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb280c8-7ce8-4f13-be36-d1c2e5734cf7 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:23:09.091163 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 720/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 2 03:23:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:23:09.097706 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699505c-80ad-4350-896e-ff1f4123d79f None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:23:09.098187 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699505c-80ad-4350-896e-ff1f4123d79f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:23:09.098292 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699505c-80ad-4350-896e-ff1f4123d79f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:23:09.118387 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-2699505c-80ad-4350-896e-ff1f4123d79f None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:23:09.119613 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2699505c-80ad-4350-896e-ff1f4123d79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:23:09.129927 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 704/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 2 03:23:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:23:09.281687 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb280c8-7ce8-4f13-be36-d1c2e5734cf7 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:23:09.300769 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb280c8-7ce8-4f13-be36-d1c2e5734cf7 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:23:09.306871 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156338bb-dd02-40f2-ac49-276023c24339 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13530240e2d446b6bf26a431d001362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:23:09.307529 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156338bb-dd02-40f2-ac49-276023c24339 service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:23:09.307805 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156338bb-dd02-40f2-ac49-276023c24339 service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:23:09.308083 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156338bb-dd02-40f2-ac49-276023c24339 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:23:09.316512 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156338bb-dd02-40f2-ac49-276023c24339 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:23:09.318086 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156338bb-dd02-40f2-ac49-276023c24339 service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:23:09.327632 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 721/1425] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:23:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:23:10.189195 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c60ca-53c6-4b85-9bf1-318613ef9071 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:23:10.190109 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c60ca-53c6-4b85-9bf1-318613ef9071 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:23:10.190109 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c60ca-53c6-4b85-9bf1-318613ef9071 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:23:10.192268 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 705/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 2 03:23:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:23:10.197385 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb79e85-7d6a-478f-911a-17b8e48af914 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:23:10.197811 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb79e85-7d6a-478f-911a-17b8e48af914 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:23:10.197937 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb79e85-7d6a-478f-911a-17b8e48af914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:23:10.220444 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-9bb79e85-7d6a-478f-911a-17b8e48af914 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:23:10.221643 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-9bb79e85-7d6a-478f-911a-17b8e48af914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:23:10.230870 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 722/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 2 03:23:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:23:10.380524 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1c60ca-53c6-4b85-9bf1-318613ef9071 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:23:10.396837 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1c60ca-53c6-4b85-9bf1-318613ef9071 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:23:10.403109 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2871ef-5d52-4765-af7d-76757e46444c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13530240e2d446b6bf26a431d001362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:23:10.403809 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2871ef-5d52-4765-af7d-76757e46444c service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:23:10.404084 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2871ef-5d52-4765-af7d-76757e46444c service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:23:10.404355 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2871ef-5d52-4765-af7d-76757e46444c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:23:10.413328 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2871ef-5d52-4765-af7d-76757e46444c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:23:10.414909 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2871ef-5d52-4765-af7d-76757e46444c service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:23:10.424976 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 706/1428] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:23:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:23:11.238788 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc3fd0-257e-46e2-a481-30a20533ece7 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:23:11.239365 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc3fd0-257e-46e2-a481-30a20533ece7 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:23:11.239365 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc3fd0-257e-46e2-a481-30a20533ece7 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:23:11.240779 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 723/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 2 03:23:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:23:11.246904 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb23dff-38bf-45f8-902f-4a6d91e7f099 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:23:11.247650 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb23dff-38bf-45f8-902f-4a6d91e7f099 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:23:11.247854 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb23dff-38bf-45f8-902f-4a6d91e7f099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:23:11.269413 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-bcb23dff-38bf-45f8-902f-4a6d91e7f099 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:23:11.270601 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-bcb23dff-38bf-45f8-902f-4a6d91e7f099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:23:11.279931 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 707/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 2 03:23:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:23:11.429154 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbc3fd0-257e-46e2-a481-30a20533ece7 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:23:11.452587 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbc3fd0-257e-46e2-a481-30a20533ece7 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:23:11.461318 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495005ac-db6b-4197-a721-b33ba6414739 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13530240e2d446b6bf26a431d001362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:23:11.461954 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495005ac-db6b-4197-a721-b33ba6414739 service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:23:11.462232 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495005ac-db6b-4197-a721-b33ba6414739 service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:23:11.462501 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495005ac-db6b-4197-a721-b33ba6414739 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:23:11.471544 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495005ac-db6b-4197-a721-b33ba6414739 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:23:11.473173 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495005ac-db6b-4197-a721-b33ba6414739 service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:23:11.483241 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 724/1431] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:23:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:23:12.284684 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1702b-d288-4ee1-9b68-e6ca8f213587 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:23:12.285258 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1702b-d288-4ee1-9b68-e6ca8f213587 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:23:12.285258 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1702b-d288-4ee1-9b68-e6ca8f213587 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:23:12.286636 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 708/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 2 03:23:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:23:12.292197 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faee092-28d9-4911-9769-79283d8e96a8 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:23:12.292672 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faee092-28d9-4911-9769-79283d8e96a8 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:23:12.292781 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faee092-28d9-4911-9769-79283d8e96a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:23:12.312616 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-2faee092-28d9-4911-9769-79283d8e96a8 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:23:12.313798 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-2faee092-28d9-4911-9769-79283d8e96a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:23:12.322268 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 725/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 2 03:23:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:23:12.481623 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d1702b-d288-4ee1-9b68-e6ca8f213587 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:23:12.501296 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d1702b-d288-4ee1-9b68-e6ca8f213587 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:23:12.511935 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b96b23-02b9-4991-b7d5-8eff6d2b4bba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13530240e2d446b6bf26a431d001362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:23:12.513770 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b96b23-02b9-4991-b7d5-8eff6d2b4bba service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:23:12.514410 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b96b23-02b9-4991-b7d5-8eff6d2b4bba service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:23:12.514818 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b96b23-02b9-4991-b7d5-8eff6d2b4bba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:23:12.529256 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b96b23-02b9-4991-b7d5-8eff6d2b4bba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:23:12.531916 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b96b23-02b9-4991-b7d5-8eff6d2b4bba service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:23:12.548643 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 709/1434] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:23:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:23:13.355046 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dfcd02-5aa5-4387-81aa-d09c59bc130d None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:23:13.355979 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dfcd02-5aa5-4387-81aa-d09c59bc130d None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:23:13.355979 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dfcd02-5aa5-4387-81aa-d09c59bc130d None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:23:13.358085 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 726/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 2 03:23:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:23:13.366419 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171c04f-093c-4db2-9c92-4f6224027f76 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:23:13.366870 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171c04f-093c-4db2-9c92-4f6224027f76 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:23:13.366972 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171c04f-093c-4db2-9c92-4f6224027f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:23:13.388491 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-b171c04f-093c-4db2-9c92-4f6224027f76 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:23:13.389699 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b171c04f-093c-4db2-9c92-4f6224027f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:23:13.398780 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 710/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 2 03:23:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:23:13.559693 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dfcd02-5aa5-4387-81aa-d09c59bc130d None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:23:13.579312 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dfcd02-5aa5-4387-81aa-d09c59bc130d None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:23:13.585908 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92194122-099a-4734-bc30-8601d4fa7d1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13530240e2d446b6bf26a431d001362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:23:13.586545 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92194122-099a-4734-bc30-8601d4fa7d1e service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:23:13.586830 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92194122-099a-4734-bc30-8601d4fa7d1e service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:23:13.587111 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92194122-099a-4734-bc30-8601d4fa7d1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:23:13.596271 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92194122-099a-4734-bc30-8601d4fa7d1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:23:13.597948 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92194122-099a-4734-bc30-8601d4fa7d1e service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:23:13.607689 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 727/1437] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:23:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:23:14.393682 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13deedef-b98b-455b-8271-c5a160588e3f None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:23:14.394182 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13deedef-b98b-455b-8271-c5a160588e3f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:23:14.394182 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13deedef-b98b-455b-8271-c5a160588e3f None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:23:14.395666 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 711/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 2 03:23:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:23:14.401587 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085341bd-189a-4922-b455-f0a5a373e0d8 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:23:14.402078 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085341bd-189a-4922-b455-f0a5a373e0d8 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:23:14.402190 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085341bd-189a-4922-b455-f0a5a373e0d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:23:14.424238 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-085341bd-189a-4922-b455-f0a5a373e0d8 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:23:14.425448 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-085341bd-189a-4922-b455-f0a5a373e0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:23:14.434791 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 728/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 2 03:23:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:23:14.598955 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13deedef-b98b-455b-8271-c5a160588e3f None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:23:14.620755 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13deedef-b98b-455b-8271-c5a160588e3f None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:23:14.626795 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7cf68b-6915-4713-ade7-386d53d834f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13530240e2d446b6bf26a431d001362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:23:14.627423 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7cf68b-6915-4713-ade7-386d53d834f1 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:23:14.627699 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7cf68b-6915-4713-ade7-386d53d834f1 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:23:14.627966 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7cf68b-6915-4713-ade7-386d53d834f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:23:14.636197 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7cf68b-6915-4713-ade7-386d53d834f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:23:14.637772 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7cf68b-6915-4713-ade7-386d53d834f1 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:23:14.647185 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 712/1440] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:23:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:23:16.566684 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11db8e-ae24-4e6d-b024-f0f62f63a6f5 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:23:16.567753 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11db8e-ae24-4e6d-b024-f0f62f63a6f5 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:23:16.567753 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11db8e-ae24-4e6d-b024-f0f62f63a6f5 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:23:16.569923 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 729/1441] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 2 03:23:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:23:16.581580 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8254a52-2a80-4148-b786-dd157978a969 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:23:16.582294 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8254a52-2a80-4148-b786-dd157978a969 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:23:16.583049 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8254a52-2a80-4148-b786-dd157978a969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:23:16.610463 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-b8254a52-2a80-4148-b786-dd157978a969 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:23:16.611701 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b8254a52-2a80-4148-b786-dd157978a969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:23:16.622170 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 713/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 2 03:23:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:23:16.663581 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d11db8e-ae24-4e6d-b024-f0f62f63a6f5 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:23:16.680166 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d11db8e-ae24-4e6d-b024-f0f62f63a6f5 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:23:16.684419 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8546ff9b-459b-4b63-b078-41b42f3feca9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:23:16.685059 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8546ff9b-459b-4b63-b078-41b42f3feca9 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:23:16.685369 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8546ff9b-459b-4b63-b078-41b42f3feca9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:23:16.685683 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8546ff9b-459b-4b63-b078-41b42f3feca9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:23:16.695157 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8546ff9b-459b-4b63-b078-41b42f3feca9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:23:16.696631 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8546ff9b-459b-4b63-b078-41b42f3feca9 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:23:16.706245 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 730/1443] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:23:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:23:18.911084 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0e1e4-f182-4ae9-8615-6311099eec3f None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:23:18.911738 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0e1e4-f182-4ae9-8615-6311099eec3f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:23:18.911738 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0e1e4-f182-4ae9-8615-6311099eec3f None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:23:18.913390 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 714/1444] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 2 03:23:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:23:18.919379 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03422ae5-f2d7-47b9-805a-0d0078adcd15 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:23:18.919853 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03422ae5-f2d7-47b9-805a-0d0078adcd15 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:23:18.919962 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03422ae5-f2d7-47b9-805a-0d0078adcd15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:23:18.939739 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-03422ae5-f2d7-47b9-805a-0d0078adcd15 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:23:18.940942 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-03422ae5-f2d7-47b9-805a-0d0078adcd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:23:18.950179 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 731/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 2 03:23:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:23:18.989003 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0e1e4-f182-4ae9-8615-6311099eec3f None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:23:19.001459 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0e1e4-f182-4ae9-8615-6311099eec3f None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:23:19.005590 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb213e2-7011-4136-bf7b-bd4ce8720119 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:23:19.006280 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb213e2-7011-4136-bf7b-bd4ce8720119 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:23:19.006564 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb213e2-7011-4136-bf7b-bd4ce8720119 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:23:19.006843 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb213e2-7011-4136-bf7b-bd4ce8720119 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:23:19.016485 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb213e2-7011-4136-bf7b-bd4ce8720119 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:23:19.017921 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb213e2-7011-4136-bf7b-bd4ce8720119 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:23:19.028138 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 715/1446] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:23:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:23:21.387628 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbbbbed-8053-4a6a-82be-812ad3fdc2d8 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:23:21.388562 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbbbbed-8053-4a6a-82be-812ad3fdc2d8 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:23:21.388562 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbbbbed-8053-4a6a-82be-812ad3fdc2d8 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:23:21.390838 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 732/1447] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 2 03:23:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:23:21.396208 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97422242-9796-430b-9b66-0eac4335d981 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:23:21.396660 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97422242-9796-430b-9b66-0eac4335d981 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:23:21.396781 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97422242-9796-430b-9b66-0eac4335d981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:23:21.419798 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-97422242-9796-430b-9b66-0eac4335d981 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:23:21.420910 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-97422242-9796-430b-9b66-0eac4335d981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:23:21.429650 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 716/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 2 03:23:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:23:21.468008 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbbbbed-8053-4a6a-82be-812ad3fdc2d8 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:23:21.486111 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbbbbed-8053-4a6a-82be-812ad3fdc2d8 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:23:21.491462 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a76713-858c-4d2d-bde7-13d136991ca8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:23:21.492087 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a76713-858c-4d2d-bde7-13d136991ca8 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:23:21.492372 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a76713-858c-4d2d-bde7-13d136991ca8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:23:21.492634 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a76713-858c-4d2d-bde7-13d136991ca8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:23:21.501738 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a76713-858c-4d2d-bde7-13d136991ca8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:23:21.503206 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a76713-858c-4d2d-bde7-13d136991ca8 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:23:21.512558 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 733/1449] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:23:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:23:23.671078 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38520875-bbca-4e8f-a3e3-803742f300cf None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:23:23.671643 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38520875-bbca-4e8f-a3e3-803742f300cf None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:23:23.671759 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38520875-bbca-4e8f-a3e3-803742f300cf None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:23:23.673740 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 717/1450] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 2 03:23:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:23:23.680192 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c6d97-27fb-477f-ae2c-0947eb53a477 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:23:23.680596 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c6d97-27fb-477f-ae2c-0947eb53a477 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:23:23.680816 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c6d97-27fb-477f-ae2c-0947eb53a477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:23:23.699597 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-c99c6d97-27fb-477f-ae2c-0947eb53a477 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:23:23.700793 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-c99c6d97-27fb-477f-ae2c-0947eb53a477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:23:23.709979 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 734/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 2 03:23:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:23:23.748837 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38520875-bbca-4e8f-a3e3-803742f300cf None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:23:23.767443 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38520875-bbca-4e8f-a3e3-803742f300cf None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:23:23.772765 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f97dd-bf4f-41e6-af18-b2a3f47bcde2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:23:23.773392 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f97dd-bf4f-41e6-af18-b2a3f47bcde2 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:23:23.773666 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f97dd-bf4f-41e6-af18-b2a3f47bcde2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:23:23.773922 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f97dd-bf4f-41e6-af18-b2a3f47bcde2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:23:23.782879 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89f97dd-bf4f-41e6-af18-b2a3f47bcde2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:23:23.784416 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89f97dd-bf4f-41e6-af18-b2a3f47bcde2 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:23:23.793881 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 718/1452] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:23:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:23:25.857561 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da965435-f15d-4bac-b287-c246d209a7bf None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:23:25.858115 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da965435-f15d-4bac-b287-c246d209a7bf None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:23:25.858115 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da965435-f15d-4bac-b287-c246d209a7bf None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:23:25.859434 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 735/1453] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 2 03:23:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:23:25.865637 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f6104-101f-4d8c-a9eb-d79a88ed3507 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:23:25.866409 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f6104-101f-4d8c-a9eb-d79a88ed3507 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:23:25.866565 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f6104-101f-4d8c-a9eb-d79a88ed3507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:23:25.894831 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-012f6104-101f-4d8c-a9eb-d79a88ed3507 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:23:25.896075 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-012f6104-101f-4d8c-a9eb-d79a88ed3507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:23:25.905484 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 719/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 2 03:23:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:23:25.949930 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da965435-f15d-4bac-b287-c246d209a7bf None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:23:25.962804 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da965435-f15d-4bac-b287-c246d209a7bf None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:23:25.967333 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dc7b4f-5def-4d05-9756-022e2c6a58a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:23:25.967988 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc7b4f-5def-4d05-9756-022e2c6a58a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:23:25.968270 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc7b4f-5def-4d05-9756-022e2c6a58a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:23:25.968543 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc7b4f-5def-4d05-9756-022e2c6a58a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:23:25.978304 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dc7b4f-5def-4d05-9756-022e2c6a58a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:23:25.979775 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dc7b4f-5def-4d05-9756-022e2c6a58a5 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:23:25.989459 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 736/1455] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:23:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:23:28.055014 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba073b68-9c6b-4442-b855-dfc148b80c0c None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:23:28.055627 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba073b68-9c6b-4442-b855-dfc148b80c0c None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:23:28.055627 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba073b68-9c6b-4442-b855-dfc148b80c0c None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:23:28.057501 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 720/1456] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 2 03:23:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:23:28.066058 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0700ff-6a26-4ed6-8af3-889dac923a78 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:23:28.066751 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0700ff-6a26-4ed6-8af3-889dac923a78 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:23:28.066887 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0700ff-6a26-4ed6-8af3-889dac923a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:23:28.091526 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-1a0700ff-6a26-4ed6-8af3-889dac923a78 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:23:28.092739 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-1a0700ff-6a26-4ed6-8af3-889dac923a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:23:28.101663 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 737/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 2 03:23:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:23:28.140072 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba073b68-9c6b-4442-b855-dfc148b80c0c None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:23:28.151664 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba073b68-9c6b-4442-b855-dfc148b80c0c None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:23:28.155882 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e32f574-0d39-4d65-a84b-fee2a471959a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:23:28.156514 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e32f574-0d39-4d65-a84b-fee2a471959a service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:23:28.156787 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e32f574-0d39-4d65-a84b-fee2a471959a service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:23:28.157068 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e32f574-0d39-4d65-a84b-fee2a471959a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:23:28.166769 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e32f574-0d39-4d65-a84b-fee2a471959a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:23:28.168234 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e32f574-0d39-4d65-a84b-fee2a471959a service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:23:28.177770 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 721/1458] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:23:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:23:30.316047 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc345b4-b5e3-457d-b8e8-17073e705523 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:23:30.317019 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc345b4-b5e3-457d-b8e8-17073e705523 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:23:30.317019 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc345b4-b5e3-457d-b8e8-17073e705523 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:23:30.319015 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 738/1459] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 2 03:23:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:23:30.324576 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd35bd-8640-4f31-b0d3-ca965078b447 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:23:30.325040 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd35bd-8640-4f31-b0d3-ca965078b447 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:23:30.325175 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd35bd-8640-4f31-b0d3-ca965078b447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:23:30.343640 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-60bd35bd-8640-4f31-b0d3-ca965078b447 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:23:30.344826 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-60bd35bd-8640-4f31-b0d3-ca965078b447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:23:30.353161 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 722/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 2 03:23:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:23:30.390353 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc345b4-b5e3-457d-b8e8-17073e705523 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:23:30.402449 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc345b4-b5e3-457d-b8e8-17073e705523 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:23:30.406340 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab3e497-cd39-4a1c-8c9d-c515e8ba0d9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:23:30.407004 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab3e497-cd39-4a1c-8c9d-c515e8ba0d9d service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:23:30.407312 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab3e497-cd39-4a1c-8c9d-c515e8ba0d9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:23:30.407586 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab3e497-cd39-4a1c-8c9d-c515e8ba0d9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:23:30.417252 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab3e497-cd39-4a1c-8c9d-c515e8ba0d9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:23:30.418675 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab3e497-cd39-4a1c-8c9d-c515e8ba0d9d service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:23:30.428656 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 739/1461] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:23:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:23:32.485060 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202610ca-c639-4728-b84d-ccf4d03f1d0a None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:23:32.485934 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202610ca-c639-4728-b84d-ccf4d03f1d0a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:23:32.485934 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202610ca-c639-4728-b84d-ccf4d03f1d0a None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:23:32.488120 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 723/1462] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 2 03:23:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:23:32.493545 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44232524-14ac-4093-a84d-07b3e41793fa None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:23:32.493978 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44232524-14ac-4093-a84d-07b3e41793fa None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:23:32.494072 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44232524-14ac-4093-a84d-07b3e41793fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:23:32.500585 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=79 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:23:32.514479 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-44232524-14ac-4093-a84d-07b3e41793fa None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:23:32.515720 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-44232524-14ac-4093-a84d-07b3e41793fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:23:32.525154 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 740/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 2 03:23:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:23:32.566009 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202610ca-c639-4728-b84d-ccf4d03f1d0a None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:23:32.575299 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=73 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:23:32.584705 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202610ca-c639-4728-b84d-ccf4d03f1d0a None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:23:32.589157 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8138316-d96e-494a-b411-8252f3a5168a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:23:32.589804 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8138316-d96e-494a-b411-8252f3a5168a service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:23:32.590072 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8138316-d96e-494a-b411-8252f3a5168a service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:23:32.590330 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8138316-d96e-494a-b411-8252f3a5168a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:23:32.599903 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8138316-d96e-494a-b411-8252f3a5168a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:23:32.601345 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8138316-d96e-494a-b411-8252f3a5168a service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:23:32.611076 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 724/1464] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:23:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:23:34.640622 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334b03e-f2c4-4793-ab7a-29bf3a1b48e6 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:23:34.641155 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334b03e-f2c4-4793-ab7a-29bf3a1b48e6 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:23:34.641155 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334b03e-f2c4-4793-ab7a-29bf3a1b48e6 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:23:34.642450 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 741/1465] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 2 03:23:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:23:34.649070 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3856a29-5a78-40b4-a973-7af36fc66652 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:23:34.649736 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3856a29-5a78-40b4-a973-7af36fc66652 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:23:34.649976 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3856a29-5a78-40b4-a973-7af36fc66652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:23:34.670776 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-d3856a29-5a78-40b4-a973-7af36fc66652 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:23:34.672015 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d3856a29-5a78-40b4-a973-7af36fc66652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:23:34.681220 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 725/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 2 03:23:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:23:34.727227 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7334b03e-f2c4-4793-ab7a-29bf3a1b48e6 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:23:34.739353 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7334b03e-f2c4-4793-ab7a-29bf3a1b48e6 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:23:34.743091 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08280fc4-0001-40d4-82fa-8dd8b97cc895 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:23:34.743753 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08280fc4-0001-40d4-82fa-8dd8b97cc895 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:23:34.744032 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08280fc4-0001-40d4-82fa-8dd8b97cc895 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:23:34.744303 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08280fc4-0001-40d4-82fa-8dd8b97cc895 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:23:34.753716 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08280fc4-0001-40d4-82fa-8dd8b97cc895 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:23:34.755192 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08280fc4-0001-40d4-82fa-8dd8b97cc895 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:23:34.769822 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 742/1467] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:23:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:23:36.823330 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ef260-da76-451a-9f41-e6abceb4ab49 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:23:36.823918 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ef260-da76-451a-9f41-e6abceb4ab49 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:23:36.823918 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ef260-da76-451a-9f41-e6abceb4ab49 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:23:36.826047 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 726/1468] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 2 03:23:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:23:36.834852 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0083a24-d25f-4546-9269-2c20a2739941 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:23:36.835691 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0083a24-d25f-4546-9269-2c20a2739941 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:23:36.835842 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0083a24-d25f-4546-9269-2c20a2739941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:23:36.859056 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-f0083a24-d25f-4546-9269-2c20a2739941 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:23:36.860299 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-f0083a24-d25f-4546-9269-2c20a2739941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:23:36.869665 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 743/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 2 03:23:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:23:36.908437 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64ef260-da76-451a-9f41-e6abceb4ab49 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:23:36.920444 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64ef260-da76-451a-9f41-e6abceb4ab49 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:23:36.924594 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dbe0fb-4d96-4d5a-b325-acfcde9fc592 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:23:36.925265 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dbe0fb-4d96-4d5a-b325-acfcde9fc592 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:23:36.925544 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dbe0fb-4d96-4d5a-b325-acfcde9fc592 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:23:36.925820 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dbe0fb-4d96-4d5a-b325-acfcde9fc592 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:23:36.936873 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dbe0fb-4d96-4d5a-b325-acfcde9fc592 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:23:36.938370 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dbe0fb-4d96-4d5a-b325-acfcde9fc592 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:23:36.950529 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 727/1470] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:23:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:23:46.853785 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=11 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:23:46.944381 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=14 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:23:56.740258 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e91aac-8d6f-4a63-b8de-524bdd2ff711 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:23:56.740855 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e91aac-8d6f-4a63-b8de-524bdd2ff711 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:23:56.740855 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e91aac-8d6f-4a63-b8de-524bdd2ff711 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:23:56.742087 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 744/1471] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:23:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:23:56.748852 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ffd989-731f-42d5-b03d-920ca90253f0 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:23:56.749555 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ffd989-731f-42d5-b03d-920ca90253f0 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:23:56.749652 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ffd989-731f-42d5-b03d-920ca90253f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:23:56.776047 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-d0ffd989-731f-42d5-b03d-920ca90253f0 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:23:56.777253 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d0ffd989-731f-42d5-b03d-920ca90253f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:23:56.786679 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 728/1472] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:23:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:23:56.834557 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a35cd3-f7bb-4b1a-b5d7-675b0f4ca2f0 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:23:56.834839 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a35cd3-f7bb-4b1a-b5d7-675b0f4ca2f0 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:23:56.835083 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a35cd3-f7bb-4b1a-b5d7-675b0f4ca2f0 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:23:56.836509 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 745/1473] 10.222.0.60 () {54 vars in 962 bytes} [Sat Jul 2 03:23:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:23:56.843146 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c43fe71-b961-4a67-a045-80bacb66d0e8 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:23:56.843447 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c43fe71-b961-4a67-a045-80bacb66d0e8 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:23:56.843722 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c43fe71-b961-4a67-a045-80bacb66d0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:23:56.862436 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-8c43fe71-b961-4a67-a045-80bacb66d0e8 None None] MFA Rules not processed for user `6470ccbf858f47bf9bb884476bf4235e`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:23:56.863668 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8c43fe71-b961-4a67-a045-80bacb66d0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:23:56.870619 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 729/1474] 10.222.0.60 () {58 vars in 1059 bytes} [Sat Jul 2 03:23:56 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 03:23:56.877973 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a35cd3-f7bb-4b1a-b5d7-675b0f4ca2f0 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:23:56.889992 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a35cd3-f7bb-4b1a-b5d7-675b0f4ca2f0 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:23:56.894005 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90650454-e0db-4f2d-aa60-8cf7518204c6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6470ccbf858f47bf9bb884476bf4235e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:23:56.894630 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90650454-e0db-4f2d-aa60-8cf7518204c6 service glance] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:23:56.894909 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90650454-e0db-4f2d-aa60-8cf7518204c6 service glance] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:23:56.895214 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90650454-e0db-4f2d-aa60-8cf7518204c6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:23:56.904469 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90650454-e0db-4f2d-aa60-8cf7518204c6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:23:56.905902 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90650454-e0db-4f2d-aa60-8cf7518204c6 service glance] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:23:56.916189 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 746/1475] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:23:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:23:59.018854 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf1a9b-0005-4c45-b03b-5dba1d628a5c None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:23:59.019483 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf1a9b-0005-4c45-b03b-5dba1d628a5c None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:23:59.019483 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf1a9b-0005-4c45-b03b-5dba1d628a5c None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:23:59.020857 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 730/1476] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:23:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:23:59.026248 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1bfb4-98a3-489f-bf85-6d8c4ac266f5 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:23:59.026692 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1bfb4-98a3-489f-bf85-6d8c4ac266f5 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:23:59.026802 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1bfb4-98a3-489f-bf85-6d8c4ac266f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:23:59.046588 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-3fd1bfb4-98a3-489f-bf85-6d8c4ac266f5 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:23:59.047776 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-3fd1bfb4-98a3-489f-bf85-6d8c4ac266f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:23:59.058960 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 747/1477] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:23:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:23:59.082910 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf1a9b-0005-4c45-b03b-5dba1d628a5c None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:23:59.097679 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf1a9b-0005-4c45-b03b-5dba1d628a5c None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:23:59.102794 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db59e43-3631-4551-b4ac-abc5e3eadb7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:23:59.103490 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db59e43-3631-4551-b4ac-abc5e3eadb7a admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:23:59.103773 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db59e43-3631-4551-b4ac-abc5e3eadb7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:23:59.104046 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db59e43-3631-4551-b4ac-abc5e3eadb7a admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:23:59.104822 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db59e43-3631-4551-b4ac-abc5e3eadb7a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:23:59.106617 dv-cinder-846842-9-smb devstack@keystone.service[80234]: WARNING py.warnings [None req-7db59e43-3631-4551-b4ac-abc5e3eadb7a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 02 03:23:59.106617 dv-cinder-846842-9-smb devstack@keystone.service[80234]: warnings.warn(msg) Jul 02 03:23:59.106617 dv-cinder-846842-9-smb devstack@keystone.service[80234]: Jul 02 03:23:59.108368 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db59e43-3631-4551-b4ac-abc5e3eadb7a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:23:59.134681 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 731/1478] 10.222.0.60 () {56 vars in 1108 bytes} [Sat Jul 2 03:23:59 2022] GET /identity/v3/projects => generated 2553 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:24:01.145228 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3fc39-ed1e-4231-b3c3-b7e86893e256 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:24:01.145825 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3fc39-ed1e-4231-b3c3-b7e86893e256 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:24:01.145825 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3fc39-ed1e-4231-b3c3-b7e86893e256 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:24:01.147153 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 748/1479] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:24:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:24:01.153614 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd09eeaa-cd2c-4e0b-ae4c-41f89ff317c6 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:24:01.154352 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd09eeaa-cd2c-4e0b-ae4c-41f89ff317c6 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:24:01.154510 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd09eeaa-cd2c-4e0b-ae4c-41f89ff317c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:24:01.182586 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-bd09eeaa-cd2c-4e0b-ae4c-41f89ff317c6 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:24:01.183853 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-bd09eeaa-cd2c-4e0b-ae4c-41f89ff317c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:24:01.192694 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 732/1480] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:24:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:24:01.235727 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a3fc39-ed1e-4231-b3c3-b7e86893e256 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:24:01.251366 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a3fc39-ed1e-4231-b3c3-b7e86893e256 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:24:01.257493 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df76ffe3-a9cc-4c87-b786-613cfc6a60ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13530240e2d446b6bf26a431d001362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:24:01.258163 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df76ffe3-a9cc-4c87-b786-613cfc6a60ca service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:24:01.258445 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df76ffe3-a9cc-4c87-b786-613cfc6a60ca service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:24:01.258719 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df76ffe3-a9cc-4c87-b786-613cfc6a60ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:24:01.267096 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df76ffe3-a9cc-4c87-b786-613cfc6a60ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:24:01.268734 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df76ffe3-a9cc-4c87-b786-613cfc6a60ca service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:24:01.278541 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 749/1481] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:24:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:24:03.493116 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6c6a9-99bd-4bfc-b0c6-ebfd6fdf5f75 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:24:03.493683 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6c6a9-99bd-4bfc-b0c6-ebfd6fdf5f75 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:24:03.493792 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6c6a9-99bd-4bfc-b0c6-ebfd6fdf5f75 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:24:03.495911 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 733/1482] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:24:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:24:03.502167 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ff49a-3e33-4aa1-868c-ff2275337303 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:24:03.502582 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ff49a-3e33-4aa1-868c-ff2275337303 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:24:03.502737 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ff49a-3e33-4aa1-868c-ff2275337303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:24:03.528736 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-e60ff49a-3e33-4aa1-868c-ff2275337303 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:24:03.529964 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-e60ff49a-3e33-4aa1-868c-ff2275337303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:24:03.539918 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 750/1483] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:24:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:24:03.576992 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f6c6a9-99bd-4bfc-b0c6-ebfd6fdf5f75 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:24:03.589536 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f6c6a9-99bd-4bfc-b0c6-ebfd6fdf5f75 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:24:03.593843 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3252733-619e-4c78-a781-cfeef07bc3f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:24:03.594504 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3252733-619e-4c78-a781-cfeef07bc3f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:24:03.594776 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3252733-619e-4c78-a781-cfeef07bc3f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:24:03.595051 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3252733-619e-4c78-a781-cfeef07bc3f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:24:03.604820 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3252733-619e-4c78-a781-cfeef07bc3f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:24:03.606291 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3252733-619e-4c78-a781-cfeef07bc3f1 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:24:03.615931 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 734/1484] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:24:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 03:24:05.695556 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21ab32-0249-4b00-a5dd-d92f6352e597 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:24:05.696118 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21ab32-0249-4b00-a5dd-d92f6352e597 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:24:05.696118 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21ab32-0249-4b00-a5dd-d92f6352e597 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:24:05.698257 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 751/1485] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:24:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:24:05.706918 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc463f15-70e9-4b0f-bca2-ade891e24c95 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:24:05.707415 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc463f15-70e9-4b0f-bca2-ade891e24c95 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:24:05.707612 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc463f15-70e9-4b0f-bca2-ade891e24c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:24:05.726768 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-fc463f15-70e9-4b0f-bca2-ade891e24c95 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:24:05.727994 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-fc463f15-70e9-4b0f-bca2-ade891e24c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:24:05.736986 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 735/1486] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:24:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:24:05.775019 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee21ab32-0249-4b00-a5dd-d92f6352e597 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:24:05.793915 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee21ab32-0249-4b00-a5dd-d92f6352e597 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:24:05.798566 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e533b378-2464-49d5-8c2e-5e167365a2b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:24:05.799239 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e533b378-2464-49d5-8c2e-5e167365a2b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:24:05.799521 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e533b378-2464-49d5-8c2e-5e167365a2b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:24:05.799791 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e533b378-2464-49d5-8c2e-5e167365a2b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:24:05.810482 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e533b378-2464-49d5-8c2e-5e167365a2b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:24:05.811973 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e533b378-2464-49d5-8c2e-5e167365a2b4 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:24:05.821658 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 752/1487] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:24:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:24:07.937404 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0954814-4be4-4b68-953b-66df7f18626b None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:24:07.937966 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0954814-4be4-4b68-953b-66df7f18626b None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:24:07.937966 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0954814-4be4-4b68-953b-66df7f18626b None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:24:07.939311 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 736/1488] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:24:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:24:07.948406 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6512fbe2-61f6-4300-9a29-331459c57ad9 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:24:07.949172 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6512fbe2-61f6-4300-9a29-331459c57ad9 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:24:07.949353 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6512fbe2-61f6-4300-9a29-331459c57ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:24:07.971354 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-6512fbe2-61f6-4300-9a29-331459c57ad9 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:24:07.972494 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-6512fbe2-61f6-4300-9a29-331459c57ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:24:07.981531 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 753/1489] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:24:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:24:08.021954 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0954814-4be4-4b68-953b-66df7f18626b None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:24:08.041722 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0954814-4be4-4b68-953b-66df7f18626b None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:24:08.048739 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f82acd-0913-4fd9-953e-29bc368f447a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:24:08.049701 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f82acd-0913-4fd9-953e-29bc368f447a service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:24:08.050120 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f82acd-0913-4fd9-953e-29bc368f447a service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:24:08.050505 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f82acd-0913-4fd9-953e-29bc368f447a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:24:08.061711 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f82acd-0913-4fd9-953e-29bc368f447a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:24:08.063152 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f82acd-0913-4fd9-953e-29bc368f447a service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:24:08.072929 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 737/1490] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:24:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:24:10.283037 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4cfbbc-6c20-411c-8a9d-abeba92e2821 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:24:10.283750 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4cfbbc-6c20-411c-8a9d-abeba92e2821 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:24:10.283750 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4cfbbc-6c20-411c-8a9d-abeba92e2821 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:24:10.285037 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 754/1491] 10.222.0.60 () {54 vars in 926 bytes} [Sat Jul 2 03:24:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:24:10.295297 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944911d8-5ab7-4f91-8c10-ec6cb2013f64 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:24:10.295931 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944911d8-5ab7-4f91-8c10-ec6cb2013f64 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:24:10.296127 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944911d8-5ab7-4f91-8c10-ec6cb2013f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:24:10.316511 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-944911d8-5ab7-4f91-8c10-ec6cb2013f64 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:24:10.317869 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-944911d8-5ab7-4f91-8c10-ec6cb2013f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:24:10.326732 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 738/1492] 10.222.0.60 () {58 vars in 1023 bytes} [Sat Jul 2 03:24:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:24:10.371449 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4cfbbc-6c20-411c-8a9d-abeba92e2821 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:24:10.384181 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4cfbbc-6c20-411c-8a9d-abeba92e2821 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:24:10.388644 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a7c7be-449c-4827-898e-4f64fca9340d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:24:10.389314 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7c7be-449c-4827-898e-4f64fca9340d service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:24:10.389593 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7c7be-449c-4827-898e-4f64fca9340d service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:24:10.389868 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7c7be-449c-4827-898e-4f64fca9340d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:24:10.399727 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a7c7be-449c-4827-898e-4f64fca9340d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:24:10.401153 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a7c7be-449c-4827-898e-4f64fca9340d service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:24:10.411037 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 755/1493] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:24:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 03:24:20.311442 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=33 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:24:20.406447 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=33 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:25:43.436249 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf19b8-fa05-415b-9e9e-09a99e0b311a None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:25:43.437137 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf19b8-fa05-415b-9e9e-09a99e0b311a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:25:43.437319 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf19b8-fa05-415b-9e9e-09a99e0b311a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:25:43.458908 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-9fbf19b8-fa05-415b-9e9e-09a99e0b311a None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:25:43.460151 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9fbf19b8-fa05-415b-9e9e-09a99e0b311a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:25:43.469467 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 739/1494] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:25:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:25:43.477888 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d6fef-f6fe-4991-b8d4-711f12d39ec1 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:25:43.478373 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d6fef-f6fe-4991-b8d4-711f12d39ec1 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:25:43.478373 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d6fef-f6fe-4991-b8d4-711f12d39ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:25:43.499024 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-d93d6fef-f6fe-4991-b8d4-711f12d39ec1 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:25:43.500264 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-d93d6fef-f6fe-4991-b8d4-711f12d39ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:25:43.510224 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 756/1495] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:25:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:25:43.514920 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf19b8-fa05-415b-9e9e-09a99e0b311a None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:25:43.525436 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf19b8-fa05-415b-9e9e-09a99e0b311a None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:25:43.531738 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a0b25-2e45-4b07-930d-29ff767395ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:25:43.532427 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a0b25-2e45-4b07-930d-29ff767395ca admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:25:43.532700 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a0b25-2e45-4b07-930d-29ff767395ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:25:43.532968 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a0b25-2e45-4b07-930d-29ff767395ca admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:25:43.533690 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09a0b25-2e45-4b07-930d-29ff767395ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:25:43.533989 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09a0b25-2e45-4b07-930d-29ff767395ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:25:43.535041 dv-cinder-846842-9-smb devstack@keystone.service[80234]: WARNING py.warnings [None req-b09a0b25-2e45-4b07-930d-29ff767395ca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 03:25:43.535041 dv-cinder-846842-9-smb devstack@keystone.service[80234]: warnings.warn(msg) Jul 02 03:25:43.535041 dv-cinder-846842-9-smb devstack@keystone.service[80234]: Jul 02 03:25:43.535961 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09a0b25-2e45-4b07-930d-29ff767395ca admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:25:43.548701 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 740/1496] 10.222.0.60 () {58 vars in 1152 bytes} [Sat Jul 2 03:25:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:25:43.557276 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d6fef-f6fe-4991-b8d4-711f12d39ec1 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:25:43.567168 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d6fef-f6fe-4991-b8d4-711f12d39ec1 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:25:43.572888 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbd2f8b-2e2b-4d6f-8053-519778f6afdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:25:43.573537 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd2f8b-2e2b-4d6f-8053-519778f6afdd admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:25:43.573819 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd2f8b-2e2b-4d6f-8053-519778f6afdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:25:43.574166 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd2f8b-2e2b-4d6f-8053-519778f6afdd admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:25:43.574922 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbd2f8b-2e2b-4d6f-8053-519778f6afdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:25:43.576756 dv-cinder-846842-9-smb devstack@keystone.service[80233]: WARNING py.warnings [None req-2bbd2f8b-2e2b-4d6f-8053-519778f6afdd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 02 03:25:43.576756 dv-cinder-846842-9-smb devstack@keystone.service[80233]: warnings.warn(msg) Jul 02 03:25:43.576756 dv-cinder-846842-9-smb devstack@keystone.service[80233]: Jul 02 03:25:43.577951 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbd2f8b-2e2b-4d6f-8053-519778f6afdd admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:25:43.617884 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 757/1497] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:25:43 2022] POST /identity/v3/projects => generated 375 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:25:43.622068 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a0b25-2e45-4b07-930d-29ff767395ca admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:25:43.632260 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a0b25-2e45-4b07-930d-29ff767395ca admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:25:43.691344 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687d20d-a41e-47cd-b84f-22e6b3a9f588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:25:43.692012 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687d20d-a41e-47cd-b84f-22e6b3a9f588 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:25:43.692292 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687d20d-a41e-47cd-b84f-22e6b3a9f588 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:25:43.692572 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687d20d-a41e-47cd-b84f-22e6b3a9f588 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:25:43.693259 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9687d20d-a41e-47cd-b84f-22e6b3a9f588 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:25:43.694268 dv-cinder-846842-9-smb devstack@keystone.service[80234]: WARNING py.warnings [None req-9687d20d-a41e-47cd-b84f-22e6b3a9f588 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 02 03:25:43.694268 dv-cinder-846842-9-smb devstack@keystone.service[80234]: warnings.warn(msg) Jul 02 03:25:43.694268 dv-cinder-846842-9-smb devstack@keystone.service[80234]: Jul 02 03:25:43.695549 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9687d20d-a41e-47cd-b84f-22e6b3a9f588 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:25:43.716955 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 741/1498] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:25:43 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:25:43.721083 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbd2f8b-2e2b-4d6f-8053-519778f6afdd admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:25:43.731361 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbd2f8b-2e2b-4d6f-8053-519778f6afdd admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:25:43.736114 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831eca96-ddf3-4b0e-a9f0-21fa433588a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:25:43.736795 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831eca96-ddf3-4b0e-a9f0-21fa433588a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:25:43.737072 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831eca96-ddf3-4b0e-a9f0-21fa433588a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:25:43.737344 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831eca96-ddf3-4b0e-a9f0-21fa433588a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:25:43.738042 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831eca96-ddf3-4b0e-a9f0-21fa433588a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:25:43.739046 dv-cinder-846842-9-smb devstack@keystone.service[80233]: WARNING py.warnings [None req-831eca96-ddf3-4b0e-a9f0-21fa433588a4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 03:25:43.739046 dv-cinder-846842-9-smb devstack@keystone.service[80233]: warnings.warn(msg) Jul 02 03:25:43.739046 dv-cinder-846842-9-smb devstack@keystone.service[80233]: Jul 02 03:25:43.740003 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831eca96-ddf3-4b0e-a9f0-21fa433588a4 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:25:43.752834 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 758/1499] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:25:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:25:43.756764 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687d20d-a41e-47cd-b84f-22e6b3a9f588 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:25:43.767271 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687d20d-a41e-47cd-b84f-22e6b3a9f588 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:25:43.772973 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97659a18-a6e9-42d3-8de9-2c14ae41c5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:25:43.773711 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97659a18-a6e9-42d3-8de9-2c14ae41c5e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:25:43.773993 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97659a18-a6e9-42d3-8de9-2c14ae41c5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:25:43.774296 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97659a18-a6e9-42d3-8de9-2c14ae41c5e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:25:43.775027 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97659a18-a6e9-42d3-8de9-2c14ae41c5e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:25:43.776089 dv-cinder-846842-9-smb devstack@keystone.service[80234]: WARNING py.warnings [None req-97659a18-a6e9-42d3-8de9-2c14ae41c5e3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 03:25:43.776089 dv-cinder-846842-9-smb devstack@keystone.service[80234]: warnings.warn(msg) Jul 02 03:25:43.776089 dv-cinder-846842-9-smb devstack@keystone.service[80234]: Jul 02 03:25:43.776970 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97659a18-a6e9-42d3-8de9-2c14ae41c5e3 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:25:43.789766 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 742/1500] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:25:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:25:43.794316 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831eca96-ddf3-4b0e-a9f0-21fa433588a4 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:25:43.804935 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831eca96-ddf3-4b0e-a9f0-21fa433588a4 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:25:43.810882 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d29f3a-9d60-42f9-92c6-d868ca0b4a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:25:43.811786 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d29f3a-9d60-42f9-92c6-d868ca0b4a61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:25:43.812066 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d29f3a-9d60-42f9-92c6-d868ca0b4a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:25:43.812338 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d29f3a-9d60-42f9-92c6-d868ca0b4a61 admin admin] PATH_INFO: `/v3/projects/ce6b90808bb8470e811137ccdd682dfc/users/79bbae7eb31e4547a1b02b70fd0982dd/roles/c43aada0326446c4ade0ab1262918fa4` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:25:43.827909 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d29f3a-9d60-42f9-92c6-d868ca0b4a61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce6b90808bb8470e811137ccdd682dfc, user_id=79bbae7eb31e4547a1b02b70fd0982dd, role_id=c43aada0326446c4ade0ab1262918fa4)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:25:43.828942 dv-cinder-846842-9-smb devstack@keystone.service[80233]: WARNING py.warnings [None req-64d29f3a-9d60-42f9-92c6-d868ca0b4a61 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 02 03:25:43.828942 dv-cinder-846842-9-smb devstack@keystone.service[80233]: warnings.warn(msg) Jul 02 03:25:43.828942 dv-cinder-846842-9-smb devstack@keystone.service[80233]: Jul 02 03:25:43.830890 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d29f3a-9d60-42f9-92c6-d868ca0b4a61 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:25:43.846090 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 759/1501] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:25:43 2022] PUT /identity/v3/projects/ce6b90808bb8470e811137ccdd682dfc/users/79bbae7eb31e4547a1b02b70fd0982dd/roles/c43aada0326446c4ade0ab1262918fa4 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:25:43.858217 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb3b786-b150-483e-987c-e6a54005d32d None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:25:43.858508 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb3b786-b150-483e-987c-e6a54005d32d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:25:43.858786 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb3b786-b150-483e-987c-e6a54005d32d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:25:43.888100 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-2cb3b786-b150-483e-987c-e6a54005d32d None None] MFA Rules not processed for user `79bbae7eb31e4547a1b02b70fd0982dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:25:43.889334 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2cb3b786-b150-483e-987c-e6a54005d32d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:25:43.957896 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 743/1502] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:25:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 03:25:43.971609 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ead081-066e-409d-ac2f-61d45770d195 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:25:43.971895 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ead081-066e-409d-ac2f-61d45770d195 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:25:43.972183 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ead081-066e-409d-ac2f-61d45770d195 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:25:43.973561 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 760/1503] 10.222.0.60 () {54 vars in 963 bytes} [Sat Jul 2 03:25:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:25:43.978615 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f544475-c1d7-439c-9445-c86f73da38b0 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:25:43.978900 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f544475-c1d7-439c-9445-c86f73da38b0 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:25:43.979175 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f544475-c1d7-439c-9445-c86f73da38b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:25:43.997578 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-4f544475-c1d7-439c-9445-c86f73da38b0 None None] MFA Rules not processed for user `c7c2bef2013546cd882013cdcb4cd929`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:25:43.998769 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4f544475-c1d7-439c-9445-c86f73da38b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:25:44.048762 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:25:44.058186 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 744/1504] 10.222.0.60 () {58 vars in 1060 bytes} [Sat Jul 2 03:25:43 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:25:44.066202 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ead081-066e-409d-ac2f-61d45770d195 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:25:44.078049 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ead081-066e-409d-ac2f-61d45770d195 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:25:44.082061 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52974d22-832c-43dc-8a33-01bde3c352d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:25:44.082700 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52974d22-832c-43dc-8a33-01bde3c352d8 service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:25:44.082983 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52974d22-832c-43dc-8a33-01bde3c352d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:25:44.083302 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52974d22-832c-43dc-8a33-01bde3c352d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:25:44.091834 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52974d22-832c-43dc-8a33-01bde3c352d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:25:44.093250 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52974d22-832c-43dc-8a33-01bde3c352d8 service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:25:44.102363 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 761/1505] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:25:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:25:44.144410 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055be85-9c49-4a2a-a50a-6cde1e182d93 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:25:44.144698 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055be85-9c49-4a2a-a50a-6cde1e182d93 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:25:44.144971 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055be85-9c49-4a2a-a50a-6cde1e182d93 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:25:44.146254 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 745/1506] 10.222.0.60 () {52 vars in 829 bytes} [Sat Jul 2 03:25:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:25:44.149838 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52974d22-832c-43dc-8a33-01bde3c352d8 service cinder] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:25:44.214108 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52974d22-832c-43dc-8a33-01bde3c352d8 service cinder] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:25:44.220629 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ef01d-b32f-4184-a7ab-7ff1540435f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:25:44.221980 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ef01d-b32f-4184-a7ab-7ff1540435f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:25:44.222420 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ef01d-b32f-4184-a7ab-7ff1540435f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:25:44.222875 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ef01d-b32f-4184-a7ab-7ff1540435f8 admin admin] PATH_INFO: `/v3/users/79bbae7eb31e4547a1b02b70fd0982dd` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:25:44.224631 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84ef01d-b32f-4184-a7ab-7ff1540435f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79bbae7eb31e4547a1b02b70fd0982dd)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:25:44.226167 dv-cinder-846842-9-smb devstack@keystone.service[80233]: WARNING py.warnings [None req-d84ef01d-b32f-4184-a7ab-7ff1540435f8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 02 03:25:44.226167 dv-cinder-846842-9-smb devstack@keystone.service[80233]: warnings.warn(msg) Jul 02 03:25:44.226167 dv-cinder-846842-9-smb devstack@keystone.service[80233]: Jul 02 03:25:44.227384 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84ef01d-b32f-4184-a7ab-7ff1540435f8 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:25:44.302444 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d84ef01d-b32f-4184-a7ab-7ff1540435f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79bbae7eb31e4547a1b02b70fd0982dd'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:25:44.303019 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d84ef01d-b32f-4184-a7ab-7ff1540435f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79bbae7eb31e4547a1b02b70fd0982dd'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:25:44.315757 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d84ef01d-b32f-4184-a7ab-7ff1540435f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79bbae7eb31e4547a1b02b70fd0982dd'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:25:44.316601 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d84ef01d-b32f-4184-a7ab-7ff1540435f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79bbae7eb31e4547a1b02b70fd0982dd'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:25:44.335426 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d84ef01d-b32f-4184-a7ab-7ff1540435f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79bbae7eb31e4547a1b02b70fd0982dd'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:25:44.343950 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:25:44.355706 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 762/1507] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:25:44 2022] DELETE /identity/v3/users/79bbae7eb31e4547a1b02b70fd0982dd => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:25:44.360966 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d8405-39b2-44e6-a845-47e0015e9f7a None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:25:44.361321 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d8405-39b2-44e6-a845-47e0015e9f7a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:25:44.361665 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d8405-39b2-44e6-a845-47e0015e9f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:25:44.381829 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-2b5d8405-39b2-44e6-a845-47e0015e9f7a None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:25:44.383045 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2b5d8405-39b2-44e6-a845-47e0015e9f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:25:44.450119 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 746/1508] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:25:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:25:44.460562 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ef01d-b32f-4184-a7ab-7ff1540435f8 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:25:44.462260 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-d84ef01d-b32f-4184-a7ab-7ff1540435f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:25:44.521581 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ef01d-b32f-4184-a7ab-7ff1540435f8 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:25:44.525658 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcaf924-71d7-466e-960f-11306c86486a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:25:44.526298 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcaf924-71d7-466e-960f-11306c86486a service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:25:44.526597 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcaf924-71d7-466e-960f-11306c86486a service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:25:44.526886 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcaf924-71d7-466e-960f-11306c86486a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:25:44.536212 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcaf924-71d7-466e-960f-11306c86486a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:25:44.537666 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcaf924-71d7-466e-960f-11306c86486a service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:25:44.548976 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 763/1509] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:25:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:25:44.917788 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d8405-39b2-44e6-a845-47e0015e9f7a None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:25:44.919471 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2b5d8405-39b2-44e6-a845-47e0015e9f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:25:44.932155 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d8405-39b2-44e6-a845-47e0015e9f7a None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:25:44.937552 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972c53cf-6079-456f-95c1-a529a2f31dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:25:44.938408 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c53cf-6079-456f-95c1-a529a2f31dff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:25:44.938813 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c53cf-6079-456f-95c1-a529a2f31dff admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:25:44.938908 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c53cf-6079-456f-95c1-a529a2f31dff admin admin] PATH_INFO: `/v3/projects/ce6b90808bb8470e811137ccdd682dfc` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:25:44.940253 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972c53cf-6079-456f-95c1-a529a2f31dff admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce6b90808bb8470e811137ccdd682dfc)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:25:44.941353 dv-cinder-846842-9-smb devstack@keystone.service[80234]: WARNING py.warnings [None req-972c53cf-6079-456f-95c1-a529a2f31dff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 02 03:25:44.941353 dv-cinder-846842-9-smb devstack@keystone.service[80234]: warnings.warn(msg) Jul 02 03:25:44.941353 dv-cinder-846842-9-smb devstack@keystone.service[80234]: Jul 02 03:25:44.942553 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972c53cf-6079-456f-95c1-a529a2f31dff admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:25:45.005241 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-972c53cf-6079-456f-95c1-a529a2f31dff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce6b90808bb8470e811137ccdd682dfc', 'request_id': 'req-972c53cf-6079-456f-95c1-a529a2f31dff'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:25:45.011382 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-972c53cf-6079-456f-95c1-a529a2f31dff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce6b90808bb8470e811137ccdd682dfc', 'request_id': 'req-972c53cf-6079-456f-95c1-a529a2f31dff'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:25:45.021584 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-972c53cf-6079-456f-95c1-a529a2f31dff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce6b90808bb8470e811137ccdd682dfc', 'request_id': 'req-972c53cf-6079-456f-95c1-a529a2f31dff'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:25:45.040871 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-972c53cf-6079-456f-95c1-a529a2f31dff admin admin] The token cache is being invalidate because project ce6b90808bb8470e811137ccdd682dfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:25:45.041195 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-972c53cf-6079-456f-95c1-a529a2f31dff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:25:45.042230 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-972c53cf-6079-456f-95c1-a529a2f31dff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:25:45.043989 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 747/1510] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:25:44 2022] DELETE /identity/v3/projects/ce6b90808bb8470e811137ccdd682dfc => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:25:54.544717 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=29 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:25:55.037423 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:27:28.791476 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cde0d9-24f7-49a1-a48d-f3b1e27e0da3 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:27:28.792408 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cde0d9-24f7-49a1-a48d-f3b1e27e0da3 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:27:28.792408 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cde0d9-24f7-49a1-a48d-f3b1e27e0da3 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:27:28.794642 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 764/1511] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 2 03:27:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:27:28.802895 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b2ed0-37fc-47ab-b296-31f9cb6e1ea8 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:27:28.803390 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b2ed0-37fc-47ab-b296-31f9cb6e1ea8 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:27:28.803491 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b2ed0-37fc-47ab-b296-31f9cb6e1ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:27:28.828509 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-7f6b2ed0-37fc-47ab-b296-31f9cb6e1ea8 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:27:28.829728 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7f6b2ed0-37fc-47ab-b296-31f9cb6e1ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:27:28.889549 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 748/1512] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 2 03:27:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:27:29.045859 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cde0d9-24f7-49a1-a48d-f3b1e27e0da3 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:27:29.050361 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-58cde0d9-24f7-49a1-a48d-f3b1e27e0da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:27:29.130632 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cde0d9-24f7-49a1-a48d-f3b1e27e0da3 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:27:29.136804 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ed51f5-04fd-4c6a-96c5-d04f827fddcb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13530240e2d446b6bf26a431d001362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:27:29.137451 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed51f5-04fd-4c6a-96c5-d04f827fddcb service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:27:29.137735 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed51f5-04fd-4c6a-96c5-d04f827fddcb service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:27:29.138010 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed51f5-04fd-4c6a-96c5-d04f827fddcb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:27:29.146533 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ed51f5-04fd-4c6a-96c5-d04f827fddcb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:27:29.148318 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ed51f5-04fd-4c6a-96c5-d04f827fddcb service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:27:29.158678 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 765/1513] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:27:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:27:29.985631 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1976116-e9d8-44be-ae52-3752b454ad69 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:27:29.986238 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1976116-e9d8-44be-ae52-3752b454ad69 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:27:29.986238 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1976116-e9d8-44be-ae52-3752b454ad69 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:27:29.987601 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 749/1514] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 2 03:27:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:27:29.992701 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f20093c-6bab-4637-a52a-d0d5db1774d5 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:27:29.993142 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f20093c-6bab-4637-a52a-d0d5db1774d5 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:27:29.993249 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f20093c-6bab-4637-a52a-d0d5db1774d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:27:30.012805 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-3f20093c-6bab-4637-a52a-d0d5db1774d5 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:27:30.014019 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-3f20093c-6bab-4637-a52a-d0d5db1774d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:27:30.022850 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 766/1515] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 2 03:27:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:27:30.178496 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1976116-e9d8-44be-ae52-3752b454ad69 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:27:30.193958 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1976116-e9d8-44be-ae52-3752b454ad69 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:27:30.200509 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fcb06c-5086-4102-ac91-df971d59c829 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13530240e2d446b6bf26a431d001362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:27:30.201147 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fcb06c-5086-4102-ac91-df971d59c829 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:27:30.201427 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fcb06c-5086-4102-ac91-df971d59c829 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:27:30.201695 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fcb06c-5086-4102-ac91-df971d59c829 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:27:30.210546 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fcb06c-5086-4102-ac91-df971d59c829 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:27:30.212219 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fcb06c-5086-4102-ac91-df971d59c829 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:27:30.221901 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 750/1516] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:27:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:27:30.749080 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a79491-4b44-4521-b61e-cb21bbdb6d38 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:27:30.749346 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a79491-4b44-4521-b61e-cb21bbdb6d38 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:27:30.749636 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a79491-4b44-4521-b61e-cb21bbdb6d38 None None] PATH_INFO: `/v3` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:27:30.751024 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 767/1517] 10.222.0.64 () {54 vars in 925 bytes} [Sat Jul 2 03:27:30 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:27:30.758176 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660abd3-e696-4404-a297-e7e98d1ed630 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:27:30.758460 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660abd3-e696-4404-a297-e7e98d1ed630 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:27:30.758731 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660abd3-e696-4404-a297-e7e98d1ed630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:27:30.778549 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-c660abd3-e696-4404-a297-e7e98d1ed630 None None] MFA Rules not processed for user `9dafc9be75a64db095fe08b9cbb04cbd`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:27:30.779787 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c660abd3-e696-4404-a297-e7e98d1ed630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:27:30.845472 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 751/1518] 10.222.0.64 () {58 vars in 1015 bytes} [Sat Jul 2 03:27:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:27:39.720838 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09423782-5c4a-427c-b85c-25024cefa7d0 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:27:39.721704 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09423782-5c4a-427c-b85c-25024cefa7d0 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:27:39.721704 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09423782-5c4a-427c-b85c-25024cefa7d0 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:27:39.723963 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 768/1519] 10.222.0.60 () {54 vars in 960 bytes} [Sat Jul 2 03:27:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:27:39.729992 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c07174-a5c2-4750-a0b9-1cffa0e714d4 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:27:39.730738 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c07174-a5c2-4750-a0b9-1cffa0e714d4 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:27:39.730888 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c07174-a5c2-4750-a0b9-1cffa0e714d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:27:39.753365 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-d9c07174-a5c2-4750-a0b9-1cffa0e714d4 None None] MFA Rules not processed for user `9dafc9be75a64db095fe08b9cbb04cbd`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:27:39.754545 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d9c07174-a5c2-4750-a0b9-1cffa0e714d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:27:39.763682 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 752/1520] 10.222.0.60 () {58 vars in 1057 bytes} [Sat Jul 2 03:27:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:27:39.771147 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09423782-5c4a-427c-b85c-25024cefa7d0 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:27:39.787067 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09423782-5c4a-427c-b85c-25024cefa7d0 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:27:39.794216 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b46c7-e6dc-4f90-868f-807cf492400e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dafc9be75a64db095fe08b9cbb04cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:27:39.794849 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b46c7-e6dc-4f90-868f-807cf492400e service placement] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:27:39.795147 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b46c7-e6dc-4f90-868f-807cf492400e service placement] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:27:39.795448 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b46c7-e6dc-4f90-868f-807cf492400e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:27:39.807363 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41b46c7-e6dc-4f90-868f-807cf492400e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:27:39.808958 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41b46c7-e6dc-4f90-868f-807cf492400e service placement] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:27:39.818937 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 769/1521] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:27:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:27:41.470816 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213801f-c29d-46f5-8221-ed0cc18ac686 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:27:41.471771 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213801f-c29d-46f5-8221-ed0cc18ac686 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:27:41.471771 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213801f-c29d-46f5-8221-ed0cc18ac686 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:27:41.474112 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 753/1522] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 2 03:27:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:27:41.482302 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f959f3-7350-44bc-8442-31fc751e7609 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:27:41.482727 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f959f3-7350-44bc-8442-31fc751e7609 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:27:41.482872 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f959f3-7350-44bc-8442-31fc751e7609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:27:41.509654 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-08f959f3-7350-44bc-8442-31fc751e7609 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:27:41.510847 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-08f959f3-7350-44bc-8442-31fc751e7609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:27:41.520275 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 770/1523] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 2 03:27:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:27:41.679724 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3213801f-c29d-46f5-8221-ed0cc18ac686 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:27:41.701901 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3213801f-c29d-46f5-8221-ed0cc18ac686 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:27:41.708309 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785ea692-5b3d-4a12-bc9f-b4fb97e58b27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13530240e2d446b6bf26a431d001362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:27:41.708946 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ea692-5b3d-4a12-bc9f-b4fb97e58b27 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:27:41.709240 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ea692-5b3d-4a12-bc9f-b4fb97e58b27 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:27:41.709513 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ea692-5b3d-4a12-bc9f-b4fb97e58b27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:27:41.717975 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785ea692-5b3d-4a12-bc9f-b4fb97e58b27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:27:41.719603 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785ea692-5b3d-4a12-bc9f-b4fb97e58b27 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:27:41.729210 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 754/1524] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:27:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:27:42.559612 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c8558-cf11-40f9-bbfb-39c56da813f6 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:27:42.560204 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c8558-cf11-40f9-bbfb-39c56da813f6 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:27:42.560204 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c8558-cf11-40f9-bbfb-39c56da813f6 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:27:42.561557 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 771/1525] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 2 03:27:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:27:42.567327 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7bcd8-726c-4d3c-8480-def9eaa29739 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:27:42.567783 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7bcd8-726c-4d3c-8480-def9eaa29739 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:27:42.567897 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7bcd8-726c-4d3c-8480-def9eaa29739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:27:42.592833 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-4cd7bcd8-726c-4d3c-8480-def9eaa29739 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:27:42.594042 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4cd7bcd8-726c-4d3c-8480-def9eaa29739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:27:42.603454 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 755/1526] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 2 03:27:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:27:42.760676 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3c8558-cf11-40f9-bbfb-39c56da813f6 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:27:42.777854 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3c8558-cf11-40f9-bbfb-39c56da813f6 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:27:42.784903 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1efaab-497a-4942-b5fa-66b690fbd983 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13530240e2d446b6bf26a431d001362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:27:42.785558 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1efaab-497a-4942-b5fa-66b690fbd983 service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:27:42.785853 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1efaab-497a-4942-b5fa-66b690fbd983 service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:27:42.786119 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1efaab-497a-4942-b5fa-66b690fbd983 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:27:42.795746 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1efaab-497a-4942-b5fa-66b690fbd983 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:27:42.797361 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1efaab-497a-4942-b5fa-66b690fbd983 service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:27:42.807444 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 772/1527] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:27:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:27:46.735166 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f1981-ef86-4577-b340-08b2090ecd7c None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:27:46.735716 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f1981-ef86-4577-b340-08b2090ecd7c None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:27:46.735716 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f1981-ef86-4577-b340-08b2090ecd7c None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:27:46.737020 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 756/1528] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 2 03:27:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:27:46.743620 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd71520-f0a9-4ff8-af06-b93b558c902b None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:27:46.744065 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd71520-f0a9-4ff8-af06-b93b558c902b None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:27:46.744181 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd71520-f0a9-4ff8-af06-b93b558c902b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:27:46.767973 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-1fd71520-f0a9-4ff8-af06-b93b558c902b None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:27:46.769171 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-1fd71520-f0a9-4ff8-af06-b93b558c902b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:27:46.777988 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 773/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 2 03:27:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:27:46.815501 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0f1981-ef86-4577-b340-08b2090ecd7c None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:27:46.817657 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-bd0f1981-ef86-4577-b340-08b2090ecd7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:27:46.887166 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0f1981-ef86-4577-b340-08b2090ecd7c None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:27:46.891770 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd518c-5f87-46d5-82fb-ede9ef0d4806 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:27:46.892447 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd518c-5f87-46d5-82fb-ede9ef0d4806 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:27:46.892730 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd518c-5f87-46d5-82fb-ede9ef0d4806 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:27:46.893012 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd518c-5f87-46d5-82fb-ede9ef0d4806 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:27:46.902887 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccd518c-5f87-46d5-82fb-ede9ef0d4806 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:27:46.904358 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccd518c-5f87-46d5-82fb-ede9ef0d4806 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:27:46.909504 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:27:46.914767 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 757/1530] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:27:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:27:48.941170 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fbf182-813c-4aa7-b1f6-30c8ba24e17d None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:27:48.941785 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fbf182-813c-4aa7-b1f6-30c8ba24e17d None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:27:48.941785 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fbf182-813c-4aa7-b1f6-30c8ba24e17d None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:27:48.943114 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 774/1531] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 2 03:27:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:27:48.951693 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9791ab2-a6a7-4cc7-8e3b-be4b9e03a103 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:27:48.952436 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9791ab2-a6a7-4cc7-8e3b-be4b9e03a103 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:27:48.952630 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9791ab2-a6a7-4cc7-8e3b-be4b9e03a103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:27:48.979004 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-a9791ab2-a6a7-4cc7-8e3b-be4b9e03a103 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:27:48.980198 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a9791ab2-a6a7-4cc7-8e3b-be4b9e03a103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:27:48.989234 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 758/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 2 03:27:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:27:49.026945 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fbf182-813c-4aa7-b1f6-30c8ba24e17d None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:27:49.029967 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-e4fbf182-813c-4aa7-b1f6-30c8ba24e17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:27:49.045982 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fbf182-813c-4aa7-b1f6-30c8ba24e17d None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:27:49.050154 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e89fa7-3b78-402a-8601-9a6607a805e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:27:49.050818 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e89fa7-3b78-402a-8601-9a6607a805e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:27:49.051101 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e89fa7-3b78-402a-8601-9a6607a805e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:27:49.051408 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e89fa7-3b78-402a-8601-9a6607a805e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:27:49.060977 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e89fa7-3b78-402a-8601-9a6607a805e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:27:49.062396 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e89fa7-3b78-402a-8601-9a6607a805e8 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:27:49.071998 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 775/1533] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:27:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:27:52.482621 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de98e6-2e85-450e-b22f-4c886f9251c6 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:27:52.483598 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de98e6-2e85-450e-b22f-4c886f9251c6 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:27:52.483598 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de98e6-2e85-450e-b22f-4c886f9251c6 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:27:52.485967 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 759/1534] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 2 03:27:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:27:52.491517 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d8e12-29b3-4b67-a892-9e389ced6822 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:27:52.491967 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d8e12-29b3-4b67-a892-9e389ced6822 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:27:52.492098 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d8e12-29b3-4b67-a892-9e389ced6822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:27:52.512470 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-442d8e12-29b3-4b67-a892-9e389ced6822 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:27:52.513689 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-442d8e12-29b3-4b67-a892-9e389ced6822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:27:52.522554 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 776/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 2 03:27:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:27:52.831570 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de98e6-2e85-450e-b22f-4c886f9251c6 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:27:52.834550 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-34de98e6-2e85-450e-b22f-4c886f9251c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:27:52.898405 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de98e6-2e85-450e-b22f-4c886f9251c6 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:27:52.902395 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7588e14-6c73-4527-9ca2-267f21301a7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:27:52.903028 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7588e14-6c73-4527-9ca2-267f21301a7a service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:27:52.903333 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7588e14-6c73-4527-9ca2-267f21301a7a service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:27:52.903605 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7588e14-6c73-4527-9ca2-267f21301a7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:27:52.913630 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7588e14-6c73-4527-9ca2-267f21301a7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:27:52.915067 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7588e14-6c73-4527-9ca2-267f21301a7a service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:27:52.924937 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 760/1536] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:27:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:27:54.939700 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882411f-4030-4b7b-a844-f6710dd93b7d None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:27:54.940400 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882411f-4030-4b7b-a844-f6710dd93b7d None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:27:54.940400 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882411f-4030-4b7b-a844-f6710dd93b7d None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:27:54.941702 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 777/1537] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 2 03:27:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:27:54.947167 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e37eb3-5856-4c77-8339-b524133eee13 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:27:54.947615 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e37eb3-5856-4c77-8339-b524133eee13 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:27:54.947727 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e37eb3-5856-4c77-8339-b524133eee13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:27:54.968106 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-52e37eb3-5856-4c77-8339-b524133eee13 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:27:54.969287 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-52e37eb3-5856-4c77-8339-b524133eee13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:27:54.978092 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 761/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 2 03:27:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:27:55.282105 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b882411f-4030-4b7b-a844-f6710dd93b7d None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:27:55.285919 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-b882411f-4030-4b7b-a844-f6710dd93b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:27:55.296128 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=65 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:27:55.303538 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b882411f-4030-4b7b-a844-f6710dd93b7d None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:27:55.307623 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30696073-0209-4658-ac7e-12cf10f597b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:27:55.308271 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30696073-0209-4658-ac7e-12cf10f597b5 service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:27:55.308553 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30696073-0209-4658-ac7e-12cf10f597b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:27:55.308827 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30696073-0209-4658-ac7e-12cf10f597b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:27:55.318928 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30696073-0209-4658-ac7e-12cf10f597b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:27:55.320280 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30696073-0209-4658-ac7e-12cf10f597b5 service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:27:55.330350 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 778/1539] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:27:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:28:04.961340 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=32 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:28:05.326147 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=5 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:29:34.289376 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c3055-ed62-4f31-8bc4-9f52004c25c9 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:34.292137 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c3055-ed62-4f31-8bc4-9f52004c25c9 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:34.292137 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c3055-ed62-4f31-8bc4-9f52004c25c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:34.312371 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-216c3055-ed62-4f31-8bc4-9f52004c25c9 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:29:34.314021 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-216c3055-ed62-4f31-8bc4-9f52004c25c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:34.327040 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 762/1540] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:29:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:29:34.336264 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787b298-1eb9-4e22-ac78-06a2e12a5e97 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:34.336870 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787b298-1eb9-4e22-ac78-06a2e12a5e97 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:34.336870 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787b298-1eb9-4e22-ac78-06a2e12a5e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:34.363495 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-0787b298-1eb9-4e22-ac78-06a2e12a5e97 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:29:34.364735 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-0787b298-1eb9-4e22-ac78-06a2e12a5e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:34.376600 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 779/1541] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:29:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 03:29:34.381259 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c3055-ed62-4f31-8bc4-9f52004c25c9 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:34.394601 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c3055-ed62-4f31-8bc4-9f52004c25c9 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:34.402503 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754877e6-fba4-432c-ace3-3858e9861a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:34.403231 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754877e6-fba4-432c-ace3-3858e9861a5a admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:34.403911 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754877e6-fba4-432c-ace3-3858e9861a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:34.404274 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754877e6-fba4-432c-ace3-3858e9861a5a admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:34.405222 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754877e6-fba4-432c-ace3-3858e9861a5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:29:34.405343 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754877e6-fba4-432c-ace3-3858e9861a5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:34.406842 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d056d-b88a-46c3-8047-a5d6a56d9222 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:34.407154 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d056d-b88a-46c3-8047-a5d6a56d9222 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:34.407531 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754877e6-fba4-432c-ace3-3858e9861a5a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:34.407656 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d056d-b88a-46c3-8047-a5d6a56d9222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:34.421104 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 763/1542] 10.222.0.60 () {58 vars in 1152 bytes} [Sat Jul 2 03:29:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:29:34.443619 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-542d056d-b88a-46c3-8047-a5d6a56d9222 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:29:34.444888 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-542d056d-b88a-46c3-8047-a5d6a56d9222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:34.447289 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754877e6-fba4-432c-ace3-3858e9861a5a admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:34.461923 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 780/1543] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:29:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 03:29:34.465154 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754877e6-fba4-432c-ace3-3858e9861a5a admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:34.470848 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735188c-1987-4df5-9fdf-a0b6bf2b47d6 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:34.471147 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735188c-1987-4df5-9fdf-a0b6bf2b47d6 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:34.471443 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735188c-1987-4df5-9fdf-a0b6bf2b47d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:34.472915 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9fbce5-e6f9-48f0-9e32-a3be4c50ff8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:34.473586 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9fbce5-e6f9-48f0-9e32-a3be4c50ff8d admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:34.473867 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9fbce5-e6f9-48f0-9e32-a3be4c50ff8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:34.474141 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9fbce5-e6f9-48f0-9e32-a3be4c50ff8d admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:34.475164 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9fbce5-e6f9-48f0-9e32-a3be4c50ff8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:34.476204 dv-cinder-846842-9-smb devstack@keystone.service[80234]: WARNING py.warnings [None req-ca9fbce5-e6f9-48f0-9e32-a3be4c50ff8d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 02 03:29:34.476204 dv-cinder-846842-9-smb devstack@keystone.service[80234]: warnings.warn(msg) Jul 02 03:29:34.476204 dv-cinder-846842-9-smb devstack@keystone.service[80234]: Jul 02 03:29:34.477399 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9fbce5-e6f9-48f0-9e32-a3be4c50ff8d admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:34.507397 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-9735188c-1987-4df5-9fdf-a0b6bf2b47d6 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:29:34.508657 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-9735188c-1987-4df5-9fdf-a0b6bf2b47d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:34.519892 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 764/1544] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:29:34 2022] POST /identity/v3/projects => generated 377 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 03:29:34.536593 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9fbce5-e6f9-48f0-9e32-a3be4c50ff8d admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:34.611385 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 781/1545] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:29:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 03:29:34.612563 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014732a1-f907-44f0-ae6d-edb3aebf7034 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:34.612853 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014732a1-f907-44f0-ae6d-edb3aebf7034 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:34.613129 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014732a1-f907-44f0-ae6d-edb3aebf7034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:34.624298 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9fbce5-e6f9-48f0-9e32-a3be4c50ff8d admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:34.638302 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095fcb11-eb4e-4c92-9d80-b273ebf86759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:34.638991 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095fcb11-eb4e-4c92-9d80-b273ebf86759 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:34.639305 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095fcb11-eb4e-4c92-9d80-b273ebf86759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:34.639582 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095fcb11-eb4e-4c92-9d80-b273ebf86759 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:34.645518 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095fcb11-eb4e-4c92-9d80-b273ebf86759 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:34.655007 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095fcb11-eb4e-4c92-9d80-b273ebf86759 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:34.661649 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-014732a1-f907-44f0-ae6d-edb3aebf7034 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:29:34.661649 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-014732a1-f907-44f0-ae6d-edb3aebf7034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:34.676019 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 782/1546] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:29:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:29:34.677806 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd41943-96a6-473d-adfd-d455f05bcd23 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:34.678093 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd41943-96a6-473d-adfd-d455f05bcd23 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:34.678415 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd41943-96a6-473d-adfd-d455f05bcd23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:34.699375 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-ecd41943-96a6-473d-adfd-d455f05bcd23 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:29:34.700717 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-ecd41943-96a6-473d-adfd-d455f05bcd23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:34.701160 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 765/1547] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:29:34 2022] POST /identity/v3/users => generated 289 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 03:29:34.702265 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095fcb11-eb4e-4c92-9d80-b273ebf86759 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:34.716346 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 783/1548] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:29:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:29:34.718372 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a9106c-9df6-44d5-b0f6-740b2809e78e None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:34.720811 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095fcb11-eb4e-4c92-9d80-b273ebf86759 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:34.721337 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a9106c-9df6-44d5-b0f6-740b2809e78e None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:34.721824 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a9106c-9df6-44d5-b0f6-740b2809e78e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:34.734179 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b998f536-7ddf-4955-90da-f15a51078a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:34.735254 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998f536-7ddf-4955-90da-f15a51078a59 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:34.735763 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998f536-7ddf-4955-90da-f15a51078a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:34.736301 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998f536-7ddf-4955-90da-f15a51078a59 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:34.737252 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b998f536-7ddf-4955-90da-f15a51078a59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:29:34.737556 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b998f536-7ddf-4955-90da-f15a51078a59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:34.739219 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b998f536-7ddf-4955-90da-f15a51078a59 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:34.746109 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-e0a9106c-9df6-44d5-b0f6-740b2809e78e None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:29:34.747844 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-e0a9106c-9df6-44d5-b0f6-740b2809e78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:34.752086 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 766/1549] 10.222.0.60 () {58 vars in 1152 bytes} [Sat Jul 2 03:29:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:29:34.753182 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc559dd6-441e-4003-9295-85be4e041cd9 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:34.753466 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc559dd6-441e-4003-9295-85be4e041cd9 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:34.753737 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc559dd6-441e-4003-9295-85be4e041cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:34.761992 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 784/1550] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:29:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:29:34.763175 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a9106c-9df6-44d5-b0f6-740b2809e78e None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:34.774614 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a9106c-9df6-44d5-b0f6-740b2809e78e None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:34.775676 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-dc559dd6-441e-4003-9295-85be4e041cd9 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:29:34.777169 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-dc559dd6-441e-4003-9295-85be4e041cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:34.780541 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7089b2-04be-4b61-a232-0ab14ae01f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:34.781451 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7089b2-04be-4b61-a232-0ab14ae01f60 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:34.782001 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7089b2-04be-4b61-a232-0ab14ae01f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:34.782519 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7089b2-04be-4b61-a232-0ab14ae01f60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:34.784340 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7089b2-04be-4b61-a232-0ab14ae01f60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:34.786215 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7089b2-04be-4b61-a232-0ab14ae01f60 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:34.786680 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 767/1551] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:29:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:29:34.788162 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256a584-9433-4609-a0b7-ee0d8f8c79c7 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:34.788448 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256a584-9433-4609-a0b7-ee0d8f8c79c7 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:34.788723 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256a584-9433-4609-a0b7-ee0d8f8c79c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:34.797380 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 785/1552] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:29:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:29:34.798705 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c382a1c7-b09f-49af-9118-7b07fb8b88eb None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:34.798988 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c382a1c7-b09f-49af-9118-7b07fb8b88eb None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:34.799297 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c382a1c7-b09f-49af-9118-7b07fb8b88eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:34.807308 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-3256a584-9433-4609-a0b7-ee0d8f8c79c7 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:29:34.808499 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3256a584-9433-4609-a0b7-ee0d8f8c79c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:34.816229 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 768/1553] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:29:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:29:34.817355 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-c382a1c7-b09f-49af-9118-7b07fb8b88eb None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:29:34.817481 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad821587-18fa-4046-92f3-cc08565988b3 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:34.817768 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad821587-18fa-4046-92f3-cc08565988b3 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:34.818043 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad821587-18fa-4046-92f3-cc08565988b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:34.818516 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-c382a1c7-b09f-49af-9118-7b07fb8b88eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:34.826250 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 786/1554] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:29:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:29:34.827002 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c382a1c7-b09f-49af-9118-7b07fb8b88eb None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:34.836418 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c382a1c7-b09f-49af-9118-7b07fb8b88eb None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:34.841276 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-ad821587-18fa-4046-92f3-cc08565988b3 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:29:34.841615 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d7d48-d8a1-414a-84af-bfd9f241aecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:34.842370 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d7d48-d8a1-414a-84af-bfd9f241aecd admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:34.842491 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ad821587-18fa-4046-92f3-cc08565988b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:34.842649 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d7d48-d8a1-414a-84af-bfd9f241aecd admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:34.842920 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d7d48-d8a1-414a-84af-bfd9f241aecd admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:34.843638 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d7d48-d8a1-414a-84af-bfd9f241aecd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:34.845527 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d7d48-d8a1-414a-84af-bfd9f241aecd admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:34.850486 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 769/1555] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:29:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:29:34.851845 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc867e0-04c9-4430-b754-770390234423 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:34.852130 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc867e0-04c9-4430-b754-770390234423 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:34.852403 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc867e0-04c9-4430-b754-770390234423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:34.870289 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-1dc867e0-04c9-4430-b754-770390234423 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:29:34.871440 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1dc867e0-04c9-4430-b754-770390234423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:34.875087 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 787/1556] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:29:34 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:29:34.876477 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea43b7d6-6155-48a1-9934-953e213207ef None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:34.876767 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea43b7d6-6155-48a1-9934-953e213207ef None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:34.877048 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea43b7d6-6155-48a1-9934-953e213207ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:34.882517 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 770/1557] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:29:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:29:34.883480 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc867e0-04c9-4430-b754-770390234423 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:34.892814 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc867e0-04c9-4430-b754-770390234423 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:34.898182 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-ea43b7d6-6155-48a1-9934-953e213207ef None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:29:34.899428 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-ea43b7d6-6155-48a1-9934-953e213207ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:34.949083 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc36a52-d33e-48ce-b989-c33269f38f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:34.949748 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc36a52-d33e-48ce-b989-c33269f38f82 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:34.950029 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc36a52-d33e-48ce-b989-c33269f38f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:34.950300 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc36a52-d33e-48ce-b989-c33269f38f82 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:34.951041 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc36a52-d33e-48ce-b989-c33269f38f82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:29:34.951367 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc36a52-d33e-48ce-b989-c33269f38f82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:34.953023 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc36a52-d33e-48ce-b989-c33269f38f82 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:34.958980 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 788/1558] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:29:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:29:34.960053 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea43b7d6-6155-48a1-9934-953e213207ef None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:34.969324 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea43b7d6-6155-48a1-9934-953e213207ef None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:34.972228 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 771/1559] 10.222.0.60 () {58 vars in 1152 bytes} [Sat Jul 2 03:29:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:29:34.973018 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc36a52-d33e-48ce-b989-c33269f38f82 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:34.977234 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1dca20-8f68-4e08-96ba-095c7bd66e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:34.978003 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1dca20-8f68-4e08-96ba-095c7bd66e96 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:34.978388 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1dca20-8f68-4e08-96ba-095c7bd66e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:34.978666 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:29:34.978824 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1dca20-8f68-4e08-96ba-095c7bd66e96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:34.979686 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1dca20-8f68-4e08-96ba-095c7bd66e96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:34.981279 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1dca20-8f68-4e08-96ba-095c7bd66e96 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:34.984286 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc36a52-d33e-48ce-b989-c33269f38f82 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:34.990345 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a8215b-dc9c-424c-9346-7efd6aefca19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:34.991050 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a8215b-dc9c-424c-9346-7efd6aefca19 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:34.991377 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a8215b-dc9c-424c-9346-7efd6aefca19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:34.991653 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a8215b-dc9c-424c-9346-7efd6aefca19 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:34.991905 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 789/1560] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:29:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:29:34.992381 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a8215b-dc9c-424c-9346-7efd6aefca19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:29:34.992683 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a8215b-dc9c-424c-9346-7efd6aefca19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:34.994327 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a8215b-dc9c-424c-9346-7efd6aefca19 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:34.996305 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b9040-bd2a-4b40-839b-d11ee1461584 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:34.996641 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b9040-bd2a-4b40-839b-d11ee1461584 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:34.996915 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b9040-bd2a-4b40-839b-d11ee1461584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:35.006561 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 772/1561] 10.222.0.60 () {58 vars in 1152 bytes} [Sat Jul 2 03:29:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:29:35.007887 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e4d3e-919d-49bd-a512-0cce70755b01 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:35.008233 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e4d3e-919d-49bd-a512-0cce70755b01 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:35.008572 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e4d3e-919d-49bd-a512-0cce70755b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:35.014929 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-b39b9040-bd2a-4b40-839b-d11ee1461584 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:29:35.016184 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-b39b9040-bd2a-4b40-839b-d11ee1461584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:35.025168 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 790/1562] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:29:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:29:35.025764 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b9040-bd2a-4b40-839b-d11ee1461584 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:35.026285 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-2d5e4d3e-919d-49bd-a512-0cce70755b01 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:29:35.027558 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2d5e4d3e-919d-49bd-a512-0cce70755b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:35.035590 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 773/1563] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:29:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:29:35.035745 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b9040-bd2a-4b40-839b-d11ee1461584 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:35.036346 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5e4d3e-919d-49bd-a512-0cce70755b01 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:35.040532 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3655379-d107-42da-8737-704f14c49315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:35.041182 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3655379-d107-42da-8737-704f14c49315 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:35.042160 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3655379-d107-42da-8737-704f14c49315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:35.042446 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3655379-d107-42da-8737-704f14c49315 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:35.043162 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3655379-d107-42da-8737-704f14c49315 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:35.044181 dv-cinder-846842-9-smb devstack@keystone.service[80233]: WARNING py.warnings [None req-c3655379-d107-42da-8737-704f14c49315 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 02 03:29:35.044181 dv-cinder-846842-9-smb devstack@keystone.service[80233]: warnings.warn(msg) Jul 02 03:29:35.044181 dv-cinder-846842-9-smb devstack@keystone.service[80233]: Jul 02 03:29:35.045540 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3655379-d107-42da-8737-704f14c49315 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:35.051781 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5e4d3e-919d-49bd-a512-0cce70755b01 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:35.057025 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:29:35.060216 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19831051-4b50-40b5-886a-9e0575d95320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:35.061039 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19831051-4b50-40b5-886a-9e0575d95320 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:35.061350 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19831051-4b50-40b5-886a-9e0575d95320 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:35.061640 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19831051-4b50-40b5-886a-9e0575d95320 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:35.062650 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19831051-4b50-40b5-886a-9e0575d95320 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:29:35.062983 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19831051-4b50-40b5-886a-9e0575d95320 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:35.065175 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19831051-4b50-40b5-886a-9e0575d95320 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:35.073954 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 791/1564] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:29:35 2022] POST /identity/v3/users => generated 290 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:29:35.075355 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1481677-7de8-44cc-ba26-4cadd7812110 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:35.075730 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1481677-7de8-44cc-ba26-4cadd7812110 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:35.076074 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1481677-7de8-44cc-ba26-4cadd7812110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:35.088518 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 774/1565] 10.222.0.60 () {58 vars in 1152 bytes} [Sat Jul 2 03:29:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:29:35.088518 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19831051-4b50-40b5-886a-9e0575d95320 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:35.094069 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19831051-4b50-40b5-886a-9e0575d95320 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:35.094929 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-e1481677-7de8-44cc-ba26-4cadd7812110 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:29:35.096175 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-e1481677-7de8-44cc-ba26-4cadd7812110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:35.098880 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15584f0-65a5-4ee1-8a12-2e484229a1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:35.099662 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15584f0-65a5-4ee1-8a12-2e484229a1dd admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:35.099940 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15584f0-65a5-4ee1-8a12-2e484229a1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:35.100214 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15584f0-65a5-4ee1-8a12-2e484229a1dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:35.100908 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15584f0-65a5-4ee1-8a12-2e484229a1dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:35.102824 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15584f0-65a5-4ee1-8a12-2e484229a1dd admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:35.104058 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 792/1566] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:29:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:29:35.104810 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1481677-7de8-44cc-ba26-4cadd7812110 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:35.114090 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1481677-7de8-44cc-ba26-4cadd7812110 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:35.118708 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e4e859-50ec-4c01-a2bb-17e83d0fcfe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:35.119682 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e4e859-50ec-4c01-a2bb-17e83d0fcfe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:35.119915 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e4e859-50ec-4c01-a2bb-17e83d0fcfe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:35.120187 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e4e859-50ec-4c01-a2bb-17e83d0fcfe4 admin admin] PATH_INFO: `/v3/projects/21d62ee1bec34176af71d872c20e5b8a/users/5caffa5bd8804abd96e411fb45383c5b/roles/c43aada0326446c4ade0ab1262918fa4` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:35.132305 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 775/1567] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:29:35 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:29:35.133153 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15584f0-65a5-4ee1-8a12-2e484229a1dd admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:35.138540 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e4e859-50ec-4c01-a2bb-17e83d0fcfe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21d62ee1bec34176af71d872c20e5b8a, user_id=5caffa5bd8804abd96e411fb45383c5b, role_id=c43aada0326446c4ade0ab1262918fa4)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:35.141212 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e4e859-50ec-4c01-a2bb-17e83d0fcfe4 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:35.156247 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 793/1568] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:29:35 2022] PUT /identity/v3/projects/21d62ee1bec34176af71d872c20e5b8a/users/5caffa5bd8804abd96e411fb45383c5b/roles/c43aada0326446c4ade0ab1262918fa4 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:29:35.157141 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e4e859-50ec-4c01-a2bb-17e83d0fcfe4 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:35.195053 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15584f0-65a5-4ee1-8a12-2e484229a1dd admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:35.224393 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e4e859-50ec-4c01-a2bb-17e83d0fcfe4 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:35.229266 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a71d6-8dd7-47bc-b360-253d4bc69040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:35.229931 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a71d6-8dd7-47bc-b360-253d4bc69040 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:35.230215 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a71d6-8dd7-47bc-b360-253d4bc69040 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:35.230490 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a71d6-8dd7-47bc-b360-253d4bc69040 admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:35.231251 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513a71d6-8dd7-47bc-b360-253d4bc69040 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:29:35.231563 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513a71d6-8dd7-47bc-b360-253d4bc69040 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:35.232582 dv-cinder-846842-9-smb devstack@keystone.service[80233]: WARNING py.warnings [None req-513a71d6-8dd7-47bc-b360-253d4bc69040 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 03:29:35.232582 dv-cinder-846842-9-smb devstack@keystone.service[80233]: warnings.warn(msg) Jul 02 03:29:35.232582 dv-cinder-846842-9-smb devstack@keystone.service[80233]: Jul 02 03:29:35.233469 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513a71d6-8dd7-47bc-b360-253d4bc69040 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:35.245218 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 794/1569] 10.222.0.60 () {58 vars in 1152 bytes} [Sat Jul 2 03:29:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:29:35.247271 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a71d6-8dd7-47bc-b360-253d4bc69040 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:35.255455 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40115151-5768-460b-97c7-c8793ba5051a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:35.255687 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a71d6-8dd7-47bc-b360-253d4bc69040 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:35.256347 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40115151-5768-460b-97c7-c8793ba5051a admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:35.256757 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40115151-5768-460b-97c7-c8793ba5051a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:35.256903 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40115151-5768-460b-97c7-c8793ba5051a admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:35.257652 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40115151-5768-460b-97c7-c8793ba5051a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:35.259596 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40115151-5768-460b-97c7-c8793ba5051a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:35.261029 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a7197d-317b-4a3f-bd9f-d994de16db16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:35.261661 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a7197d-317b-4a3f-bd9f-d994de16db16 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:35.261941 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a7197d-317b-4a3f-bd9f-d994de16db16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:35.262213 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a7197d-317b-4a3f-bd9f-d994de16db16 admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:35.262927 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a7197d-317b-4a3f-bd9f-d994de16db16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:29:35.263263 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a7197d-317b-4a3f-bd9f-d994de16db16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:35.264880 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a7197d-317b-4a3f-bd9f-d994de16db16 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:35.285166 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 795/1570] 10.222.0.60 () {58 vars in 1152 bytes} [Sat Jul 2 03:29:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:29:35.285166 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a7197d-317b-4a3f-bd9f-d994de16db16 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:35.289902 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 776/1571] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:29:35 2022] POST /identity/v3/projects => generated 385 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:29:35.289902 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40115151-5768-460b-97c7-c8793ba5051a admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:35.290521 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a7197d-317b-4a3f-bd9f-d994de16db16 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:35.329736 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:29:35.346080 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a13eddb-297c-4d2c-86b7-e43374c6e2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:35.346746 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13eddb-297c-4d2c-86b7-e43374c6e2f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:35.347030 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13eddb-297c-4d2c-86b7-e43374c6e2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:35.347330 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13eddb-297c-4d2c-86b7-e43374c6e2f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:35.348051 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a13eddb-297c-4d2c-86b7-e43374c6e2f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:35.349640 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a13eddb-297c-4d2c-86b7-e43374c6e2f6 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:35.350383 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40115151-5768-460b-97c7-c8793ba5051a admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:35.355675 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ea98c-0b4a-4ad8-a653-c99bba6c692f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:35.356450 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ea98c-0b4a-4ad8-a653-c99bba6c692f admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:35.356826 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ea98c-0b4a-4ad8-a653-c99bba6c692f admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:35.357207 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ea98c-0b4a-4ad8-a653-c99bba6c692f admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:35.358020 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336ea98c-0b4a-4ad8-a653-c99bba6c692f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:35.359416 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 796/1572] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:29:35 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:29:35.360169 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336ea98c-0b4a-4ad8-a653-c99bba6c692f admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:35.363437 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a13eddb-297c-4d2c-86b7-e43374c6e2f6 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:35.376533 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a13eddb-297c-4d2c-86b7-e43374c6e2f6 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:35.382414 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b61daf9-d154-4a82-afe1-1603d2cceef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:35.383015 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b61daf9-d154-4a82-afe1-1603d2cceef1 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:35.383332 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b61daf9-d154-4a82-afe1-1603d2cceef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:35.383611 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b61daf9-d154-4a82-afe1-1603d2cceef1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:35.384334 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b61daf9-d154-4a82-afe1-1603d2cceef1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:29:35.384639 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b61daf9-d154-4a82-afe1-1603d2cceef1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:35.386235 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b61daf9-d154-4a82-afe1-1603d2cceef1 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:35.391316 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 777/1573] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:29:35 2022] POST /identity/v3/projects => generated 393 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:29:35.392228 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ea98c-0b4a-4ad8-a653-c99bba6c692f admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:35.398345 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 797/1574] 10.222.0.60 () {58 vars in 1152 bytes} [Sat Jul 2 03:29:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:29:35.399701 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88bebba-2c86-497b-957e-7c7f39f41121 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:35.399987 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88bebba-2c86-497b-957e-7c7f39f41121 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:35.400259 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88bebba-2c86-497b-957e-7c7f39f41121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:35.422476 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-d88bebba-2c86-497b-957e-7c7f39f41121 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:29:35.423718 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-d88bebba-2c86-497b-957e-7c7f39f41121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:35.443915 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:29:35.459251 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ea98c-0b4a-4ad8-a653-c99bba6c692f admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:35.464084 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c532d33-2993-4528-9d00-01d1441edef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:35.464921 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c532d33-2993-4528-9d00-01d1441edef5 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:35.465300 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c532d33-2993-4528-9d00-01d1441edef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:35.465673 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c532d33-2993-4528-9d00-01d1441edef5 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:35.466468 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c532d33-2993-4528-9d00-01d1441edef5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:35.468526 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c532d33-2993-4528-9d00-01d1441edef5 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:35.485061 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 798/1575] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:29:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:29:35.485867 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88bebba-2c86-497b-957e-7c7f39f41121 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:35.492914 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 778/1576] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:29:35 2022] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:29:35.492914 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c532d33-2993-4528-9d00-01d1441edef5 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:35.495112 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88bebba-2c86-497b-957e-7c7f39f41121 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:35.499952 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75995f33-0322-42ff-8172-87b46d8fd1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:35.500606 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75995f33-0322-42ff-8172-87b46d8fd1bc admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:35.500887 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75995f33-0322-42ff-8172-87b46d8fd1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:35.501160 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75995f33-0322-42ff-8172-87b46d8fd1bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:35.501632 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c532d33-2993-4528-9d00-01d1441edef5 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:35.501845 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75995f33-0322-42ff-8172-87b46d8fd1bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:35.503812 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75995f33-0322-42ff-8172-87b46d8fd1bc admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:35.506148 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa57967-4690-4714-ac68-732a60f0bd21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:35.507017 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa57967-4690-4714-ac68-732a60f0bd21 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:35.507178 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa57967-4690-4714-ac68-732a60f0bd21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:35.507454 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa57967-4690-4714-ac68-732a60f0bd21 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:35.508130 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa57967-4690-4714-ac68-732a60f0bd21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:35.510006 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa57967-4690-4714-ac68-732a60f0bd21 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:35.529865 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 799/1577] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:29:35 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:29:35.530777 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75995f33-0322-42ff-8172-87b46d8fd1bc admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:35.540249 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 779/1578] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:29:35 2022] POST /identity/v3/projects => generated 405 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:29:35.540249 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa57967-4690-4714-ac68-732a60f0bd21 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:35.594926 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75995f33-0322-42ff-8172-87b46d8fd1bc admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:35.599375 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa57967-4690-4714-ac68-732a60f0bd21 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:35.600523 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79142dfd-dff2-41d8-b465-5987a8158587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:35.601190 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79142dfd-dff2-41d8-b465-5987a8158587 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:35.601487 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79142dfd-dff2-41d8-b465-5987a8158587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:35.601753 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79142dfd-dff2-41d8-b465-5987a8158587 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:35.602488 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79142dfd-dff2-41d8-b465-5987a8158587 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:35.604442 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79142dfd-dff2-41d8-b465-5987a8158587 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:35.604859 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa10339-9a46-43b2-a689-e820ec58f738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:35.605529 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa10339-9a46-43b2-a689-e820ec58f738 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:35.605813 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa10339-9a46-43b2-a689-e820ec58f738 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:35.606090 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa10339-9a46-43b2-a689-e820ec58f738 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:35.606821 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa10339-9a46-43b2-a689-e820ec58f738 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:35.608493 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa10339-9a46-43b2-a689-e820ec58f738 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:35.619545 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 780/1579] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:29:35 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:29:35.620154 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa10339-9a46-43b2-a689-e820ec58f738 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:35.628781 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 800/1580] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:29:35 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:29:35.629437 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79142dfd-dff2-41d8-b465-5987a8158587 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:35.630121 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa10339-9a46-43b2-a689-e820ec58f738 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:35.635751 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ad326-baff-40c6-bb82-a21c6c0904a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:35.636341 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ad326-baff-40c6-bb82-a21c6c0904a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:35.636623 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ad326-baff-40c6-bb82-a21c6c0904a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:35.636895 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ad326-baff-40c6-bb82-a21c6c0904a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:35.637586 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327ad326-baff-40c6-bb82-a21c6c0904a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:35.638912 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79142dfd-dff2-41d8-b465-5987a8158587 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:35.639553 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327ad326-baff-40c6-bb82-a21c6c0904a6 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:35.643673 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9160d0e3-a181-4d09-a542-133461993d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:35.644284 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160d0e3-a181-4d09-a542-133461993d4f admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:35.644559 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160d0e3-a181-4d09-a542-133461993d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:35.644834 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160d0e3-a181-4d09-a542-133461993d4f admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:35.645499 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9160d0e3-a181-4d09-a542-133461993d4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:35.647419 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9160d0e3-a181-4d09-a542-133461993d4f admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:35.665120 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 781/1581] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:29:35 2022] POST /identity/v3/users => generated 297 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:29:35.665120 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ad326-baff-40c6-bb82-a21c6c0904a6 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:35.674645 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ad326-baff-40c6-bb82-a21c6c0904a6 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:35.678849 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 801/1582] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:29:35 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:29:35.678849 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9160d0e3-a181-4d09-a542-133461993d4f admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:35.686618 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:29:35.737586 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10868e45-2f08-4fa6-b3a5-a3fd6881805f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:35.738462 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10868e45-2f08-4fa6-b3a5-a3fd6881805f admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:35.738812 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10868e45-2f08-4fa6-b3a5-a3fd6881805f admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:35.739201 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10868e45-2f08-4fa6-b3a5-a3fd6881805f admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:35.739325 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9160d0e3-a181-4d09-a542-133461993d4f admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:35.740197 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10868e45-2f08-4fa6-b3a5-a3fd6881805f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:35.742355 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10868e45-2f08-4fa6-b3a5-a3fd6881805f admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:35.743068 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcf679e-0d14-408c-b286-eeaa62c85a58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:35.743744 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf679e-0d14-408c-b286-eeaa62c85a58 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:35.744332 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf679e-0d14-408c-b286-eeaa62c85a58 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:35.744332 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf679e-0d14-408c-b286-eeaa62c85a58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:35.754800 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 782/1583] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:29:35 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:29:35.755092 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcf679e-0d14-408c-b286-eeaa62c85a58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:35.755928 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10868e45-2f08-4fa6-b3a5-a3fd6881805f admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:35.756938 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcf679e-0d14-408c-b286-eeaa62c85a58 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:35.766269 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10868e45-2f08-4fa6-b3a5-a3fd6881805f admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:35.767852 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 802/1584] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:29:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:29:35.768722 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcf679e-0d14-408c-b286-eeaa62c85a58 service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:35.771016 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ddf05-0f3e-4423-ad57-3a236e4c01d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:35.771698 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ddf05-0f3e-4423-ad57-3a236e4c01d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:35.772039 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ddf05-0f3e-4423-ad57-3a236e4c01d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:35.772315 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ddf05-0f3e-4423-ad57-3a236e4c01d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:35.772998 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8ddf05-0f3e-4423-ad57-3a236e4c01d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:35.774919 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8ddf05-0f3e-4423-ad57-3a236e4c01d1 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:35.778438 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcf679e-0d14-408c-b286-eeaa62c85a58 service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:35.785034 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa55f0-5e58-4769-bed6-4ce5e8c72bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:35.785794 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa55f0-5e58-4769-bed6-4ce5e8c72bd9 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:35.786200 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa55f0-5e58-4769-bed6-4ce5e8c72bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:35.786537 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa55f0-5e58-4769-bed6-4ce5e8c72bd9 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:35.787367 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaa55f0-5e58-4769-bed6-4ce5e8c72bd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:35.789347 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaa55f0-5e58-4769-bed6-4ce5e8c72bd9 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:35.798477 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 783/1585] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:29:35 2022] POST /identity/v3/users => generated 287 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:29:35.802374 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ddf05-0f3e-4423-ad57-3a236e4c01d1 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:35.805969 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:29:35.813091 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ddf05-0f3e-4423-ad57-3a236e4c01d1 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:35.815695 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 803/1586] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:29:35 2022] POST /identity/v3/users => generated 303 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:29:35.817268 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa55f0-5e58-4769-bed6-4ce5e8c72bd9 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:35.819170 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97670619-3c49-4e98-af02-8bae2cd87b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:35.820066 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97670619-3c49-4e98-af02-8bae2cd87b8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:35.820344 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97670619-3c49-4e98-af02-8bae2cd87b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:35.820917 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97670619-3c49-4e98-af02-8bae2cd87b8a admin admin] PATH_INFO: `/v3/projects/c341097b55354c959d45768712b4748e/users/d2581f217a574b13b0fe042d38a94740/roles/c43aada0326446c4ade0ab1262918fa4` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:35.828573 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa55f0-5e58-4769-bed6-4ce5e8c72bd9 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:35.834079 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2060d555-eef4-43d1-8158-09b64ff7d3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:35.834803 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2060d555-eef4-43d1-8158-09b64ff7d3b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:35.835087 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2060d555-eef4-43d1-8158-09b64ff7d3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:35.835423 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2060d555-eef4-43d1-8158-09b64ff7d3b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:35.836174 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2060d555-eef4-43d1-8158-09b64ff7d3b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:35.837911 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2060d555-eef4-43d1-8158-09b64ff7d3b2 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:35.838038 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97670619-3c49-4e98-af02-8bae2cd87b8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c341097b55354c959d45768712b4748e, user_id=d2581f217a574b13b0fe042d38a94740, role_id=c43aada0326446c4ade0ab1262918fa4)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:35.839068 dv-cinder-846842-9-smb devstack@keystone.service[80234]: WARNING py.warnings [None req-97670619-3c49-4e98-af02-8bae2cd87b8a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 02 03:29:35.839068 dv-cinder-846842-9-smb devstack@keystone.service[80234]: warnings.warn(msg) Jul 02 03:29:35.839068 dv-cinder-846842-9-smb devstack@keystone.service[80234]: Jul 02 03:29:35.841147 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97670619-3c49-4e98-af02-8bae2cd87b8a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:35.851071 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 804/1587] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:29:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:29:35.851670 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2060d555-eef4-43d1-8158-09b64ff7d3b2 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:35.855659 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 784/1588] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:29:35 2022] PUT /identity/v3/projects/c341097b55354c959d45768712b4748e/users/d2581f217a574b13b0fe042d38a94740/roles/c43aada0326446c4ade0ab1262918fa4 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:29:35.856595 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97670619-3c49-4e98-af02-8bae2cd87b8a admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:35.868466 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2060d555-eef4-43d1-8158-09b64ff7d3b2 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:35.931745 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef556c1b-4dae-445b-8e24-e3df49006c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:35.932430 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef556c1b-4dae-445b-8e24-e3df49006c4e admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:35.932682 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97670619-3c49-4e98-af02-8bae2cd87b8a admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:35.932884 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef556c1b-4dae-445b-8e24-e3df49006c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:35.933125 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef556c1b-4dae-445b-8e24-e3df49006c4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:35.934038 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef556c1b-4dae-445b-8e24-e3df49006c4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:35.935706 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef556c1b-4dae-445b-8e24-e3df49006c4e admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:35.947436 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 805/1589] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:29:35 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:29:35.948247 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef556c1b-4dae-445b-8e24-e3df49006c4e admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:35.955639 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cef167-ee9b-4b59-b5bc-ae2807924ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:35.956384 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cef167-ee9b-4b59-b5bc-ae2807924ad9 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:35.956668 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cef167-ee9b-4b59-b5bc-ae2807924ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:35.956944 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cef167-ee9b-4b59-b5bc-ae2807924ad9 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:35.957694 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cef167-ee9b-4b59-b5bc-ae2807924ad9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:35.959959 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cef167-ee9b-4b59-b5bc-ae2807924ad9 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:35.965167 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef556c1b-4dae-445b-8e24-e3df49006c4e admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:35.970434 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7962eff8-d2e1-467c-9535-80bcf58cd1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:35.971282 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7962eff8-d2e1-467c-9535-80bcf58cd1cf admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:35.971810 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7962eff8-d2e1-467c-9535-80bcf58cd1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:35.972262 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7962eff8-d2e1-467c-9535-80bcf58cd1cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:35.973031 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7962eff8-d2e1-467c-9535-80bcf58cd1cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:35.975106 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7962eff8-d2e1-467c-9535-80bcf58cd1cf admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:35.991164 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 785/1590] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:29:35 2022] POST /identity/v3/users => generated 286 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:29:35.991164 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cef167-ee9b-4b59-b5bc-ae2807924ad9 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:35.991454 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 806/1591] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:29:35 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:29:35.991454 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7962eff8-d2e1-467c-9535-80bcf58cd1cf admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:36.002569 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cef167-ee9b-4b59-b5bc-ae2807924ad9 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:36.003540 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7962eff8-d2e1-467c-9535-80bcf58cd1cf admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:36.007769 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfa2f5d-9fc6-443f-a9e4-8009751d15c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:36.008378 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa2f5d-9fc6-443f-a9e4-8009751d15c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:36.009021 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa2f5d-9fc6-443f-a9e4-8009751d15c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:36.009021 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa2f5d-9fc6-443f-a9e4-8009751d15c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:36.009619 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b418eaf-3420-4524-ae5d-c99f00308056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:36.009738 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfa2f5d-9fc6-443f-a9e4-8009751d15c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:36.010489 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b418eaf-3420-4524-ae5d-c99f00308056 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:36.010862 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b418eaf-3420-4524-ae5d-c99f00308056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:36.011266 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b418eaf-3420-4524-ae5d-c99f00308056 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:36.011377 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfa2f5d-9fc6-443f-a9e4-8009751d15c2 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:36.012160 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b418eaf-3420-4524-ae5d-c99f00308056 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:36.014482 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b418eaf-3420-4524-ae5d-c99f00308056 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:36.021415 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 786/1592] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:29:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:29:36.022338 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfa2f5d-9fc6-443f-a9e4-8009751d15c2 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:36.029936 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 807/1593] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:29:35 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:29:36.031175 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d48254-6434-4d75-9bcb-b4e869c0f064 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:36.031473 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d48254-6434-4d75-9bcb-b4e869c0f064 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:36.031756 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d48254-6434-4d75-9bcb-b4e869c0f064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:36.036073 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfa2f5d-9fc6-443f-a9e4-8009751d15c2 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:36.042338 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97b5a20-d46f-4b6b-87ca-d8bc66c7ff4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:36.043113 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b5a20-d46f-4b6b-87ca-d8bc66c7ff4e admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:36.043524 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b5a20-d46f-4b6b-87ca-d8bc66c7ff4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:36.043886 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b5a20-d46f-4b6b-87ca-d8bc66c7ff4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:36.045094 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97b5a20-d46f-4b6b-87ca-d8bc66c7ff4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:36.046944 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97b5a20-d46f-4b6b-87ca-d8bc66c7ff4e admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:36.050268 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-a4d48254-6434-4d75-9bcb-b4e869c0f064 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:29:36.051540 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-a4d48254-6434-4d75-9bcb-b4e869c0f064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:36.061039 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 787/1594] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:29:36 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:29:36.061488 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 808/1595] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:29:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:29:36.062388 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d48254-6434-4d75-9bcb-b4e869c0f064 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:36.065014 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97b5a20-d46f-4b6b-87ca-d8bc66c7ff4e admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:36.073861 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d48254-6434-4d75-9bcb-b4e869c0f064 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:36.075205 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97b5a20-d46f-4b6b-87ca-d8bc66c7ff4e admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:36.078717 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032255e5-51ce-4499-b9de-202986b55345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:36.079478 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032255e5-51ce-4499-b9de-202986b55345 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:36.079764 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032255e5-51ce-4499-b9de-202986b55345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:36.080039 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032255e5-51ce-4499-b9de-202986b55345 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:36.081108 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032255e5-51ce-4499-b9de-202986b55345 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:36.081233 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14343c89-6dc2-4a2a-bea2-d7d49764b32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:36.081681 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14343c89-6dc2-4a2a-bea2-d7d49764b32e admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:36.082069 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14343c89-6dc2-4a2a-bea2-d7d49764b32e admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:36.082370 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032255e5-51ce-4499-b9de-202986b55345 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:36.082485 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14343c89-6dc2-4a2a-bea2-d7d49764b32e admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:36.083431 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14343c89-6dc2-4a2a-bea2-d7d49764b32e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:36.085172 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14343c89-6dc2-4a2a-bea2-d7d49764b32e admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:36.095334 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 809/1596] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:29:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:29:36.095689 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 788/1597] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:29:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:29:36.096597 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032255e5-51ce-4499-b9de-202986b55345 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:36.096739 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14343c89-6dc2-4a2a-bea2-d7d49764b32e admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:36.111368 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032255e5-51ce-4499-b9de-202986b55345 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:36.112651 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14343c89-6dc2-4a2a-bea2-d7d49764b32e admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:36.117581 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e3dd7-2b5d-4d9f-beca-dc539a0a89c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:36.118781 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e3dd7-2b5d-4d9f-beca-dc539a0a89c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:36.119392 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45917326-f3cb-4b81-b4fd-e62d50858e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:36.120379 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45917326-f3cb-4b81-b4fd-e62d50858e90 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:36.120659 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45917326-f3cb-4b81-b4fd-e62d50858e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:36.120932 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45917326-f3cb-4b81-b4fd-e62d50858e90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:36.121662 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45917326-f3cb-4b81-b4fd-e62d50858e90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:36.123297 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45917326-f3cb-4b81-b4fd-e62d50858e90 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:36.125942 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e3dd7-2b5d-4d9f-beca-dc539a0a89c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:36.126312 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e3dd7-2b5d-4d9f-beca-dc539a0a89c5 admin admin] PATH_INFO: `/v3/projects/6cd770bfe49e4af5927749a0da0456c0/users/11ccfa53ebb7405d9325a22f0295bf61/roles/c43aada0326446c4ade0ab1262918fa4` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:36.136545 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 789/1598] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:29:36 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:29:36.137836 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45917326-f3cb-4b81-b4fd-e62d50858e90 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:36.143868 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3e3dd7-2b5d-4d9f-beca-dc539a0a89c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cd770bfe49e4af5927749a0da0456c0, user_id=11ccfa53ebb7405d9325a22f0295bf61, role_id=c43aada0326446c4ade0ab1262918fa4)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:36.146531 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3e3dd7-2b5d-4d9f-beca-dc539a0a89c5 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:36.149323 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45917326-f3cb-4b81-b4fd-e62d50858e90 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:36.155794 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62dfd4b-f134-4e4e-9592-accc1bdc0296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:36.156973 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62dfd4b-f134-4e4e-9592-accc1bdc0296 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:36.156973 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62dfd4b-f134-4e4e-9592-accc1bdc0296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:36.157312 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62dfd4b-f134-4e4e-9592-accc1bdc0296 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:36.158309 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62dfd4b-f134-4e4e-9592-accc1bdc0296 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:36.160210 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62dfd4b-f134-4e4e-9592-accc1bdc0296 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:36.167372 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:29:36.171440 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 810/1599] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:29:36 2022] PUT /identity/v3/projects/6cd770bfe49e4af5927749a0da0456c0/users/11ccfa53ebb7405d9325a22f0295bf61/roles/c43aada0326446c4ade0ab1262918fa4 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:29:36.172168 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e3dd7-2b5d-4d9f-beca-dc539a0a89c5 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:36.181819 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 790/1600] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:29:36 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:29:36.182754 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62dfd4b-f134-4e4e-9592-accc1bdc0296 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:36.247350 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62dfd4b-f134-4e4e-9592-accc1bdc0296 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:36.255211 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e3dd7-2b5d-4d9f-beca-dc539a0a89c5 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:36.260301 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5044b489-4677-49a1-a1b9-7e2ba7bb7b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:36.261795 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044b489-4677-49a1-a1b9-7e2ba7bb7b11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:36.262061 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044b489-4677-49a1-a1b9-7e2ba7bb7b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:36.262332 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044b489-4677-49a1-a1b9-7e2ba7bb7b11 admin admin] PATH_INFO: `/v3/projects/26afb3ba136a454e83a3885a4a09e185/users/bbc6d7339539476d8304683e643cd985/roles/c43aada0326446c4ade0ab1262918fa4` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:36.280889 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5044b489-4677-49a1-a1b9-7e2ba7bb7b11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26afb3ba136a454e83a3885a4a09e185, user_id=bbc6d7339539476d8304683e643cd985, role_id=c43aada0326446c4ade0ab1262918fa4)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:36.283997 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5044b489-4677-49a1-a1b9-7e2ba7bb7b11 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:36.300278 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce5b8fc-87b5-43c6-ba14-6e4502daf96c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:36.300881 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5b8fc-87b5-43c6-ba14-6e4502daf96c service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:36.300981 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5b8fc-87b5-43c6-ba14-6e4502daf96c service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:36.301229 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5b8fc-87b5-43c6-ba14-6e4502daf96c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:36.301879 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 811/1601] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:29:36 2022] PUT /identity/v3/projects/26afb3ba136a454e83a3885a4a09e185/users/bbc6d7339539476d8304683e643cd985/roles/c43aada0326446c4ade0ab1262918fa4 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:29:36.302772 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5044b489-4677-49a1-a1b9-7e2ba7bb7b11 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:36.317566 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:29:36.322123 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce5b8fc-87b5-43c6-ba14-6e4502daf96c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:36.323624 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce5b8fc-87b5-43c6-ba14-6e4502daf96c service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:36.334666 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 791/1602] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:29:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:29:36.335348 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce5b8fc-87b5-43c6-ba14-6e4502daf96c service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:36.344586 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce5b8fc-87b5-43c6-ba14-6e4502daf96c service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:36.381516 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5044b489-4677-49a1-a1b9-7e2ba7bb7b11 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:36.386356 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d46aba-d26b-470b-b50a-7592fb914702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:36.387069 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d46aba-d26b-470b-b50a-7592fb914702 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:36.387401 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d46aba-d26b-470b-b50a-7592fb914702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:36.387677 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d46aba-d26b-470b-b50a-7592fb914702 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:36.388411 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d46aba-d26b-470b-b50a-7592fb914702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:36.390080 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d46aba-d26b-470b-b50a-7592fb914702 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:36.404157 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 812/1603] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:29:36 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:29:36.404157 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d46aba-d26b-470b-b50a-7592fb914702 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:36.413218 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d46aba-d26b-470b-b50a-7592fb914702 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:36.415405 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a8c249-e08c-44a2-aa2b-2890be032e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:36.416407 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8c249-e08c-44a2-aa2b-2890be032e3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:36.417072 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8c249-e08c-44a2-aa2b-2890be032e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:36.417411 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8c249-e08c-44a2-aa2b-2890be032e3b admin admin] PATH_INFO: `/v3/projects/61cf8610ee6b4f2dbad28242343ff604/users/ac2f872367a9463ab4c7c56cec0c79dc/roles/c43aada0326446c4ade0ab1262918fa4` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:36.418877 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035bfe2e-08b8-47e4-a7c2-82bfe27a2d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:36.420122 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035bfe2e-08b8-47e4-a7c2-82bfe27a2d50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:36.421373 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035bfe2e-08b8-47e4-a7c2-82bfe27a2d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:36.421828 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035bfe2e-08b8-47e4-a7c2-82bfe27a2d50 admin admin] PATH_INFO: `/v3/projects/c2670137d6274cb9932e17558514214c/users/6a0b87df6933491b9264226345a5668d/roles/c43aada0326446c4ade0ab1262918fa4` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:36.433512 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a8c249-e08c-44a2-aa2b-2890be032e3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=61cf8610ee6b4f2dbad28242343ff604, user_id=ac2f872367a9463ab4c7c56cec0c79dc, role_id=c43aada0326446c4ade0ab1262918fa4)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:36.436376 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a8c249-e08c-44a2-aa2b-2890be032e3b admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:36.438177 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035bfe2e-08b8-47e4-a7c2-82bfe27a2d50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2670137d6274cb9932e17558514214c, user_id=6a0b87df6933491b9264226345a5668d, role_id=c43aada0326446c4ade0ab1262918fa4)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:36.441075 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035bfe2e-08b8-47e4-a7c2-82bfe27a2d50 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:36.452412 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 792/1604] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:29:36 2022] PUT /identity/v3/projects/61cf8610ee6b4f2dbad28242343ff604/users/ac2f872367a9463ab4c7c56cec0c79dc/roles/c43aada0326446c4ade0ab1262918fa4 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:29:36.453710 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d4a9c-ab8f-4ccc-99e8-3daa7469d8bd None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:36.453849 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d4a9c-ab8f-4ccc-99e8-3daa7469d8bd None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:36.454126 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d4a9c-ab8f-4ccc-99e8-3daa7469d8bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:36.459900 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 813/1605] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:29:36 2022] PUT /identity/v3/projects/c2670137d6274cb9932e17558514214c/users/6a0b87df6933491b9264226345a5668d/roles/c43aada0326446c4ade0ab1262918fa4 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:29:36.468914 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035bfe2e-08b8-47e4-a7c2-82bfe27a2d50 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:36.474002 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-853d4a9c-ab8f-4ccc-99e8-3daa7469d8bd None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:29:36.475153 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-853d4a9c-ab8f-4ccc-99e8-3daa7469d8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:36.520243 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:29:36.547382 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 793/1606] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:29:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:29:36.552581 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d6227c-8c4a-410f-b349-39470ff6ee55 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:36.552696 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035bfe2e-08b8-47e4-a7c2-82bfe27a2d50 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:36.552783 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d6227c-8c4a-410f-b349-39470ff6ee55 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:36.552783 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d6227c-8c4a-410f-b349-39470ff6ee55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:36.558833 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48fb483-b2f2-4664-b021-ae541e02afb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:36.560691 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48fb483-b2f2-4664-b021-ae541e02afb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:36.561005 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48fb483-b2f2-4664-b021-ae541e02afb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:36.561510 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48fb483-b2f2-4664-b021-ae541e02afb1 admin admin] PATH_INFO: `/v3/projects/9238cab16e704b89b7e98b28f245c4d2/users/2cec5dc9207f4151af52feb53f6eee7c/roles/c43aada0326446c4ade0ab1262918fa4` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:36.584699 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-22d6227c-8c4a-410f-b349-39470ff6ee55 None None] MFA Rules not processed for user `bbc6d7339539476d8304683e643cd985`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:29:36.586884 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-22d6227c-8c4a-410f-b349-39470ff6ee55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:36.590551 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48fb483-b2f2-4664-b021-ae541e02afb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9238cab16e704b89b7e98b28f245c4d2, user_id=2cec5dc9207f4151af52feb53f6eee7c, role_id=c43aada0326446c4ade0ab1262918fa4)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:36.595178 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48fb483-b2f2-4664-b021-ae541e02afb1 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:36.616571 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 814/1607] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:29:36 2022] PUT /identity/v3/projects/9238cab16e704b89b7e98b28f245c4d2/users/2cec5dc9207f4151af52feb53f6eee7c/roles/c43aada0326446c4ade0ab1262918fa4 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:29:36.618188 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48fb483-b2f2-4664-b021-ae541e02afb1 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:36.679440 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 794/1608] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:29:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:29:36.681153 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84cee7-fc47-44a4-87b8-f9e6a8d601ff None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:36.681445 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84cee7-fc47-44a4-87b8-f9e6a8d601ff None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:36.681723 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84cee7-fc47-44a4-87b8-f9e6a8d601ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:36.702568 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-8f84cee7-fc47-44a4-87b8-f9e6a8d601ff None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:29:36.704175 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8f84cee7-fc47-44a4-87b8-f9e6a8d601ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:36.715297 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 795/1609] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:29:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:29:36.716858 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b240c4-14b0-4448-b6df-c2a4b4e262ec None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:36.717209 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b240c4-14b0-4448-b6df-c2a4b4e262ec None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:36.717920 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b240c4-14b0-4448-b6df-c2a4b4e262ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:36.719610 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:29:36.729161 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48fb483-b2f2-4664-b021-ae541e02afb1 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:36.745212 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81356bf4-a0bf-4202-b923-291f8e152f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:36.746260 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81356bf4-a0bf-4202-b923-291f8e152f31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:36.746568 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81356bf4-a0bf-4202-b923-291f8e152f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:36.746877 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81356bf4-a0bf-4202-b923-291f8e152f31 admin admin] PATH_INFO: `/v3/projects/4011002d621d4daf91e3903c7a7de14d/users/2886721dc82a446291700ddf3552a927/roles/c43aada0326446c4ade0ab1262918fa4` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:36.756267 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-e6b240c4-14b0-4448-b6df-c2a4b4e262ec None None] MFA Rules not processed for user `6a0b87df6933491b9264226345a5668d`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:29:36.758033 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e6b240c4-14b0-4448-b6df-c2a4b4e262ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:36.767881 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81356bf4-a0bf-4202-b923-291f8e152f31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4011002d621d4daf91e3903c7a7de14d, user_id=2886721dc82a446291700ddf3552a927, role_id=c43aada0326446c4ade0ab1262918fa4)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:36.770707 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81356bf4-a0bf-4202-b923-291f8e152f31 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:36.795637 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 815/1610] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:29:36 2022] PUT /identity/v3/projects/4011002d621d4daf91e3903c7a7de14d/users/2886721dc82a446291700ddf3552a927/roles/c43aada0326446c4ade0ab1262918fa4 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:29:36.796600 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81356bf4-a0bf-4202-b923-291f8e152f31 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:36.867580 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 796/1611] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:29:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:29:36.869627 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0e2f7-bf75-4419-9581-8896284a607f None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:36.870729 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0e2f7-bf75-4419-9581-8896284a607f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:36.871195 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0e2f7-bf75-4419-9581-8896284a607f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:36.902530 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81356bf4-a0bf-4202-b923-291f8e152f31 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:36.910479 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e81825e-9616-464a-9835-13f2529124f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:36.911177 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81825e-9616-464a-9835-13f2529124f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:36.911458 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81825e-9616-464a-9835-13f2529124f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:36.911733 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81825e-9616-464a-9835-13f2529124f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:37.062484 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e81825e-9616-464a-9835-13f2529124f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:37.064192 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e81825e-9616-464a-9835-13f2529124f9 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:37.075596 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 816/1612] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:29:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:29:37.076988 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc8cf6f-250e-44a9-ac67-dcaafe24ef7e None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:37.077278 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc8cf6f-250e-44a9-ac67-dcaafe24ef7e None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:37.077561 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc8cf6f-250e-44a9-ac67-dcaafe24ef7e None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:37.083551 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 817/1613] 10.222.0.60 () {54 vars in 961 bytes} [Sat Jul 2 03:29:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:29:37.084229 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-2da0e2f7-bf75-4419-9581-8896284a607f None None] MFA Rules not processed for user `2cec5dc9207f4151af52feb53f6eee7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:29:37.084486 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc8cf6f-250e-44a9-ac67-dcaafe24ef7e None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:37.085937 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2da0e2f7-bf75-4419-9581-8896284a607f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:37.097124 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc8cf6f-250e-44a9-ac67-dcaafe24ef7e None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:37.101446 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e663e2d3-9115-4e81-ad3f-e564d0a1e4ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:37.102198 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e663e2d3-9115-4e81-ad3f-e564d0a1e4ee service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:37.102503 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e663e2d3-9115-4e81-ad3f-e564d0a1e4ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:37.102816 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e663e2d3-9115-4e81-ad3f-e564d0a1e4ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:37.118125 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e663e2d3-9115-4e81-ad3f-e564d0a1e4ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:37.120704 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e663e2d3-9115-4e81-ad3f-e564d0a1e4ee service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:37.134861 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 818/1614] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:29:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:29:37.137364 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb12de-cdfc-4fc8-84d2-78d0501b5cbc None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:37.137364 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb12de-cdfc-4fc8-84d2-78d0501b5cbc None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:37.137364 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb12de-cdfc-4fc8-84d2-78d0501b5cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:37.153191 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:29:37.174619 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-e1cb12de-cdfc-4fc8-84d2-78d0501b5cbc None None] MFA Rules not processed for user `2886721dc82a446291700ddf3552a927`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:29:37.178757 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-e1cb12de-cdfc-4fc8-84d2-78d0501b5cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:37.196790 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 797/1615] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:29:36 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:29:37.200481 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee93c1-4d57-4b7c-86d7-0c8c874ff99f None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:37.201898 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee93c1-4d57-4b7c-86d7-0c8c874ff99f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:37.202179 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee93c1-4d57-4b7c-86d7-0c8c874ff99f None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:37.205120 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 798/1616] 10.222.0.60 () {54 vars in 961 bytes} [Sat Jul 2 03:29:37 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:29:37.210972 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca9f14c-acd6-467e-a06a-1e4115d2585d None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:37.210972 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca9f14c-acd6-467e-a06a-1e4115d2585d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:37.210972 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca9f14c-acd6-467e-a06a-1e4115d2585d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:37.260554 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-1ca9f14c-acd6-467e-a06a-1e4115d2585d None None] MFA Rules not processed for user `13530240e2d446b6bf26a431d001362a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:29:37.261939 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1ca9f14c-acd6-467e-a06a-1e4115d2585d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:37.290344 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 819/1617] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:29:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:29:37.291431 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cb12de-cdfc-4fc8-84d2-78d0501b5cbc None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:37.314290 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cb12de-cdfc-4fc8-84d2-78d0501b5cbc None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:37.320567 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c76738-6a10-4551-9bc7-085bef826d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:37.321480 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c76738-6a10-4551-9bc7-085bef826d0b admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:37.321832 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c76738-6a10-4551-9bc7-085bef826d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:37.322229 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c76738-6a10-4551-9bc7-085bef826d0b admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:37.323187 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c76738-6a10-4551-9bc7-085bef826d0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:37.325665 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c76738-6a10-4551-9bc7-085bef826d0b admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:37.331884 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:29:37.360449 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 799/1618] 10.222.0.60 () {58 vars in 1058 bytes} [Sat Jul 2 03:29:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:29:37.362928 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe8b36-a11b-46ec-8089-36bce5f519d8 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:37.364565 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe8b36-a11b-46ec-8089-36bce5f519d8 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:37.365146 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe8b36-a11b-46ec-8089-36bce5f519d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:37.387244 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 820/1619] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:29:37 2022] POST /identity/v3/projects => generated 405 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:29:37.388323 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c76738-6a10-4551-9bc7-085bef826d0b admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:37.419934 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-bcfe8b36-a11b-46ec-8089-36bce5f519d8 None None] MFA Rules not processed for user `13530240e2d446b6bf26a431d001362a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:29:37.421160 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-bcfe8b36-a11b-46ec-8089-36bce5f519d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:37.460494 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c76738-6a10-4551-9bc7-085bef826d0b admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:37.471577 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c2634-9da0-4d70-b3ec-4f913934287c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:37.474555 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c2634-9da0-4d70-b3ec-4f913934287c service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:37.475887 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c2634-9da0-4d70-b3ec-4f913934287c service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:37.476319 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c2634-9da0-4d70-b3ec-4f913934287c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:37.570150 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 800/1620] 10.222.0.60 () {58 vars in 1058 bytes} [Sat Jul 2 03:29:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:29:37.578226 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe8b36-a11b-46ec-8089-36bce5f519d8 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:37.598111 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2c2634-9da0-4d70-b3ec-4f913934287c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:37.601294 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe8b36-a11b-46ec-8089-36bce5f519d8 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:37.601828 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2c2634-9da0-4d70-b3ec-4f913934287c service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:37.609139 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428cd37d-43e5-4994-a773-de8613d23fe3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13530240e2d446b6bf26a431d001362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:37.610450 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428cd37d-43e5-4994-a773-de8613d23fe3 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:37.612320 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428cd37d-43e5-4994-a773-de8613d23fe3 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:37.612841 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428cd37d-43e5-4994-a773-de8613d23fe3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:37.620648 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 821/1621] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:29:37 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:29:37.622152 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c2634-9da0-4d70-b3ec-4f913934287c service cinder] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:37.705577 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428cd37d-43e5-4994-a773-de8613d23fe3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:37.707467 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428cd37d-43e5-4994-a773-de8613d23fe3 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:37.720232 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 801/1622] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:29:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:29:37.721360 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428cd37d-43e5-4994-a773-de8613d23fe3 service nova] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:37.734275 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428cd37d-43e5-4994-a773-de8613d23fe3 service nova] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:37.734503 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c2634-9da0-4d70-b3ec-4f913934287c service cinder] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:37.751150 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd28a47-bf8e-476b-a594-1d33f00aa6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:37.751852 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd28a47-bf8e-476b-a594-1d33f00aa6fe admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:37.752137 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd28a47-bf8e-476b-a594-1d33f00aa6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:37.753682 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd28a47-bf8e-476b-a594-1d33f00aa6fe admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:37.755259 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd28a47-bf8e-476b-a594-1d33f00aa6fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:37.761634 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd28a47-bf8e-476b-a594-1d33f00aa6fe admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:37.764963 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd9a55-1b3b-4e4c-b57c-eb6bd385df4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13530240e2d446b6bf26a431d001362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:37.765716 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd9a55-1b3b-4e4c-b57c-eb6bd385df4b service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:37.766003 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd9a55-1b3b-4e4c-b57c-eb6bd385df4b service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:37.766479 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd9a55-1b3b-4e4c-b57c-eb6bd385df4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:37.782460 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:29:37.814414 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 822/1623] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:29:37 2022] POST /identity/v3/users => generated 309 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:29:37.817918 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd28a47-bf8e-476b-a594-1d33f00aa6fe admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:37.840320 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd28a47-bf8e-476b-a594-1d33f00aa6fe admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:37.851681 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a47cebb-e17d-4314-9a9c-6a13852e7041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:37.852594 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a47cebb-e17d-4314-9a9c-6a13852e7041 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:37.852840 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a47cebb-e17d-4314-9a9c-6a13852e7041 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:37.853105 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a47cebb-e17d-4314-9a9c-6a13852e7041 admin admin] PATH_INFO: `/v3/users/2886721dc82a446291700ddf3552a927` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:37.857925 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a47cebb-e17d-4314-9a9c-6a13852e7041 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2886721dc82a446291700ddf3552a927)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:37.865410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a47cebb-e17d-4314-9a9c-6a13852e7041 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:37.899292 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdd9a55-1b3b-4e4c-b57c-eb6bd385df4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:37.900913 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdd9a55-1b3b-4e4c-b57c-eb6bd385df4b service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:37.911485 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 802/1624] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:29:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:29:37.912347 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd9a55-1b3b-4e4c-b57c-eb6bd385df4b service nova] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:37.924126 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd9a55-1b3b-4e4c-b57c-eb6bd385df4b service nova] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:37.928923 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c298c7-cd2f-44e8-82c0-8a6425a208a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:37.929618 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c298c7-cd2f-44e8-82c0-8a6425a208a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:37.929909 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c298c7-cd2f-44e8-82c0-8a6425a208a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:37.930635 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c298c7-cd2f-44e8-82c0-8a6425a208a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:37.931096 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c298c7-cd2f-44e8-82c0-8a6425a208a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:37.933755 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c298c7-cd2f-44e8-82c0-8a6425a208a7 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:37.946018 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 803/1625] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:29:37.949876 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c298c7-cd2f-44e8-82c0-8a6425a208a7 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:37.950565 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:29:37.962768 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c298c7-cd2f-44e8-82c0-8a6425a208a7 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:37.973976 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0fcf63-b2c2-4eba-8dd4-13711cbcad47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:37.974937 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0fcf63-b2c2-4eba-8dd4-13711cbcad47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:37.975406 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0fcf63-b2c2-4eba-8dd4-13711cbcad47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:37.975937 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0fcf63-b2c2-4eba-8dd4-13711cbcad47 admin admin] PATH_INFO: `/v3/projects/3504ab706b9640a2907632a72189404e/users/f51bc29f1ad84d4186521ac621aa6ef2/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:38.083879 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-1a47cebb-e17d-4314-9a9c-6a13852e7041 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2886721dc82a446291700ddf3552a927'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:29:38.083879 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-1a47cebb-e17d-4314-9a9c-6a13852e7041 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2886721dc82a446291700ddf3552a927'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:29:38.084391 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0fcf63-b2c2-4eba-8dd4-13711cbcad47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3504ab706b9640a2907632a72189404e, user_id=f51bc29f1ad84d4186521ac621aa6ef2, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:38.084391 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0fcf63-b2c2-4eba-8dd4-13711cbcad47 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:38.084730 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-1a47cebb-e17d-4314-9a9c-6a13852e7041 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2886721dc82a446291700ddf3552a927'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:29:38.084730 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-1a47cebb-e17d-4314-9a9c-6a13852e7041 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2886721dc82a446291700ddf3552a927'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:29:38.084906 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 804/1626] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:29:37 2022] PUT /identity/v3/projects/3504ab706b9640a2907632a72189404e/users/f51bc29f1ad84d4186521ac621aa6ef2/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 03:29:38.085002 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-1a47cebb-e17d-4314-9a9c-6a13852e7041 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2886721dc82a446291700ddf3552a927'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:29:38.085090 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0fcf63-b2c2-4eba-8dd4-13711cbcad47 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:38.085090 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5c0fcf63-b2c2-4eba-8dd4-13711cbcad47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:38.117291 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 823/1627] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:29:37 2022] DELETE /identity/v3/users/2886721dc82a446291700ddf3552a927 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:29:38.127790 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226948c6-10d4-470d-9ab7-33536a943c97 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:38.128134 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226948c6-10d4-470d-9ab7-33536a943c97 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:38.128463 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226948c6-10d4-470d-9ab7-33536a943c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:38.199268 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-226948c6-10d4-470d-9ab7-33536a943c97 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:29:38.205370 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-226948c6-10d4-470d-9ab7-33536a943c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:38.329095 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0fcf63-b2c2-4eba-8dd4-13711cbcad47 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:38.365220 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 824/1628] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:29:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:29:38.378862 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22beb340-c8c9-4ba2-b43f-0861cef801e7 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:38.379418 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22beb340-c8c9-4ba2-b43f-0861cef801e7 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:38.380486 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22beb340-c8c9-4ba2-b43f-0861cef801e7 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:38.383570 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 825/1629] 10.222.0.60 () {54 vars in 912 bytes} [Sat Jul 2 03:29:38 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:29:38.388923 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151c6d4-e1bb-4c4c-b6ee-93fccdfd59f1 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:38.389891 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151c6d4-e1bb-4c4c-b6ee-93fccdfd59f1 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:38.390349 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151c6d4-e1bb-4c4c-b6ee-93fccdfd59f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:38.425145 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-7151c6d4-e1bb-4c4c-b6ee-93fccdfd59f1 None None] MFA Rules not processed for user `13530240e2d446b6bf26a431d001362a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:29:38.426417 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-7151c6d4-e1bb-4c4c-b6ee-93fccdfd59f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:38.491633 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e75d039-1198-439f-922d-8e2665bbc4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:38.492411 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75d039-1198-439f-922d-8e2665bbc4ff admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:38.492691 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75d039-1198-439f-922d-8e2665bbc4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:38.492960 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75d039-1198-439f-922d-8e2665bbc4ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:38.493695 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e75d039-1198-439f-922d-8e2665bbc4ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:38.495545 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e75d039-1198-439f-922d-8e2665bbc4ff admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:38.521422 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 805/1630] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:29:38 2022] GET /identity/v3/roles => generated 1420 bytes in 466 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:29:38.529957 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d9605-7658-4001-8b8a-13e863196bb9 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:38.530504 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d9605-7658-4001-8b8a-13e863196bb9 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:38.530883 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d9605-7658-4001-8b8a-13e863196bb9 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:38.533603 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 806/1631] 10.222.0.60 () {54 vars in 912 bytes} [Sat Jul 2 03:29:38 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:29:38.534393 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06d9605-7658-4001-8b8a-13e863196bb9 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:38.543173 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a06d9605-7658-4001-8b8a-13e863196bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:38.545656 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 826/1632] 10.222.0.60 () {58 vars in 1009 bytes} [Sat Jul 2 03:29:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:29:38.546521 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7151c6d4-e1bb-4c4c-b6ee-93fccdfd59f1 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:38.565139 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7151c6d4-e1bb-4c4c-b6ee-93fccdfd59f1 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:38.571328 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da3a093-c665-494c-bc02-e5ed940d3698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:38.574181 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da3a093-c665-494c-bc02-e5ed940d3698 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:38.574181 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da3a093-c665-494c-bc02-e5ed940d3698 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:38.574410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da3a093-c665-494c-bc02-e5ed940d3698 admin admin] PATH_INFO: `/v3/projects/3504ab706b9640a2907632a72189404e/users/f51bc29f1ad84d4186521ac621aa6ef2/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:38.576817 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da3a093-c665-494c-bc02-e5ed940d3698 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3504ab706b9640a2907632a72189404e, user_id=f51bc29f1ad84d4186521ac621aa6ef2, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:38.579017 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:29:38.587295 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da3a093-c665-494c-bc02-e5ed940d3698 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:38.603964 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 827/1633] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:29:38 2022] PUT /identity/v3/projects/3504ab706b9640a2907632a72189404e/users/f51bc29f1ad84d4186521ac621aa6ef2/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:29:38.606125 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b43953-21c0-40cc-87dc-445f6f9beb1e None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:38.606125 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b43953-21c0-40cc-87dc-445f6f9beb1e None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:38.606125 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b43953-21c0-40cc-87dc-445f6f9beb1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:38.635011 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-c4b43953-21c0-40cc-87dc-445f6f9beb1e None None] MFA Rules not processed for user `13530240e2d446b6bf26a431d001362a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:29:38.636569 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-c4b43953-21c0-40cc-87dc-445f6f9beb1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:38.654097 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:29:38.688753 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06d9605-7658-4001-8b8a-13e863196bb9 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:38.781888 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 828/1634] 10.222.0.60 () {58 vars in 1009 bytes} [Sat Jul 2 03:29:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:29:38.783054 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b43953-21c0-40cc-87dc-445f6f9beb1e None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:38.785389 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-c4b43953-21c0-40cc-87dc-445f6f9beb1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:38.813154 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bbcefd-eccf-4993-814c-1c2657d4d89a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:38.815888 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bbcefd-eccf-4993-814c-1c2657d4d89a service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:38.817971 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bbcefd-eccf-4993-814c-1c2657d4d89a service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:38.818385 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bbcefd-eccf-4993-814c-1c2657d4d89a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:38.880130 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b43953-21c0-40cc-87dc-445f6f9beb1e None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:38.884863 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355fd6d8-5f7d-4d44-8b57-18f5b6bd7bad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:38.885397 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355fd6d8-5f7d-4d44-8b57-18f5b6bd7bad service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:38.885772 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355fd6d8-5f7d-4d44-8b57-18f5b6bd7bad service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:38.886140 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355fd6d8-5f7d-4d44-8b57-18f5b6bd7bad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:38.899495 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355fd6d8-5f7d-4d44-8b57-18f5b6bd7bad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:38.901133 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355fd6d8-5f7d-4d44-8b57-18f5b6bd7bad service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:38.917342 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 829/1635] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:29:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:29:38.919083 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f7074-8b78-44a8-a5c5-b95ed7d28627 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:38.919662 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f7074-8b78-44a8-a5c5-b95ed7d28627 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:38.920032 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f7074-8b78-44a8-a5c5-b95ed7d28627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:38.951627 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-d15f7074-8b78-44a8-a5c5-b95ed7d28627 None None] MFA Rules not processed for user `f51bc29f1ad84d4186521ac621aa6ef2`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:29:38.953099 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-d15f7074-8b78-44a8-a5c5-b95ed7d28627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:38.966458 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bbcefd-eccf-4993-814c-1c2657d4d89a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:38.970145 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bbcefd-eccf-4993-814c-1c2657d4d89a service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:38.988378 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 807/1636] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:29:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:29:38.989611 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bbcefd-eccf-4993-814c-1c2657d4d89a service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:38.992025 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-97bbcefd-eccf-4993-814c-1c2657d4d89a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:39.007398 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bbcefd-eccf-4993-814c-1c2657d4d89a service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:39.013487 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912cbfe0-11c9-43d0-8af3-8b10c4f56dba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:39.014460 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912cbfe0-11c9-43d0-8af3-8b10c4f56dba service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:39.014896 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912cbfe0-11c9-43d0-8af3-8b10c4f56dba service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:39.015388 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912cbfe0-11c9-43d0-8af3-8b10c4f56dba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:39.033123 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912cbfe0-11c9-43d0-8af3-8b10c4f56dba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:39.034828 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912cbfe0-11c9-43d0-8af3-8b10c4f56dba service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:39.053935 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 808/1637] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:29:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:29:39.121546 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 830/1638] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:29:38 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:29:39.769101 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912cbfe0-11c9-43d0-8af3-8b10c4f56dba service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:39.778701 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912cbfe0-11c9-43d0-8af3-8b10c4f56dba service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:39.783730 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698bf71f-776b-46eb-9ca0-2e4c97842acc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:39.784631 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698bf71f-776b-46eb-9ca0-2e4c97842acc service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:39.785068 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698bf71f-776b-46eb-9ca0-2e4c97842acc service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:39.785484 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698bf71f-776b-46eb-9ca0-2e4c97842acc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:39.796474 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698bf71f-776b-46eb-9ca0-2e4c97842acc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:39.798240 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698bf71f-776b-46eb-9ca0-2e4c97842acc service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:39.833577 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 809/1639] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:29:39 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:29:40.448362 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f7074-8b78-44a8-a5c5-b95ed7d28627 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:40.461602 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f7074-8b78-44a8-a5c5-b95ed7d28627 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:40.467455 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41e4500-5728-44b6-b6bc-473f3320855e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:40.468555 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e4500-5728-44b6-b6bc-473f3320855e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:40.468992 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e4500-5728-44b6-b6bc-473f3320855e admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:40.469371 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e4500-5728-44b6-b6bc-473f3320855e admin admin] PATH_INFO: `/v3/users/2cec5dc9207f4151af52feb53f6eee7c` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:40.470812 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41e4500-5728-44b6-b6bc-473f3320855e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cec5dc9207f4151af52feb53f6eee7c)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:40.473019 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41e4500-5728-44b6-b6bc-473f3320855e admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:40.531277 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:29:40.545436 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-f41e4500-5728-44b6-b6bc-473f3320855e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cec5dc9207f4151af52feb53f6eee7c'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:29:40.546302 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-f41e4500-5728-44b6-b6bc-473f3320855e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cec5dc9207f4151af52feb53f6eee7c'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:29:40.560852 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-f41e4500-5728-44b6-b6bc-473f3320855e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cec5dc9207f4151af52feb53f6eee7c'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:29:40.562468 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-f41e4500-5728-44b6-b6bc-473f3320855e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cec5dc9207f4151af52feb53f6eee7c'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:29:40.582298 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-f41e4500-5728-44b6-b6bc-473f3320855e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cec5dc9207f4151af52feb53f6eee7c'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:29:40.602830 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 831/1640] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:29:40 2022] DELETE /identity/v3/users/2cec5dc9207f4151af52feb53f6eee7c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:29:40.606157 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0abb9dd-f557-442f-9afa-ea68a6a09946 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:40.606681 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0abb9dd-f557-442f-9afa-ea68a6a09946 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:40.607574 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0abb9dd-f557-442f-9afa-ea68a6a09946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:40.647641 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-d0abb9dd-f557-442f-9afa-ea68a6a09946 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:29:40.649245 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d0abb9dd-f557-442f-9afa-ea68a6a09946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:40.730536 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41e4500-5728-44b6-b6bc-473f3320855e admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:40.734589 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-f41e4500-5728-44b6-b6bc-473f3320855e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:40.800824 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:29:40.839353 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 810/1641] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:29:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:29:40.892310 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41e4500-5728-44b6-b6bc-473f3320855e admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:40.901897 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16e3046-0089-49fb-935e-aa3d286ed908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:40.903047 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e3046-0089-49fb-935e-aa3d286ed908 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:40.903477 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e3046-0089-49fb-935e-aa3d286ed908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:40.903858 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e3046-0089-49fb-935e-aa3d286ed908 admin admin] PATH_INFO: `/v3/projects/4011002d621d4daf91e3903c7a7de14d` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:40.905234 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16e3046-0089-49fb-935e-aa3d286ed908 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4011002d621d4daf91e3903c7a7de14d)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:40.906669 dv-cinder-846842-9-smb devstack@keystone.service[80233]: WARNING py.warnings [None req-e16e3046-0089-49fb-935e-aa3d286ed908 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 02 03:29:40.906669 dv-cinder-846842-9-smb devstack@keystone.service[80233]: warnings.warn(msg) Jul 02 03:29:40.906669 dv-cinder-846842-9-smb devstack@keystone.service[80233]: Jul 02 03:29:40.908348 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16e3046-0089-49fb-935e-aa3d286ed908 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:40.914688 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0abb9dd-f557-442f-9afa-ea68a6a09946 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:40.917617 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d0abb9dd-f557-442f-9afa-ea68a6a09946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:41.093319 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e16e3046-0089-49fb-935e-aa3d286ed908 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4011002d621d4daf91e3903c7a7de14d', 'request_id': 'req-e16e3046-0089-49fb-935e-aa3d286ed908'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:29:41.109864 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e16e3046-0089-49fb-935e-aa3d286ed908 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4011002d621d4daf91e3903c7a7de14d', 'request_id': 'req-e16e3046-0089-49fb-935e-aa3d286ed908'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:29:41.137553 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0abb9dd-f557-442f-9afa-ea68a6a09946 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:41.147258 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e16e3046-0089-49fb-935e-aa3d286ed908 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4011002d621d4daf91e3903c7a7de14d', 'request_id': 'req-e16e3046-0089-49fb-935e-aa3d286ed908'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:29:41.170749 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e16e3046-0089-49fb-935e-aa3d286ed908 admin admin] The token cache is being invalidate because project 4011002d621d4daf91e3903c7a7de14d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:29:41.171064 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e16e3046-0089-49fb-935e-aa3d286ed908 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:29:41.172914 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e16e3046-0089-49fb-935e-aa3d286ed908 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:29:41.180149 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 832/1642] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:29:40 2022] DELETE /identity/v3/projects/4011002d621d4daf91e3903c7a7de14d => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 03:29:41.184053 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32f592-71cf-415b-94a3-d389d588810f None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:41.184346 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32f592-71cf-415b-94a3-d389d588810f None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:41.184625 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32f592-71cf-415b-94a3-d389d588810f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:41.232192 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-da32f592-71cf-415b-94a3-d389d588810f None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:29:41.233430 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-da32f592-71cf-415b-94a3-d389d588810f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:41.401346 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c654393-671d-4c28-89aa-04bf85d37341 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:41.402237 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c654393-671d-4c28-89aa-04bf85d37341 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:41.402520 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c654393-671d-4c28-89aa-04bf85d37341 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:41.403725 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c654393-671d-4c28-89aa-04bf85d37341 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:41.411892 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9c654393-671d-4c28-89aa-04bf85d37341 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:41.464183 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:29:41.536749 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 833/1643] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:29:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:29:41.543764 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5af86-b272-483c-88fc-abb79cf06847 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:41.544053 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5af86-b272-483c-88fc-abb79cf06847 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:41.544554 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5af86-b272-483c-88fc-abb79cf06847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:41.596467 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-f1c5af86-b272-483c-88fc-abb79cf06847 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:29:41.597980 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-f1c5af86-b272-483c-88fc-abb79cf06847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:41.608079 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c654393-671d-4c28-89aa-04bf85d37341 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:41.611156 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c654393-671d-4c28-89aa-04bf85d37341 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:41.622045 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 834/1644] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:29:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 03:29:41.623337 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c5af86-b272-483c-88fc-abb79cf06847 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:41.636368 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 811/1645] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:29:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 722 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:29:41.644841 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c5af86-b272-483c-88fc-abb79cf06847 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:41.651129 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aec56be-61e6-4ce1-8f2a-2a2f268f1727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:41.652299 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec56be-61e6-4ce1-8f2a-2a2f268f1727 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:41.652583 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec56be-61e6-4ce1-8f2a-2a2f268f1727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:41.652859 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec56be-61e6-4ce1-8f2a-2a2f268f1727 admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:41.653735 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aec56be-61e6-4ce1-8f2a-2a2f268f1727 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:29:41.654053 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aec56be-61e6-4ce1-8f2a-2a2f268f1727 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:41.655817 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aec56be-61e6-4ce1-8f2a-2a2f268f1727 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:41.677652 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 835/1646] 10.222.0.60 () {58 vars in 1152 bytes} [Sat Jul 2 03:29:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:29:41.679242 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c654393-671d-4c28-89aa-04bf85d37341 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:41.699036 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c654393-671d-4c28-89aa-04bf85d37341 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:41.723885 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8063e0-9a58-496a-b2fa-3d61670e67ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:41.725794 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8063e0-9a58-496a-b2fa-3d61670e67ea admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:41.727777 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8063e0-9a58-496a-b2fa-3d61670e67ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:41.728753 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8063e0-9a58-496a-b2fa-3d61670e67ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:41.732316 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8063e0-9a58-496a-b2fa-3d61670e67ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:41.738956 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8063e0-9a58-496a-b2fa-3d61670e67ea admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:41.831171 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 812/1647] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:29:41 2022] POST /identity/v3/projects => generated 361 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 03:29:41.834365 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aec56be-61e6-4ce1-8f2a-2a2f268f1727 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:41.850756 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aec56be-61e6-4ce1-8f2a-2a2f268f1727 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:42.025989 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e903d5-58f1-437f-9803-aae214fc969c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:42.026281 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e903d5-58f1-437f-9803-aae214fc969c admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:42.026763 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e903d5-58f1-437f-9803-aae214fc969c admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:42.027042 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e903d5-58f1-437f-9803-aae214fc969c admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:42.027785 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e903d5-58f1-437f-9803-aae214fc969c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:42.031169 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e903d5-58f1-437f-9803-aae214fc969c admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:42.068201 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 836/1648] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:29:41 2022] POST /identity/v3/users => generated 281 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:29:42.069058 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8063e0-9a58-496a-b2fa-3d61670e67ea admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:42.096808 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8063e0-9a58-496a-b2fa-3d61670e67ea admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:42.125630 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e055e0-278d-48d5-b0c2-2d6a5bd9cf1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:42.129005 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e055e0-278d-48d5-b0c2-2d6a5bd9cf1b admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:42.130768 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e055e0-278d-48d5-b0c2-2d6a5bd9cf1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:42.131531 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e055e0-278d-48d5-b0c2-2d6a5bd9cf1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:42.134144 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e055e0-278d-48d5-b0c2-2d6a5bd9cf1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:42.138690 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e055e0-278d-48d5-b0c2-2d6a5bd9cf1b admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:42.156551 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 813/1649] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:29:42 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:29:42.161282 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e903d5-58f1-437f-9803-aae214fc969c admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:42.174322 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e903d5-58f1-437f-9803-aae214fc969c admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:42.193427 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b905fe6-a17b-4d02-834e-51fd9628e9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:42.194369 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b905fe6-a17b-4d02-834e-51fd9628e9e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:42.194800 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b905fe6-a17b-4d02-834e-51fd9628e9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:42.195221 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b905fe6-a17b-4d02-834e-51fd9628e9e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:42.196351 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b905fe6-a17b-4d02-834e-51fd9628e9e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:42.199587 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b905fe6-a17b-4d02-834e-51fd9628e9e2 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:42.225499 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e055e0-278d-48d5-b0c2-2d6a5bd9cf1b admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:42.233735 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 837/1650] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:29:42 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:29:42.239779 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e055e0-278d-48d5-b0c2-2d6a5bd9cf1b admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:42.248413 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89be4c53-1b37-4801-8146-cc81ca2115b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:42.250097 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be4c53-1b37-4801-8146-cc81ca2115b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:42.250097 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be4c53-1b37-4801-8146-cc81ca2115b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:42.250538 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be4c53-1b37-4801-8146-cc81ca2115b2 admin admin] PATH_INFO: `/v3/projects/06b087a8c8f24299ae7df2b21034931e/users/f218a5fdda8348208efc9043fb4b984b/roles/c43aada0326446c4ade0ab1262918fa4` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:42.287811 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89be4c53-1b37-4801-8146-cc81ca2115b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06b087a8c8f24299ae7df2b21034931e, user_id=f218a5fdda8348208efc9043fb4b984b, role_id=c43aada0326446c4ade0ab1262918fa4)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:42.293297 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89be4c53-1b37-4801-8146-cc81ca2115b2 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:42.335975 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 814/1651] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:29:42 2022] PUT /identity/v3/projects/06b087a8c8f24299ae7df2b21034931e/users/f218a5fdda8348208efc9043fb4b984b/roles/c43aada0326446c4ade0ab1262918fa4 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:29:42.336623 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a02ddf-0359-4887-9a23-cf740e060869 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:42.336949 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a02ddf-0359-4887-9a23-cf740e060869 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:42.337892 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a02ddf-0359-4887-9a23-cf740e060869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:42.400979 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-68a02ddf-0359-4887-9a23-cf740e060869 None None] MFA Rules not processed for user `f218a5fdda8348208efc9043fb4b984b`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:29:42.403228 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-68a02ddf-0359-4887-9a23-cf740e060869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:42.623864 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 838/1652] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:29:42 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:29:42.676888 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89be4c53-1b37-4801-8146-cc81ca2115b2 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:42.678767 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-89be4c53-1b37-4801-8146-cc81ca2115b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:42.685423 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:29:42.832025 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89be4c53-1b37-4801-8146-cc81ca2115b2 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:42.837676 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1894a-6e06-4057-8ac7-6c01d1c4a3e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:42.839103 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1894a-6e06-4057-8ac7-6c01d1c4a3e5 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:42.839645 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1894a-6e06-4057-8ac7-6c01d1c4a3e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:42.840131 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1894a-6e06-4057-8ac7-6c01d1c4a3e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:42.851365 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc1894a-6e06-4057-8ac7-6c01d1c4a3e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:42.853587 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc1894a-6e06-4057-8ac7-6c01d1c4a3e5 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:42.881406 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 815/1653] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:29:42 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:29:42.900797 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a02ddf-0359-4887-9a23-cf740e060869 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:42.965356 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1894a-6e06-4057-8ac7-6c01d1c4a3e5 service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:42.966983 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7bc1894a-6e06-4057-8ac7-6c01d1c4a3e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:42.979440 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:29:43.035646 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a02ddf-0359-4887-9a23-cf740e060869 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:43.042981 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9659bae7-cbf5-4cd5-a10a-fcc710d0f6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:43.044038 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659bae7-cbf5-4cd5-a10a-fcc710d0f6eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:43.045298 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659bae7-cbf5-4cd5-a10a-fcc710d0f6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:43.045703 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659bae7-cbf5-4cd5-a10a-fcc710d0f6eb admin admin] PATH_INFO: `/v3/users/f218a5fdda8348208efc9043fb4b984b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:43.050552 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9659bae7-cbf5-4cd5-a10a-fcc710d0f6eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f218a5fdda8348208efc9043fb4b984b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:43.053499 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9659bae7-cbf5-4cd5-a10a-fcc710d0f6eb admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:43.098330 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1894a-6e06-4057-8ac7-6c01d1c4a3e5 service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:43.111962 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7feaa5-794b-44ef-977d-74d63e5f0237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:43.112877 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7feaa5-794b-44ef-977d-74d63e5f0237 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:43.113146 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7feaa5-794b-44ef-977d-74d63e5f0237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:43.113421 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7feaa5-794b-44ef-977d-74d63e5f0237 admin admin] PATH_INFO: `/v3/users/6a0b87df6933491b9264226345a5668d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:43.114764 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7feaa5-794b-44ef-977d-74d63e5f0237 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a0b87df6933491b9264226345a5668d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:43.115871 dv-cinder-846842-9-smb devstack@keystone.service[80234]: WARNING py.warnings [None req-6b7feaa5-794b-44ef-977d-74d63e5f0237 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 02 03:29:43.115871 dv-cinder-846842-9-smb devstack@keystone.service[80234]: warnings.warn(msg) Jul 02 03:29:43.115871 dv-cinder-846842-9-smb devstack@keystone.service[80234]: Jul 02 03:29:43.117096 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7feaa5-794b-44ef-977d-74d63e5f0237 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:43.132843 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-9659bae7-cbf5-4cd5-a10a-fcc710d0f6eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f218a5fdda8348208efc9043fb4b984b'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:29:43.135716 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-9659bae7-cbf5-4cd5-a10a-fcc710d0f6eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f218a5fdda8348208efc9043fb4b984b'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:29:43.151985 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-9659bae7-cbf5-4cd5-a10a-fcc710d0f6eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f218a5fdda8348208efc9043fb4b984b'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:29:43.152767 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-9659bae7-cbf5-4cd5-a10a-fcc710d0f6eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f218a5fdda8348208efc9043fb4b984b'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:29:43.178683 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-9659bae7-cbf5-4cd5-a10a-fcc710d0f6eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f218a5fdda8348208efc9043fb4b984b'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:29:43.220788 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 839/1654] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:29:42 2022] DELETE /identity/v3/users/f218a5fdda8348208efc9043fb4b984b => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:29:43.227407 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af025f5-6886-428a-9171-cfc2ed9b62eb None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:43.227795 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af025f5-6886-428a-9171-cfc2ed9b62eb None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:43.228644 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af025f5-6886-428a-9171-cfc2ed9b62eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:43.238328 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6b7feaa5-794b-44ef-977d-74d63e5f0237 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a0b87df6933491b9264226345a5668d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:29:43.239023 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6b7feaa5-794b-44ef-977d-74d63e5f0237 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a0b87df6933491b9264226345a5668d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:29:43.239695 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6b7feaa5-794b-44ef-977d-74d63e5f0237 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a0b87df6933491b9264226345a5668d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:29:43.269135 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-7af025f5-6886-428a-9171-cfc2ed9b62eb None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:29:43.273129 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-7af025f5-6886-428a-9171-cfc2ed9b62eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:43.283765 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6b7feaa5-794b-44ef-977d-74d63e5f0237 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a0b87df6933491b9264226345a5668d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:29:43.305388 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6b7feaa5-794b-44ef-977d-74d63e5f0237 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a0b87df6933491b9264226345a5668d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:29:43.333326 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 816/1655] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:29:42 2022] DELETE /identity/v3/users/6a0b87df6933491b9264226345a5668d => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:29:43.334260 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7feaa5-794b-44ef-977d-74d63e5f0237 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:43.344057 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-6b7feaa5-794b-44ef-977d-74d63e5f0237 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:43.387205 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 840/1656] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:29:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 03:29:43.389612 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e378e3-a47b-4eb4-8522-882325c43e48 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:43.389992 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e378e3-a47b-4eb4-8522-882325c43e48 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:43.390366 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e378e3-a47b-4eb4-8522-882325c43e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:43.392860 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:29:43.420352 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-90e378e3-a47b-4eb4-8522-882325c43e48 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:29:43.421871 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-90e378e3-a47b-4eb4-8522-882325c43e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:43.471335 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7feaa5-794b-44ef-977d-74d63e5f0237 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:43.484149 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdba71a-d437-4f86-aec8-cb8b52e319ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:43.484688 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdba71a-d437-4f86-aec8-cb8b52e319ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:43.484969 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdba71a-d437-4f86-aec8-cb8b52e319ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:43.485242 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdba71a-d437-4f86-aec8-cb8b52e319ee admin admin] PATH_INFO: `/v3/projects/9238cab16e704b89b7e98b28f245c4d2` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:43.486514 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdba71a-d437-4f86-aec8-cb8b52e319ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=9238cab16e704b89b7e98b28f245c4d2)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:43.488509 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdba71a-d437-4f86-aec8-cb8b52e319ee admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:43.507196 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:29:43.533499 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 841/1657] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:29:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:29:43.533499 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e378e3-a47b-4eb4-8522-882325c43e48 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:43.533942 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-90e378e3-a47b-4eb4-8522-882325c43e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:43.584697 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6fdba71a-d437-4f86-aec8-cb8b52e319ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9238cab16e704b89b7e98b28f245c4d2', 'request_id': 'req-6fdba71a-d437-4f86-aec8-cb8b52e319ee'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:29:43.596049 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6fdba71a-d437-4f86-aec8-cb8b52e319ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9238cab16e704b89b7e98b28f245c4d2', 'request_id': 'req-6fdba71a-d437-4f86-aec8-cb8b52e319ee'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:29:43.616438 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6fdba71a-d437-4f86-aec8-cb8b52e319ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9238cab16e704b89b7e98b28f245c4d2', 'request_id': 'req-6fdba71a-d437-4f86-aec8-cb8b52e319ee'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:29:43.639951 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6fdba71a-d437-4f86-aec8-cb8b52e319ee admin admin] The token cache is being invalidate because project 9238cab16e704b89b7e98b28f245c4d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:29:43.640239 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6fdba71a-d437-4f86-aec8-cb8b52e319ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:29:43.640923 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6fdba71a-d437-4f86-aec8-cb8b52e319ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:29:43.642822 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 817/1658] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:29:43 2022] DELETE /identity/v3/projects/9238cab16e704b89b7e98b28f245c4d2 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:29:43.643768 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdba71a-d437-4f86-aec8-cb8b52e319ee admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:43.646437 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-6fdba71a-d437-4f86-aec8-cb8b52e319ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:43.651147 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e378e3-a47b-4eb4-8522-882325c43e48 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:43.746969 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6571f58-8c6d-452f-a634-2fe65e38720c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:43.749052 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6571f58-8c6d-452f-a634-2fe65e38720c service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:43.749633 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6571f58-8c6d-452f-a634-2fe65e38720c service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:43.750197 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6571f58-8c6d-452f-a634-2fe65e38720c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:43.752844 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-e6571f58-8c6d-452f-a634-2fe65e38720c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:43.766449 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdba71a-d437-4f86-aec8-cb8b52e319ee admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:43.774361 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d4ffd-0fc7-4b1b-b90b-07a55f5cf2d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:43.775091 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d4ffd-0fc7-4b1b-b90b-07a55f5cf2d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:43.775342 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d4ffd-0fc7-4b1b-b90b-07a55f5cf2d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:43.775618 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d4ffd-0fc7-4b1b-b90b-07a55f5cf2d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:43.780551 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-6b6d4ffd-0fc7-4b1b-b90b-07a55f5cf2d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:43.863199 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6571f58-8c6d-452f-a634-2fe65e38720c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:43.866028 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6571f58-8c6d-452f-a634-2fe65e38720c service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:43.903456 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 842/1659] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:29:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:29:43.904454 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6571f58-8c6d-452f-a634-2fe65e38720c service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:43.905858 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-e6571f58-8c6d-452f-a634-2fe65e38720c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:43.907872 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6d4ffd-0fc7-4b1b-b90b-07a55f5cf2d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:43.909168 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6d4ffd-0fc7-4b1b-b90b-07a55f5cf2d7 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:43.939345 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 818/1660] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:29:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:29:43.958273 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6571f58-8c6d-452f-a634-2fe65e38720c service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:43.976763 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de7f769-7006-40c9-aeb1-f41dde212a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:43.979097 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7f769-7006-40c9-aeb1-f41dde212a58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:43.980809 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7f769-7006-40c9-aeb1-f41dde212a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:43.982228 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7f769-7006-40c9-aeb1-f41dde212a58 admin admin] PATH_INFO: `/v3/users/f51bc29f1ad84d4186521ac621aa6ef2` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:43.987977 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de7f769-7006-40c9-aeb1-f41dde212a58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f51bc29f1ad84d4186521ac621aa6ef2)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:43.996578 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de7f769-7006-40c9-aeb1-f41dde212a58 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:44.132554 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6de7f769-7006-40c9-aeb1-f41dde212a58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f51bc29f1ad84d4186521ac621aa6ef2'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:29:44.133239 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6de7f769-7006-40c9-aeb1-f41dde212a58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f51bc29f1ad84d4186521ac621aa6ef2'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:29:44.138127 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:29:44.151821 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6de7f769-7006-40c9-aeb1-f41dde212a58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f51bc29f1ad84d4186521ac621aa6ef2'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:29:44.153563 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6de7f769-7006-40c9-aeb1-f41dde212a58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f51bc29f1ad84d4186521ac621aa6ef2'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:29:44.206400 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6de7f769-7006-40c9-aeb1-f41dde212a58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f51bc29f1ad84d4186521ac621aa6ef2'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:29:44.262213 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 843/1661] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:29:43 2022] DELETE /identity/v3/users/f51bc29f1ad84d4186521ac621aa6ef2 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:29:45.453187 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d4ffd-0fc7-4b1b-b90b-07a55f5cf2d7 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:45.455094 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-6b6d4ffd-0fc7-4b1b-b90b-07a55f5cf2d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:45.466081 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:29:45.474235 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d4ffd-0fc7-4b1b-b90b-07a55f5cf2d7 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:45.616170 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579f6794-215d-42da-afbb-addeba656595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:45.617073 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f6794-215d-42da-afbb-addeba656595 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:45.617352 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f6794-215d-42da-afbb-addeba656595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:45.617626 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f6794-215d-42da-afbb-addeba656595 admin admin] PATH_INFO: `/v3/users/bbc6d7339539476d8304683e643cd985` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:45.619030 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579f6794-215d-42da-afbb-addeba656595 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbc6d7339539476d8304683e643cd985)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:45.621129 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579f6794-215d-42da-afbb-addeba656595 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:45.797048 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-579f6794-215d-42da-afbb-addeba656595 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbc6d7339539476d8304683e643cd985'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:29:45.798727 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-579f6794-215d-42da-afbb-addeba656595 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbc6d7339539476d8304683e643cd985'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:29:45.802791 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-579f6794-215d-42da-afbb-addeba656595 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbc6d7339539476d8304683e643cd985'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:29:45.858702 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-579f6794-215d-42da-afbb-addeba656595 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbc6d7339539476d8304683e643cd985'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:29:45.880392 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-579f6794-215d-42da-afbb-addeba656595 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbc6d7339539476d8304683e643cd985'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:29:45.931727 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 819/1662] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:29:45 2022] DELETE /identity/v3/users/bbc6d7339539476d8304683e643cd985 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:29:45.937909 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f808e171-352d-4ddf-a2ce-caf97952984e None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:45.938597 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f808e171-352d-4ddf-a2ce-caf97952984e None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:45.938881 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f808e171-352d-4ddf-a2ce-caf97952984e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:45.970977 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-f808e171-352d-4ddf-a2ce-caf97952984e None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:29:45.972357 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-f808e171-352d-4ddf-a2ce-caf97952984e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:46.086992 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 844/1663] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:29:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:29:46.232463 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579f6794-215d-42da-afbb-addeba656595 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:46.234160 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-579f6794-215d-42da-afbb-addeba656595 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:46.354943 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579f6794-215d-42da-afbb-addeba656595 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:46.364851 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9731c2-63bb-464d-a91d-d1ec17703c1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:46.366852 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9731c2-63bb-464d-a91d-d1ec17703c1e service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:46.367162 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9731c2-63bb-464d-a91d-d1ec17703c1e service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:46.369280 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9731c2-63bb-464d-a91d-d1ec17703c1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:46.401766 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9731c2-63bb-464d-a91d-d1ec17703c1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:46.403275 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9731c2-63bb-464d-a91d-d1ec17703c1e service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:46.430275 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 820/1664] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:29:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:29:46.622151 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f808e171-352d-4ddf-a2ce-caf97952984e None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:46.624149 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-f808e171-352d-4ddf-a2ce-caf97952984e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:46.650594 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f808e171-352d-4ddf-a2ce-caf97952984e None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:46.669062 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a259f63-4a82-44fb-9f1a-9d7993c28ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:46.670104 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a259f63-4a82-44fb-9f1a-9d7993c28ef6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:46.674534 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a259f63-4a82-44fb-9f1a-9d7993c28ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:46.674844 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a259f63-4a82-44fb-9f1a-9d7993c28ef6 admin admin] PATH_INFO: `/v3/projects/06b087a8c8f24299ae7df2b21034931e` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:46.678464 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a259f63-4a82-44fb-9f1a-9d7993c28ef6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06b087a8c8f24299ae7df2b21034931e)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:46.685198 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a259f63-4a82-44fb-9f1a-9d7993c28ef6 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:46.792542 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-8a259f63-4a82-44fb-9f1a-9d7993c28ef6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06b087a8c8f24299ae7df2b21034931e', 'request_id': 'req-8a259f63-4a82-44fb-9f1a-9d7993c28ef6'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:29:46.807829 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-8a259f63-4a82-44fb-9f1a-9d7993c28ef6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06b087a8c8f24299ae7df2b21034931e', 'request_id': 'req-8a259f63-4a82-44fb-9f1a-9d7993c28ef6'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:29:46.820942 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-8a259f63-4a82-44fb-9f1a-9d7993c28ef6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06b087a8c8f24299ae7df2b21034931e', 'request_id': 'req-8a259f63-4a82-44fb-9f1a-9d7993c28ef6'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:29:46.847041 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-8a259f63-4a82-44fb-9f1a-9d7993c28ef6 admin admin] The token cache is being invalidate because project 06b087a8c8f24299ae7df2b21034931e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:29:46.847371 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-8a259f63-4a82-44fb-9f1a-9d7993c28ef6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:29:46.848059 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-8a259f63-4a82-44fb-9f1a-9d7993c28ef6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:29:46.852398 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 845/1665] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:29:46 2022] DELETE /identity/v3/projects/06b087a8c8f24299ae7df2b21034931e => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:29:46.858805 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ba1db-ab81-463c-9962-731ae7573808 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:46.859414 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ba1db-ab81-463c-9962-731ae7573808 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:46.859414 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ba1db-ab81-463c-9962-731ae7573808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:46.893344 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-2d3ba1db-ab81-463c-9962-731ae7573808 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:29:46.894912 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2d3ba1db-ab81-463c-9962-731ae7573808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:46.954132 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:29:47.078638 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a259f63-4a82-44fb-9f1a-9d7993c28ef6 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:47.080317 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-8a259f63-4a82-44fb-9f1a-9d7993c28ef6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:47.126477 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 821/1666] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:29:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:29:47.128578 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f117408-786f-49ba-b712-994613f10878 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:47.128703 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f117408-786f-49ba-b712-994613f10878 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:47.129057 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f117408-786f-49ba-b712-994613f10878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:47.194220 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-6f117408-786f-49ba-b712-994613f10878 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:29:47.200349 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-6f117408-786f-49ba-b712-994613f10878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:47.238102 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 822/1667] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:29:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:29:47.239227 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f117408-786f-49ba-b712-994613f10878 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:47.245786 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:29:47.258996 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f117408-786f-49ba-b712-994613f10878 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:47.270834 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922357f3-3a2b-4000-ac23-273ec2c29710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:47.271605 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922357f3-3a2b-4000-ac23-273ec2c29710 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:47.271915 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922357f3-3a2b-4000-ac23-273ec2c29710 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:47.272196 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922357f3-3a2b-4000-ac23-273ec2c29710 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:47.272999 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922357f3-3a2b-4000-ac23-273ec2c29710 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:29:47.273308 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922357f3-3a2b-4000-ac23-273ec2c29710 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:47.274966 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922357f3-3a2b-4000-ac23-273ec2c29710 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:47.277422 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a259f63-4a82-44fb-9f1a-9d7993c28ef6 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:47.294630 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb3a531-ef8f-45f7-898d-e92d54c68529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:47.295563 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3a531-ef8f-45f7-898d-e92d54c68529 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:47.295836 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3a531-ef8f-45f7-898d-e92d54c68529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:47.296105 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3a531-ef8f-45f7-898d-e92d54c68529 admin admin] PATH_INFO: `/v3/projects/3504ab706b9640a2907632a72189404e` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:47.297390 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb3a531-ef8f-45f7-898d-e92d54c68529 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3504ab706b9640a2907632a72189404e)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:47.299649 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb3a531-ef8f-45f7-898d-e92d54c68529 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:47.318816 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 823/1668] 10.222.0.60 () {58 vars in 1152 bytes} [Sat Jul 2 03:29:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:29:47.320259 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922357f3-3a2b-4000-ac23-273ec2c29710 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:47.338517 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922357f3-3a2b-4000-ac23-273ec2c29710 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:47.355735 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814e54e1-9940-464e-a945-e3bf5475c9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:47.359224 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e54e1-9940-464e-a945-e3bf5475c9d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:47.359924 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e54e1-9940-464e-a945-e3bf5475c9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:47.361796 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e54e1-9940-464e-a945-e3bf5475c9d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:47.362801 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814e54e1-9940-464e-a945-e3bf5475c9d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:47.367422 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814e54e1-9940-464e-a945-e3bf5475c9d0 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:47.423763 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-9cb3a531-ef8f-45f7-898d-e92d54c68529 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3504ab706b9640a2907632a72189404e', 'request_id': 'req-9cb3a531-ef8f-45f7-898d-e92d54c68529'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:29:47.443554 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 824/1669] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:29:47 2022] POST /identity/v3/projects => generated 367 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:29:47.444873 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814e54e1-9940-464e-a945-e3bf5475c9d0 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:47.448712 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-9cb3a531-ef8f-45f7-898d-e92d54c68529 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3504ab706b9640a2907632a72189404e', 'request_id': 'req-9cb3a531-ef8f-45f7-898d-e92d54c68529'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:29:47.464009 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-9cb3a531-ef8f-45f7-898d-e92d54c68529 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3504ab706b9640a2907632a72189404e', 'request_id': 'req-9cb3a531-ef8f-45f7-898d-e92d54c68529'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:29:47.489603 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-9cb3a531-ef8f-45f7-898d-e92d54c68529 admin admin] The token cache is being invalidate because project 3504ab706b9640a2907632a72189404e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:29:47.491473 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-9cb3a531-ef8f-45f7-898d-e92d54c68529 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:29:47.492425 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-9cb3a531-ef8f-45f7-898d-e92d54c68529 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:29:47.499918 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 846/1670] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:29:47 2022] DELETE /identity/v3/projects/3504ab706b9640a2907632a72189404e => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:29:47.501615 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1b6c3-32b9-4acb-bec8-657d78e1fa22 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:47.502062 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1b6c3-32b9-4acb-bec8-657d78e1fa22 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:47.502478 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1b6c3-32b9-4acb-bec8-657d78e1fa22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:47.533285 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-f6b1b6c3-32b9-4acb-bec8-657d78e1fa22 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:29:47.536666 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-f6b1b6c3-32b9-4acb-bec8-657d78e1fa22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:47.583975 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814e54e1-9940-464e-a945-e3bf5475c9d0 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:47.603944 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f365079-2f0c-44ff-b723-d83a90a5bf80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:47.604652 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f365079-2f0c-44ff-b723-d83a90a5bf80 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:47.605126 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f365079-2f0c-44ff-b723-d83a90a5bf80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:47.605408 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f365079-2f0c-44ff-b723-d83a90a5bf80 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:47.606712 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f365079-2f0c-44ff-b723-d83a90a5bf80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:47.608722 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f365079-2f0c-44ff-b723-d83a90a5bf80 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:47.667221 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 847/1671] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:29:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:29:47.667546 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 825/1672] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:29:47 2022] POST /identity/v3/users => generated 284 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:29:47.680036 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1b6c3-32b9-4acb-bec8-657d78e1fa22 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:47.680193 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86004f8a-2ab3-4a9f-8c79-25696d1e6c2c None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:47.680494 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86004f8a-2ab3-4a9f-8c79-25696d1e6c2c None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:47.680780 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86004f8a-2ab3-4a9f-8c79-25696d1e6c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:47.682305 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-f6b1b6c3-32b9-4acb-bec8-657d78e1fa22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:47.712950 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1b6c3-32b9-4acb-bec8-657d78e1fa22 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:47.715742 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-86004f8a-2ab3-4a9f-8c79-25696d1e6c2c None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:29:47.716839 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-86004f8a-2ab3-4a9f-8c79-25696d1e6c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:47.725778 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d1e68b-3b28-4aa1-ad07-71b36d3cedbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:47.727257 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d1e68b-3b28-4aa1-ad07-71b36d3cedbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:47.727623 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d1e68b-3b28-4aa1-ad07-71b36d3cedbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:47.727899 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d1e68b-3b28-4aa1-ad07-71b36d3cedbd admin admin] PATH_INFO: `/v3/projects/c2670137d6274cb9932e17558514214c` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:47.730418 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d1e68b-3b28-4aa1-ad07-71b36d3cedbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2670137d6274cb9932e17558514214c)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:47.733193 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d1e68b-3b28-4aa1-ad07-71b36d3cedbd admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:47.738537 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 826/1673] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:29:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:29:47.739594 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86004f8a-2ab3-4a9f-8c79-25696d1e6c2c None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:47.741169 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-86004f8a-2ab3-4a9f-8c79-25696d1e6c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:47.782440 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86004f8a-2ab3-4a9f-8c79-25696d1e6c2c None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:47.801431 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8bc029-e9ce-46f5-ad9f-318fb42e2a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:47.802127 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8bc029-e9ce-46f5-ad9f-318fb42e2a52 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:47.802410 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8bc029-e9ce-46f5-ad9f-318fb42e2a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:47.802683 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8bc029-e9ce-46f5-ad9f-318fb42e2a52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:47.803544 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8bc029-e9ce-46f5-ad9f-318fb42e2a52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:47.805195 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8bc029-e9ce-46f5-ad9f-318fb42e2a52 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:47.827148 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 827/1674] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:29:47 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:29:47.828053 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8bc029-e9ce-46f5-ad9f-318fb42e2a52 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:47.849159 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-a9d1e68b-3b28-4aa1-ad07-71b36d3cedbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2670137d6274cb9932e17558514214c', 'request_id': 'req-a9d1e68b-3b28-4aa1-ad07-71b36d3cedbd'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:29:47.851381 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8bc029-e9ce-46f5-ad9f-318fb42e2a52 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:47.863351 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-a9d1e68b-3b28-4aa1-ad07-71b36d3cedbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2670137d6274cb9932e17558514214c', 'request_id': 'req-a9d1e68b-3b28-4aa1-ad07-71b36d3cedbd'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:29:47.882325 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-a9d1e68b-3b28-4aa1-ad07-71b36d3cedbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2670137d6274cb9932e17558514214c', 'request_id': 'req-a9d1e68b-3b28-4aa1-ad07-71b36d3cedbd'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:29:47.912220 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-a9d1e68b-3b28-4aa1-ad07-71b36d3cedbd admin admin] The token cache is being invalidate because project c2670137d6274cb9932e17558514214c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:29:47.912715 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-a9d1e68b-3b28-4aa1-ad07-71b36d3cedbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:29:47.914969 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-a9d1e68b-3b28-4aa1-ad07-71b36d3cedbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:29:47.919774 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 848/1675] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:29:47 2022] DELETE /identity/v3/projects/c2670137d6274cb9932e17558514214c => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:29:47.920906 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d1e68b-3b28-4aa1-ad07-71b36d3cedbd admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:47.933169 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-a9d1e68b-3b28-4aa1-ad07-71b36d3cedbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:47.941269 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:29:47.949128 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d29516-2f24-4a79-8de5-a4feec4664e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:47.949900 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:29:47.952591 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d29516-2f24-4a79-8de5-a4feec4664e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:47.953151 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d29516-2f24-4a79-8de5-a4feec4664e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:47.953499 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d29516-2f24-4a79-8de5-a4feec4664e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:47.954348 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d29516-2f24-4a79-8de5-a4feec4664e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:29:47.954725 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d29516-2f24-4a79-8de5-a4feec4664e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:47.956503 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d29516-2f24-4a79-8de5-a4feec4664e8 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:47.982386 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 828/1676] 10.222.0.60 () {58 vars in 1152 bytes} [Sat Jul 2 03:29:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:29:47.983847 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e93f4-c5ef-4ea8-9753-16cb39e3488f None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:47.986652 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e93f4-c5ef-4ea8-9753-16cb39e3488f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:47.987163 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e93f4-c5ef-4ea8-9753-16cb39e3488f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:48.031039 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-b54e93f4-c5ef-4ea8-9753-16cb39e3488f None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:29:48.032767 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b54e93f4-c5ef-4ea8-9753-16cb39e3488f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:48.047143 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d1e68b-3b28-4aa1-ad07-71b36d3cedbd admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:48.050691 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 829/1677] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:29:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:29:48.051951 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54e93f4-c5ef-4ea8-9753-16cb39e3488f None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:48.053850 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b54e93f4-c5ef-4ea8-9753-16cb39e3488f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:48.059961 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46854511-35ce-43ff-848e-6b6c678c8ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:48.060656 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46854511-35ce-43ff-848e-6b6c678c8ee3 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:48.061403 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46854511-35ce-43ff-848e-6b6c678c8ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:48.061403 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46854511-35ce-43ff-848e-6b6c678c8ee3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:48.061934 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46854511-35ce-43ff-848e-6b6c678c8ee3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:48.064244 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46854511-35ce-43ff-848e-6b6c678c8ee3 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:48.069099 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54e93f4-c5ef-4ea8-9753-16cb39e3488f None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:48.074356 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a561a-93be-4f00-9039-be4fc9ea1871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:48.075157 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a561a-93be-4f00-9039-be4fc9ea1871 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:48.075547 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a561a-93be-4f00-9039-be4fc9ea1871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:48.078878 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 849/1678] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:29:47 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:29:48.079533 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a561a-93be-4f00-9039-be4fc9ea1871 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:48.079533 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744a561a-93be-4f00-9039-be4fc9ea1871 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:48.079692 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986cfa28-9e11-4550-810a-83b3ec144ece None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:48.079692 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986cfa28-9e11-4550-810a-83b3ec144ece None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:48.079692 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986cfa28-9e11-4550-810a-83b3ec144ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:48.079889 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744a561a-93be-4f00-9039-be4fc9ea1871 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:48.110535 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-986cfa28-9e11-4550-810a-83b3ec144ece None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:29:48.113574 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-986cfa28-9e11-4550-810a-83b3ec144ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:48.116908 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 830/1679] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:29:48 2022] POST /identity/v3/projects => generated 379 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:29:48.121212 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a561a-93be-4f00-9039-be4fc9ea1871 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:48.222513 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a561a-93be-4f00-9039-be4fc9ea1871 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:48.228582 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4cb743-4106-4fd2-9ad4-466100d76d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:48.229493 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4cb743-4106-4fd2-9ad4-466100d76d9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:48.229773 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4cb743-4106-4fd2-9ad4-466100d76d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:48.230056 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4cb743-4106-4fd2-9ad4-466100d76d9c admin admin] PATH_INFO: `/v3/projects/73389b1df990428cb9ee438e4883341c/users/a65a291b3a854e3e99d894f5d9407201/roles/c43aada0326446c4ade0ab1262918fa4` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:48.261315 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4cb743-4106-4fd2-9ad4-466100d76d9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=73389b1df990428cb9ee438e4883341c, user_id=a65a291b3a854e3e99d894f5d9407201, role_id=c43aada0326446c4ade0ab1262918fa4)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:48.266546 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4cb743-4106-4fd2-9ad4-466100d76d9c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:48.306184 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 831/1680] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:29:48 2022] PUT /identity/v3/projects/73389b1df990428cb9ee438e4883341c/users/a65a291b3a854e3e99d894f5d9407201/roles/c43aada0326446c4ade0ab1262918fa4 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:29:48.306908 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 850/1681] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:29:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:29:48.308284 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e0e2a-8f02-4aa9-974b-07ee15ec2000 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:48.308573 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e0e2a-8f02-4aa9-974b-07ee15ec2000 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:48.308851 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e0e2a-8f02-4aa9-974b-07ee15ec2000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:48.310630 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4cb743-4106-4fd2-9ad4-466100d76d9c admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:48.407635 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-a93e0e2a-8f02-4aa9-974b-07ee15ec2000 None None] MFA Rules not processed for user `a65a291b3a854e3e99d894f5d9407201`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:29:48.408784 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-a93e0e2a-8f02-4aa9-974b-07ee15ec2000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:48.458385 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4cb743-4106-4fd2-9ad4-466100d76d9c admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:48.471699 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e93ad-716e-4949-b660-55be1a933e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:48.472698 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e93ad-716e-4949-b660-55be1a933e43 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:48.472984 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e93ad-716e-4949-b660-55be1a933e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:48.473258 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e93ad-716e-4949-b660-55be1a933e43 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:48.473965 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1e93ad-716e-4949-b660-55be1a933e43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:48.476247 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1e93ad-716e-4949-b660-55be1a933e43 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:48.536831 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 832/1682] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:29:48 2022] POST /identity/v3/users => generated 290 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:29:48.539015 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e93ad-716e-4949-b660-55be1a933e43 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:48.554448 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e93ad-716e-4949-b660-55be1a933e43 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:48.569820 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411ae917-ad2a-4c0d-9ca3-69f39ae7bafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:48.574178 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ae917-ad2a-4c0d-9ca3-69f39ae7bafa admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:48.574883 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ae917-ad2a-4c0d-9ca3-69f39ae7bafa admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:48.575505 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ae917-ad2a-4c0d-9ca3-69f39ae7bafa admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:48.576826 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411ae917-ad2a-4c0d-9ca3-69f39ae7bafa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:29:48.577304 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411ae917-ad2a-4c0d-9ca3-69f39ae7bafa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:48.580034 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411ae917-ad2a-4c0d-9ca3-69f39ae7bafa admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:48.598545 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 833/1683] 10.222.0.60 () {58 vars in 1152 bytes} [Sat Jul 2 03:29:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:29:48.605089 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411ae917-ad2a-4c0d-9ca3-69f39ae7bafa admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:48.623096 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 851/1684] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:29:48 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:29:48.626645 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93e0e2a-8f02-4aa9-974b-07ee15ec2000 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:48.646710 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411ae917-ad2a-4c0d-9ca3-69f39ae7bafa admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:48.652941 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e330f1-73cd-4285-97e7-1c23b13ce346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:48.653652 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e330f1-73cd-4285-97e7-1c23b13ce346 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:48.653937 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e330f1-73cd-4285-97e7-1c23b13ce346 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:48.654203 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e330f1-73cd-4285-97e7-1c23b13ce346 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:48.672368 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93e0e2a-8f02-4aa9-974b-07ee15ec2000 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:48.683022 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e330f1-73cd-4285-97e7-1c23b13ce346 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:48.683841 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131e7b5c-efee-433a-b59f-c765680dde8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:48.684469 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e7b5c-efee-433a-b59f-c765680dde8a admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:48.684747 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e7b5c-efee-433a-b59f-c765680dde8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:48.684960 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e330f1-73cd-4285-97e7-1c23b13ce346 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:48.685081 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e7b5c-efee-433a-b59f-c765680dde8a admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:48.685782 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131e7b5c-efee-433a-b59f-c765680dde8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:48.687629 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131e7b5c-efee-433a-b59f-c765680dde8a admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:48.706248 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 834/1685] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:29:48 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:29:48.707505 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e330f1-73cd-4285-97e7-1c23b13ce346 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:48.709609 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b7e330f1-73cd-4285-97e7-1c23b13ce346 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:48.744660 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:29:48.784853 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 852/1686] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:29:48 2022] POST /identity/v3/projects => generated 367 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:29:48.784853 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131e7b5c-efee-433a-b59f-c765680dde8a admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:48.832383 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:29:48.916397 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e330f1-73cd-4285-97e7-1c23b13ce346 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:48.988781 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131e7b5c-efee-433a-b59f-c765680dde8a admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:49.003988 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fda626-ccaf-4ebd-91ad-21a81f3b25fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:49.005290 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fda626-ccaf-4ebd-91ad-21a81f3b25fb admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:49.005617 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fda626-ccaf-4ebd-91ad-21a81f3b25fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:49.009347 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fda626-ccaf-4ebd-91ad-21a81f3b25fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:49.011622 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fda626-ccaf-4ebd-91ad-21a81f3b25fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:49.015622 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fda626-ccaf-4ebd-91ad-21a81f3b25fb admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:49.050259 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 853/1687] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:29:48 2022] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:29:49.055377 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3140d9a-7b52-4431-a36b-19726316f8d7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6470ccbf858f47bf9bb884476bf4235e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:49.056045 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3140d9a-7b52-4431-a36b-19726316f8d7 service glance] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:49.056319 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3140d9a-7b52-4431-a36b-19726316f8d7 service glance] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:49.056594 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3140d9a-7b52-4431-a36b-19726316f8d7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:49.059596 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fda626-ccaf-4ebd-91ad-21a81f3b25fb admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:49.088017 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fda626-ccaf-4ebd-91ad-21a81f3b25fb admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:49.113495 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a339cda-aef3-414a-9145-337f7699a0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:49.113495 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a339cda-aef3-414a-9145-337f7699a0e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:49.113495 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a339cda-aef3-414a-9145-337f7699a0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:49.117817 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a339cda-aef3-414a-9145-337f7699a0e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:49.118660 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a339cda-aef3-414a-9145-337f7699a0e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:49.123458 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a339cda-aef3-414a-9145-337f7699a0e5 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:49.185895 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 854/1688] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:29:49 2022] POST /identity/v3/users => generated 284 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:29:49.187711 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674a1a0-8d37-49c9-9f08-9d34bb66f131 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:49.187996 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674a1a0-8d37-49c9-9f08-9d34bb66f131 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:49.188276 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674a1a0-8d37-49c9-9f08-9d34bb66f131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:49.231292 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3140d9a-7b52-4431-a36b-19726316f8d7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:49.235472 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3140d9a-7b52-4431-a36b-19726316f8d7 service glance] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:49.268584 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 835/1689] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:29:48 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:29:49.270802 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f76ef3-257c-40d8-aecd-e9536d5da4aa None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:49.270923 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-3674a1a0-8d37-49c9-9f08-9d34bb66f131 None None] MFA Rules not processed for user `5caffa5bd8804abd96e411fb45383c5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:29:49.271094 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f76ef3-257c-40d8-aecd-e9536d5da4aa None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:49.271408 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f76ef3-257c-40d8-aecd-e9536d5da4aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:49.276780 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-3674a1a0-8d37-49c9-9f08-9d34bb66f131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:49.375584 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-21f76ef3-257c-40d8-aecd-e9536d5da4aa None None] MFA Rules not processed for user `d2581f217a574b13b0fe042d38a94740`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:29:49.387146 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-21f76ef3-257c-40d8-aecd-e9536d5da4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:49.437392 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 855/1690] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:29:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:29:49.439144 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3674a1a0-8d37-49c9-9f08-9d34bb66f131 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:49.440682 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-3674a1a0-8d37-49c9-9f08-9d34bb66f131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:49.461899 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3674a1a0-8d37-49c9-9f08-9d34bb66f131 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:49.478803 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524c3cf7-98e0-46a5-b8fe-a1be52362a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:49.480195 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c3cf7-98e0-46a5-b8fe-a1be52362a2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:49.480695 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c3cf7-98e0-46a5-b8fe-a1be52362a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:49.481125 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c3cf7-98e0-46a5-b8fe-a1be52362a2e admin admin] PATH_INFO: `/v3/projects/26afb3ba136a454e83a3885a4a09e185` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:49.483154 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524c3cf7-98e0-46a5-b8fe-a1be52362a2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=26afb3ba136a454e83a3885a4a09e185)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:49.485753 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524c3cf7-98e0-46a5-b8fe-a1be52362a2e admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:49.594244 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 836/1691] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:29:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:29:49.596414 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f76ef3-257c-40d8-aecd-e9536d5da4aa None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:49.626461 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f76ef3-257c-40d8-aecd-e9536d5da4aa None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:49.641696 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7d325e-8413-4d0d-b583-bf82bdc2b4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:49.643820 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d325e-8413-4d0d-b583-bf82bdc2b4fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:49.645302 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d325e-8413-4d0d-b583-bf82bdc2b4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:49.645699 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d325e-8413-4d0d-b583-bf82bdc2b4fa admin admin] PATH_INFO: `/v3/projects/96a954a9715049719627ea06b84ccff3/users/b8b4090be5cb41a4a75d5a4e25659edc/roles/c43aada0326446c4ade0ab1262918fa4` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:49.664905 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-524c3cf7-98e0-46a5-b8fe-a1be52362a2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26afb3ba136a454e83a3885a4a09e185', 'request_id': 'req-524c3cf7-98e0-46a5-b8fe-a1be52362a2e'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:29:49.675287 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-524c3cf7-98e0-46a5-b8fe-a1be52362a2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26afb3ba136a454e83a3885a4a09e185', 'request_id': 'req-524c3cf7-98e0-46a5-b8fe-a1be52362a2e'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:29:49.675725 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:29:49.683896 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-524c3cf7-98e0-46a5-b8fe-a1be52362a2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26afb3ba136a454e83a3885a4a09e185', 'request_id': 'req-524c3cf7-98e0-46a5-b8fe-a1be52362a2e'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:29:49.701696 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-524c3cf7-98e0-46a5-b8fe-a1be52362a2e admin admin] The token cache is being invalidate because project 26afb3ba136a454e83a3885a4a09e185 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:29:49.701985 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-524c3cf7-98e0-46a5-b8fe-a1be52362a2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:29:49.702919 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-524c3cf7-98e0-46a5-b8fe-a1be52362a2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:29:49.703037 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7d325e-8413-4d0d-b583-bf82bdc2b4fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=96a954a9715049719627ea06b84ccff3, user_id=b8b4090be5cb41a4a75d5a4e25659edc, role_id=c43aada0326446c4ade0ab1262918fa4)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:49.708545 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 856/1692] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:29:49 2022] DELETE /identity/v3/projects/26afb3ba136a454e83a3885a4a09e185 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:29:49.709966 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524c3cf7-98e0-46a5-b8fe-a1be52362a2e admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:49.711499 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-524c3cf7-98e0-46a5-b8fe-a1be52362a2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:49.712863 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7d325e-8413-4d0d-b583-bf82bdc2b4fa admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:49.717921 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:29:49.787475 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 837/1693] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:29:49 2022] PUT /identity/v3/projects/96a954a9715049719627ea06b84ccff3/users/b8b4090be5cb41a4a75d5a4e25659edc/roles/c43aada0326446c4ade0ab1262918fa4 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:29:49.790436 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7d325e-8413-4d0d-b583-bf82bdc2b4fa admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:49.800727 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-fb7d325e-8413-4d0d-b583-bf82bdc2b4fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:49.834100 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524c3cf7-98e0-46a5-b8fe-a1be52362a2e admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:49.972998 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30999516-820f-46ff-93d5-af506c79e0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:49.973953 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30999516-820f-46ff-93d5-af506c79e0af admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:49.974889 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30999516-820f-46ff-93d5-af506c79e0af admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:49.976082 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30999516-820f-46ff-93d5-af506c79e0af admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:49.978712 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30999516-820f-46ff-93d5-af506c79e0af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:49.983374 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30999516-820f-46ff-93d5-af506c79e0af admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:50.025037 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 857/1694] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:29:49 2022] GET /identity/v3/roles => generated 1420 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:29:50.031687 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e3a01-bc11-4fd2-8256-9939e2d9568e None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:50.033578 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e3a01-bc11-4fd2-8256-9939e2d9568e None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:50.033862 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e3a01-bc11-4fd2-8256-9939e2d9568e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:50.091402 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7d325e-8413-4d0d-b583-bf82bdc2b4fa admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:50.097928 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-152e3a01-bc11-4fd2-8256-9939e2d9568e None None] MFA Rules not processed for user `d2581f217a574b13b0fe042d38a94740`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:29:50.099446 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-152e3a01-bc11-4fd2-8256-9939e2d9568e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:50.112575 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6094f27-01b3-4614-ba59-21f28806c0f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13530240e2d446b6bf26a431d001362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:50.113418 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6094f27-01b3-4614-ba59-21f28806c0f8 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:50.114768 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6094f27-01b3-4614-ba59-21f28806c0f8 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:50.115175 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6094f27-01b3-4614-ba59-21f28806c0f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:50.132849 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d6094f27-01b3-4614-ba59-21f28806c0f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:50.256030 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 858/1695] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:29:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:29:50.260639 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc022f5b-73ac-419a-b343-d8a2f9e75ec6 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:50.261190 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc022f5b-73ac-419a-b343-d8a2f9e75ec6 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:50.261608 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc022f5b-73ac-419a-b343-d8a2f9e75ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:50.303010 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-dc022f5b-73ac-419a-b343-d8a2f9e75ec6 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:29:50.304291 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-dc022f5b-73ac-419a-b343-d8a2f9e75ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:50.329313 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6094f27-01b3-4614-ba59-21f28806c0f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:50.332104 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6094f27-01b3-4614-ba59-21f28806c0f8 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:50.332715 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 859/1696] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:29:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:29:50.338296 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7229d-fbe2-4715-ba2f-d2ce67a35cc6 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:50.338636 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7229d-fbe2-4715-ba2f-d2ce67a35cc6 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:50.339828 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7229d-fbe2-4715-ba2f-d2ce67a35cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:50.362113 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 838/1697] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:29:49 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:29:50.365343 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6094f27-01b3-4614-ba59-21f28806c0f8 service nova] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:50.406985 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6094f27-01b3-4614-ba59-21f28806c0f8 service nova] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:50.419843 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdb0510-e6e1-4407-b9c9-e25a7a6c086d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:50.420674 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb0510-e6e1-4407-b9c9-e25a7a6c086d admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:50.421067 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb0510-e6e1-4407-b9c9-e25a7a6c086d admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:50.421451 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb0510-e6e1-4407-b9c9-e25a7a6c086d admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:50.422985 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdb0510-e6e1-4407-b9c9-e25a7a6c086d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:50.437718 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdb0510-e6e1-4407-b9c9-e25a7a6c086d admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:50.446213 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-2fb7229d-fbe2-4715-ba2f-d2ce67a35cc6 None None] MFA Rules not processed for user `b8b4090be5cb41a4a75d5a4e25659edc`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:29:50.450507 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-2fb7229d-fbe2-4715-ba2f-d2ce67a35cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:50.468405 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 839/1698] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:29:50 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:29:50.469572 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdb0510-e6e1-4407-b9c9-e25a7a6c086d admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:50.477004 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-bbdb0510-e6e1-4407-b9c9-e25a7a6c086d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:50.535191 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdb0510-e6e1-4407-b9c9-e25a7a6c086d admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:50.554210 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d2608-85b1-4d79-b71e-92ea3ea4cddf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13530240e2d446b6bf26a431d001362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:50.554210 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d2608-85b1-4d79-b71e-92ea3ea4cddf service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:50.554210 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d2608-85b1-4d79-b71e-92ea3ea4cddf service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:50.555291 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d2608-85b1-4d79-b71e-92ea3ea4cddf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:50.560952 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-167d2608-85b1-4d79-b71e-92ea3ea4cddf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:50.590970 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167d2608-85b1-4d79-b71e-92ea3ea4cddf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:50.593129 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167d2608-85b1-4d79-b71e-92ea3ea4cddf service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:50.597333 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:29:50.641398 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 840/1699] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:29:50 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:29:50.646635 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d3700-823d-424e-8038-1250a5174391 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:50.646635 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d3700-823d-424e-8038-1250a5174391 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:50.647461 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d3700-823d-424e-8038-1250a5174391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:50.728768 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-0a3d3700-823d-424e-8038-1250a5174391 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:29:50.730021 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0a3d3700-823d-424e-8038-1250a5174391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:50.781111 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 841/1700] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:29:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:29:50.784217 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d3700-823d-424e-8038-1250a5174391 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:50.785338 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 860/1701] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:29:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 452 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:29:50.796330 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb7229d-fbe2-4715-ba2f-d2ce67a35cc6 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:50.829341 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb7229d-fbe2-4715-ba2f-d2ce67a35cc6 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:50.844937 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d3700-823d-424e-8038-1250a5174391 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:50.852774 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1155f401-7383-4859-bc19-fc5d7966d0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:50.853456 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155f401-7383-4859-bc19-fc5d7966d0ed admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:50.853736 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155f401-7383-4859-bc19-fc5d7966d0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:50.854010 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155f401-7383-4859-bc19-fc5d7966d0ed admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:50.854876 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1155f401-7383-4859-bc19-fc5d7966d0ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:29:50.855209 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1155f401-7383-4859-bc19-fc5d7966d0ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:50.856825 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1155f401-7383-4859-bc19-fc5d7966d0ed admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:50.893959 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b2f1bf-96d4-4bad-9944-c8b4ee932f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:50.894418 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b2f1bf-96d4-4bad-9944-c8b4ee932f70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:50.894746 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b2f1bf-96d4-4bad-9944-c8b4ee932f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:50.895042 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b2f1bf-96d4-4bad-9944-c8b4ee932f70 admin admin] PATH_INFO: `/v3/projects/13d7a18399114dfba7d0dfb4e1d51ab3/users/a732fa2ee0eb48bbab89a6d6b73cef14/roles/c43aada0326446c4ade0ab1262918fa4` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:50.922431 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 861/1702] 10.222.0.60 () {58 vars in 1152 bytes} [Sat Jul 2 03:29:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:29:50.930321 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1155f401-7383-4859-bc19-fc5d7966d0ed admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:50.958748 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-1155f401-7383-4859-bc19-fc5d7966d0ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:50.980836 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b2f1bf-96d4-4bad-9944-c8b4ee932f70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13d7a18399114dfba7d0dfb4e1d51ab3, user_id=a732fa2ee0eb48bbab89a6d6b73cef14, role_id=c43aada0326446c4ade0ab1262918fa4)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:50.983571 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b2f1bf-96d4-4bad-9944-c8b4ee932f70 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:51.009001 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1155f401-7383-4859-bc19-fc5d7966d0ed admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:51.022140 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3546d569-f3fb-4cfe-95fb-9a9434afc38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:51.025292 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 842/1703] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:29:50 2022] PUT /identity/v3/projects/13d7a18399114dfba7d0dfb4e1d51ab3/users/a732fa2ee0eb48bbab89a6d6b73cef14/roles/c43aada0326446c4ade0ab1262918fa4 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:29:51.026146 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b2f1bf-96d4-4bad-9944-c8b4ee932f70 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:51.026829 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3546d569-f3fb-4cfe-95fb-9a9434afc38b admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:51.027185 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3546d569-f3fb-4cfe-95fb-9a9434afc38b admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:51.027460 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3546d569-f3fb-4cfe-95fb-9a9434afc38b admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:51.028195 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3546d569-f3fb-4cfe-95fb-9a9434afc38b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:51.030181 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3546d569-f3fb-4cfe-95fb-9a9434afc38b admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:51.157565 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 862/1704] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:29:50 2022] POST /identity/v3/projects => generated 381 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:29:51.166819 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b59fd-90eb-4542-bbae-b8c12485f213 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:51.168041 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b59fd-90eb-4542-bbae-b8c12485f213 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:51.169780 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b59fd-90eb-4542-bbae-b8c12485f213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:51.177289 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:29:51.266466 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-010b59fd-90eb-4542-bbae-b8c12485f213 None None] MFA Rules not processed for user `a732fa2ee0eb48bbab89a6d6b73cef14`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:29:51.267732 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-010b59fd-90eb-4542-bbae-b8c12485f213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:51.284786 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b2f1bf-96d4-4bad-9944-c8b4ee932f70 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:51.462306 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3397ba02-b6ee-4ff1-a25e-97618f49eb84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:51.463399 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3397ba02-b6ee-4ff1-a25e-97618f49eb84 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:51.463931 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3397ba02-b6ee-4ff1-a25e-97618f49eb84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:51.464404 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3397ba02-b6ee-4ff1-a25e-97618f49eb84 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:51.465591 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3397ba02-b6ee-4ff1-a25e-97618f49eb84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:51.472236 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3397ba02-b6ee-4ff1-a25e-97618f49eb84 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:51.517696 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 863/1705] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:29:51 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:29:51.522055 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b59fd-90eb-4542-bbae-b8c12485f213 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:51.544792 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 843/1706] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:29:51 2022] POST /identity/v3/projects => generated 373 bytes in 519 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:29:51.550004 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3397ba02-b6ee-4ff1-a25e-97618f49eb84 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:51.557481 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b59fd-90eb-4542-bbae-b8c12485f213 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:51.558666 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3397ba02-b6ee-4ff1-a25e-97618f49eb84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:51.702334 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3397ba02-b6ee-4ff1-a25e-97618f49eb84 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:51.715393 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a97045-1eb7-4a0e-8ce3-749e437099cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:51.716066 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a97045-1eb7-4a0e-8ce3-749e437099cb service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:51.716346 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a97045-1eb7-4a0e-8ce3-749e437099cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:51.716633 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a97045-1eb7-4a0e-8ce3-749e437099cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:51.726228 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f137e718-dc4c-49c4-9943-859c026b8b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:51.727666 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137e718-dc4c-49c4-9943-859c026b8b29 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:51.728810 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137e718-dc4c-49c4-9943-859c026b8b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:51.731016 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137e718-dc4c-49c4-9943-859c026b8b29 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:51.731969 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f137e718-dc4c-49c4-9943-859c026b8b29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:51.734917 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f137e718-dc4c-49c4-9943-859c026b8b29 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:51.778700 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 864/1707] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:29:51 2022] POST /identity/v3/users => generated 297 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:29:51.780182 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f137e718-dc4c-49c4-9943-859c026b8b29 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:51.821543 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f137e718-dc4c-49c4-9943-859c026b8b29 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:51.831041 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c942daa-7dba-4c4a-aac0-c61340bb5a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:51.832131 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c942daa-7dba-4c4a-aac0-c61340bb5a46 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:51.832814 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c942daa-7dba-4c4a-aac0-c61340bb5a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:51.833369 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c942daa-7dba-4c4a-aac0-c61340bb5a46 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:51.838097 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c942daa-7dba-4c4a-aac0-c61340bb5a46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:51.840824 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c942daa-7dba-4c4a-aac0-c61340bb5a46 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:51.858971 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a97045-1eb7-4a0e-8ce3-749e437099cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:51.860600 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a97045-1eb7-4a0e-8ce3-749e437099cb service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:51.868186 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:29:51.888422 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 865/1708] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:29:51 2022] POST /identity/v3/users => generated 287 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:29:51.890865 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46687c11-8558-49ce-8478-7d29b0f68431 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:51.892686 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46687c11-8558-49ce-8478-7d29b0f68431 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:51.894282 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46687c11-8558-49ce-8478-7d29b0f68431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:51.897554 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 844/1709] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:29:51 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:29:51.900382 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c40a54-d2ea-4b8c-96cd-5a50c9363cfa None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:51.901331 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c40a54-d2ea-4b8c-96cd-5a50c9363cfa None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:51.905093 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c40a54-d2ea-4b8c-96cd-5a50c9363cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:51.951375 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-46687c11-8558-49ce-8478-7d29b0f68431 None None] MFA Rules not processed for user `11ccfa53ebb7405d9325a22f0295bf61`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:29:51.952926 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-46687c11-8558-49ce-8478-7d29b0f68431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:51.956439 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-59c40a54-d2ea-4b8c-96cd-5a50c9363cfa None None] MFA Rules not processed for user `3333e7495b9546d882e2a2211ff8875c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:29:51.961557 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-59c40a54-d2ea-4b8c-96cd-5a50c9363cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:51.985935 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:29:52.084086 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 866/1710] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:29:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:29:52.086037 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46687c11-8558-49ce-8478-7d29b0f68431 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:52.132392 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46687c11-8558-49ce-8478-7d29b0f68431 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:52.147864 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f390b474-2197-4bea-bd56-dbf0153cad70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:52.148640 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f390b474-2197-4bea-bd56-dbf0153cad70 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:52.149811 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f390b474-2197-4bea-bd56-dbf0153cad70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:52.149811 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f390b474-2197-4bea-bd56-dbf0153cad70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:52.153314 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f390b474-2197-4bea-bd56-dbf0153cad70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:52.156073 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f390b474-2197-4bea-bd56-dbf0153cad70 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:52.161464 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 845/1711] 10.222.0.60 () {58 vars in 1009 bytes} [Sat Jul 2 03:29:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:29:52.162624 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c40a54-d2ea-4b8c-96cd-5a50c9363cfa None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:52.195329 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c40a54-d2ea-4b8c-96cd-5a50c9363cfa None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:52.208731 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e6b8f4-d0f3-40cd-a515-40c0f7e4aa5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:52.210795 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6b8f4-d0f3-40cd-a515-40c0f7e4aa5c admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:52.211082 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6b8f4-d0f3-40cd-a515-40c0f7e4aa5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:52.211398 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6b8f4-d0f3-40cd-a515-40c0f7e4aa5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:52.218194 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e6b8f4-d0f3-40cd-a515-40c0f7e4aa5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:52.219663 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 867/1712] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:29:52.220703 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f390b474-2197-4bea-bd56-dbf0153cad70 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:52.225600 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e6b8f4-d0f3-40cd-a515-40c0f7e4aa5c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:52.255814 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 846/1713] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:29:52.259626 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e6b8f4-d0f3-40cd-a515-40c0f7e4aa5c admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:52.290565 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e6b8f4-d0f3-40cd-a515-40c0f7e4aa5c admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:52.306025 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a00147-d57b-4133-b1cd-7923f6f0fb10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:52.308529 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a00147-d57b-4133-b1cd-7923f6f0fb10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:52.309903 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a00147-d57b-4133-b1cd-7923f6f0fb10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:52.310899 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a00147-d57b-4133-b1cd-7923f6f0fb10 admin admin] PATH_INFO: `/v3/projects/84c442fe1ccd4763a5869164fb9b50a1/users/2c6b6bef596645b68a8241bb1ff8ad34/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:52.387867 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a00147-d57b-4133-b1cd-7923f6f0fb10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84c442fe1ccd4763a5869164fb9b50a1, user_id=2c6b6bef596645b68a8241bb1ff8ad34, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:52.407965 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a00147-d57b-4133-b1cd-7923f6f0fb10 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:52.434917 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f390b474-2197-4bea-bd56-dbf0153cad70 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:52.450714 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 847/1714] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:29:52 2022] PUT /identity/v3/projects/84c442fe1ccd4763a5869164fb9b50a1/users/2c6b6bef596645b68a8241bb1ff8ad34/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:29:52.452153 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a00147-d57b-4133-b1cd-7923f6f0fb10 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:52.637718 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a00147-d57b-4133-b1cd-7923f6f0fb10 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:52.651764 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5dd37e-c62b-4c2c-96c5-fe747b1892bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:52.654786 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5dd37e-c62b-4c2c-96c5-fe747b1892bf admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:52.655077 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5dd37e-c62b-4c2c-96c5-fe747b1892bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:52.655514 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5dd37e-c62b-4c2c-96c5-fe747b1892bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:52.656277 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5dd37e-c62b-4c2c-96c5-fe747b1892bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:52.661069 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5dd37e-c62b-4c2c-96c5-fe747b1892bf admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:52.689203 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 848/1715] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:29:52.693756 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d4c63-12a8-4506-b8fc-f03161c99557 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13530240e2d446b6bf26a431d001362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:52.694452 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d8ce5-d46e-4818-b62c-5c1bfb49c7c6 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:52.694452 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d8ce5-d46e-4818-b62c-5c1bfb49c7c6 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:52.694774 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d8ce5-d46e-4818-b62c-5c1bfb49c7c6 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:52.695673 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d4c63-12a8-4506-b8fc-f03161c99557 service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:52.696159 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d4c63-12a8-4506-b8fc-f03161c99557 service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:52.696588 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d4c63-12a8-4506-b8fc-f03161c99557 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:52.699362 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 849/1716] 10.222.0.60 () {54 vars in 912 bytes} [Sat Jul 2 03:29:52 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:29:52.701667 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159d8ce5-d46e-4818-b62c-5c1bfb49c7c6 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:52.730618 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:29:52.737453 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159d8ce5-d46e-4818-b62c-5c1bfb49c7c6 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:52.751840 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897f534a-2579-4819-a858-95cbd624f127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:52.752536 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f534a-2579-4819-a858-95cbd624f127 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:52.752801 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f534a-2579-4819-a858-95cbd624f127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:52.753099 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f534a-2579-4819-a858-95cbd624f127 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:52.753792 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897f534a-2579-4819-a858-95cbd624f127 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:52.764246 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897f534a-2579-4819-a858-95cbd624f127 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:52.815522 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 850/1717] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:29:52.817887 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897f534a-2579-4819-a858-95cbd624f127 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:52.821843 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-897f534a-2579-4819-a858-95cbd624f127 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:52.825100 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9d4c63-12a8-4506-b8fc-f03161c99557 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:52.829496 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9d4c63-12a8-4506-b8fc-f03161c99557 service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:52.878668 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 868/1718] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:29:52 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 658 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:29:52.879708 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d4c63-12a8-4506-b8fc-f03161c99557 service nova] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:52.920131 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d4c63-12a8-4506-b8fc-f03161c99557 service nova] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:52.940452 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e153f1-ff87-4e09-8263-3cc52a260707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:52.941372 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e153f1-ff87-4e09-8263-3cc52a260707 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:52.941655 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e153f1-ff87-4e09-8263-3cc52a260707 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:52.941929 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e153f1-ff87-4e09-8263-3cc52a260707 admin admin] PATH_INFO: `/v3/projects/ebb13fcda85e40f6a0d6dbe0e66ff6e1/users/52be19705db34470b7798d2c81481600/roles/c43aada0326446c4ade0ab1262918fa4` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:52.965601 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897f534a-2579-4819-a858-95cbd624f127 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:52.987630 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceda51b6-9ceb-47d0-910f-19384ff4251c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '692ec343bf9f4339ba691440f55a6c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:52.988414 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda51b6-9ceb-47d0-910f-19384ff4251c service swift] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:52.988970 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda51b6-9ceb-47d0-910f-19384ff4251c service swift] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:52.989336 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda51b6-9ceb-47d0-910f-19384ff4251c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:53.004586 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e153f1-ff87-4e09-8263-3cc52a260707 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebb13fcda85e40f6a0d6dbe0e66ff6e1, user_id=52be19705db34470b7798d2c81481600, role_id=c43aada0326446c4ade0ab1262918fa4)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:53.015305 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:29:53.018103 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e153f1-ff87-4e09-8263-3cc52a260707 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:53.063999 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 869/1719] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:29:52 2022] PUT /identity/v3/projects/ebb13fcda85e40f6a0d6dbe0e66ff6e1/users/52be19705db34470b7798d2c81481600/roles/c43aada0326446c4ade0ab1262918fa4 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:29:53.068220 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2fb91-a6c6-4a4a-84f4-1f57cb1e54a3 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:53.068559 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2fb91-a6c6-4a4a-84f4-1f57cb1e54a3 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:53.068834 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2fb91-a6c6-4a4a-84f4-1f57cb1e54a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:53.140193 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceda51b6-9ceb-47d0-910f-19384ff4251c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:53.141979 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceda51b6-9ceb-47d0-910f-19384ff4251c service swift] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:53.199830 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 851/1720] 10.222.0.60 () {60 vars in 1384 bytes} [Sat Jul 2 03:29:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 03:29:53.200868 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceda51b6-9ceb-47d0-910f-19384ff4251c service swift] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:53.262521 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceda51b6-9ceb-47d0-910f-19384ff4251c service swift] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:53.276828 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-62a2fb91-a6c6-4a4a-84f4-1f57cb1e54a3 None None] MFA Rules not processed for user `b0e8a3ba6f84477bb9b4780918f357c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:29:53.287446 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-62a2fb91-a6c6-4a4a-84f4-1f57cb1e54a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:53.550638 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acaa79a-ce9c-4d25-bdc0-f990893ae508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:53.553223 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 870/1721] 10.222.0.60 () {58 vars in 1009 bytes} [Sat Jul 2 03:29:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 487 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:29:53.553627 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acaa79a-ce9c-4d25-bdc0-f990893ae508 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:53.554838 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e9f672-a573-4773-a688-5f0437352a06 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:53.555187 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e9f672-a573-4773-a688-5f0437352a06 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:53.555421 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e9f672-a573-4773-a688-5f0437352a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:53.556780 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acaa79a-ce9c-4d25-bdc0-f990893ae508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:53.557683 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acaa79a-ce9c-4d25-bdc0-f990893ae508 admin admin] PATH_INFO: `/v3/projects/84c442fe1ccd4763a5869164fb9b50a1/users/2c6b6bef596645b68a8241bb1ff8ad34/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:53.561475 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acaa79a-ce9c-4d25-bdc0-f990893ae508 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84c442fe1ccd4763a5869164fb9b50a1, user_id=2c6b6bef596645b68a8241bb1ff8ad34, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:53.567935 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acaa79a-ce9c-4d25-bdc0-f990893ae508 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:53.629434 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 852/1722] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:29:53 2022] PUT /identity/v3/projects/84c442fe1ccd4763a5869164fb9b50a1/users/2c6b6bef596645b68a8241bb1ff8ad34/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:29:53.636311 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acaa79a-ce9c-4d25-bdc0-f990893ae508 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:53.650196 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1acaa79a-ce9c-4d25-bdc0-f990893ae508 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:53.729210 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-86e9f672-a573-4773-a688-5f0437352a06 None None] MFA Rules not processed for user `52be19705db34470b7798d2c81481600`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:29:53.737363 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-86e9f672-a573-4773-a688-5f0437352a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:53.930455 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 871/1723] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:29:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:29:53.930455 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0bfb6-b630-4cbc-b1a9-6e6a4665aae2 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:53.930455 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0bfb6-b630-4cbc-b1a9-6e6a4665aae2 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:53.930455 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0bfb6-b630-4cbc-b1a9-6e6a4665aae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:53.949584 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acaa79a-ce9c-4d25-bdc0-f990893ae508 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:53.964140 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c885bbb2-ccbb-47e2-bdec-3f7db9364aeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:53.964820 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c885bbb2-ccbb-47e2-bdec-3f7db9364aeb service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:53.965102 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c885bbb2-ccbb-47e2-bdec-3f7db9364aeb service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:53.965372 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c885bbb2-ccbb-47e2-bdec-3f7db9364aeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:53.985384 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c885bbb2-ccbb-47e2-bdec-3f7db9364aeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:53.988691 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c885bbb2-ccbb-47e2-bdec-3f7db9364aeb service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:54.025192 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 853/1724] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:29:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:29:54.026789 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c885bbb2-ccbb-47e2-bdec-3f7db9364aeb service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:54.032911 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-b3b0bfb6-b630-4cbc-b1a9-6e6a4665aae2 None None] MFA Rules not processed for user `2c6b6bef596645b68a8241bb1ff8ad34`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:29:54.034267 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-b3b0bfb6-b630-4cbc-b1a9-6e6a4665aae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:54.045548 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:29:54.214305 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:29:54.233594 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 872/1725] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:29:53 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:29:54.234951 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d99a5c-d625-4428-925a-5a7c2f02c9d9 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:54.236726 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d99a5c-d625-4428-925a-5a7c2f02c9d9 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:54.237106 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d99a5c-d625-4428-925a-5a7c2f02c9d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:54.271571 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c885bbb2-ccbb-47e2-bdec-3f7db9364aeb service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:54.279740 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caa8ebf-21ab-4008-8f43-98c060efdee9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13530240e2d446b6bf26a431d001362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:54.280629 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa8ebf-21ab-4008-8f43-98c060efdee9 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:54.281375 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa8ebf-21ab-4008-8f43-98c060efdee9 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:54.281659 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa8ebf-21ab-4008-8f43-98c060efdee9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:54.293040 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caa8ebf-21ab-4008-8f43-98c060efdee9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:54.296086 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caa8ebf-21ab-4008-8f43-98c060efdee9 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:54.340272 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-37d99a5c-d625-4428-925a-5a7c2f02c9d9 None None] MFA Rules not processed for user `ac2f872367a9463ab4c7c56cec0c79dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:29:54.341679 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-37d99a5c-d625-4428-925a-5a7c2f02c9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:54.352762 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 854/1726] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:29:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:29:54.353710 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caa8ebf-21ab-4008-8f43-98c060efdee9 service nova] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:54.457281 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caa8ebf-21ab-4008-8f43-98c060efdee9 service nova] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:54.466593 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ff9af-209a-479c-8fba-d18e7c26d933 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:54.468996 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ff9af-209a-479c-8fba-d18e7c26d933 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:54.473554 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ff9af-209a-479c-8fba-d18e7c26d933 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:54.473940 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ff9af-209a-479c-8fba-d18e7c26d933 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:54.527325 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802ff9af-209a-479c-8fba-d18e7c26d933 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:54.531949 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802ff9af-209a-479c-8fba-d18e7c26d933 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:54.582869 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 855/1727] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:29:54 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:29:54.609022 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 873/1728] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:29:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:29:54.610946 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da45105b-63eb-4354-b278-0d39685d49fd None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:54.612144 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da45105b-63eb-4354-b278-0d39685d49fd None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:54.612534 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da45105b-63eb-4354-b278-0d39685d49fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:54.667400 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-da45105b-63eb-4354-b278-0d39685d49fd None None] MFA Rules not processed for user `ac2f872367a9463ab4c7c56cec0c79dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:29:54.668721 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-da45105b-63eb-4354-b278-0d39685d49fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:54.677524 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 856/1729] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:29:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:29:54.747692 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d99a5c-d625-4428-925a-5a7c2f02c9d9 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:54.775924 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d99a5c-d625-4428-925a-5a7c2f02c9d9 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:54.799657 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c7f6d-aa33-47a9-b6b8-c60516d9c9e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13530240e2d446b6bf26a431d001362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:54.803866 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c7f6d-aa33-47a9-b6b8-c60516d9c9e9 service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:54.804210 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c7f6d-aa33-47a9-b6b8-c60516d9c9e9 service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:54.804497 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c7f6d-aa33-47a9-b6b8-c60516d9c9e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:54.838689 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3c7f6d-aa33-47a9-b6b8-c60516d9c9e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:54.844207 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3c7f6d-aa33-47a9-b6b8-c60516d9c9e9 service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:54.879181 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 874/1730] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:29:54 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:29:54.897062 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da45105b-63eb-4354-b278-0d39685d49fd None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:54.909365 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da45105b-63eb-4354-b278-0d39685d49fd None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:54.919904 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2276f8-91d3-4e08-b442-cf9434e9a06e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:54.920775 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2276f8-91d3-4e08-b442-cf9434e9a06e service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:54.921061 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2276f8-91d3-4e08-b442-cf9434e9a06e service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:54.921343 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2276f8-91d3-4e08-b442-cf9434e9a06e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:55.068966 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2276f8-91d3-4e08-b442-cf9434e9a06e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:55.071175 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2276f8-91d3-4e08-b442-cf9434e9a06e service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:55.094625 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 857/1731] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:29:54 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:29:55.536060 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea4c324-292a-4696-9b43-311d3943145e None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:55.536635 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea4c324-292a-4696-9b43-311d3943145e None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:55.537117 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea4c324-292a-4696-9b43-311d3943145e None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:55.538949 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 875/1732] 10.222.0.60 () {54 vars in 960 bytes} [Sat Jul 2 03:29:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:29:55.550255 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ff6719-0c7e-4046-b041-00d03b3ef7a7 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:55.551282 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ff6719-0c7e-4046-b041-00d03b3ef7a7 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:55.551651 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ff6719-0c7e-4046-b041-00d03b3ef7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:55.577260 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-e1ff6719-0c7e-4046-b041-00d03b3ef7a7 None None] MFA Rules not processed for user `9dafc9be75a64db095fe08b9cbb04cbd`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:29:55.579053 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e1ff6719-0c7e-4046-b041-00d03b3ef7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:55.768356 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea4c324-292a-4696-9b43-311d3943145e None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:55.773374 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 858/1733] 10.222.0.60 () {58 vars in 1057 bytes} [Sat Jul 2 03:29:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 03:29:55.788515 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea4c324-292a-4696-9b43-311d3943145e None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:55.799449 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550d7a99-7357-4cf7-bb43-d33b9ef25a08 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dafc9be75a64db095fe08b9cbb04cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:55.800590 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d7a99-7357-4cf7-bb43-d33b9ef25a08 service placement] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:55.801015 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d7a99-7357-4cf7-bb43-d33b9ef25a08 service placement] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:55.801418 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d7a99-7357-4cf7-bb43-d33b9ef25a08 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:55.804351 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-550d7a99-7357-4cf7-bb43-d33b9ef25a08 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:55.845294 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550d7a99-7357-4cf7-bb43-d33b9ef25a08 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:55.848730 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550d7a99-7357-4cf7-bb43-d33b9ef25a08 service placement] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:55.907691 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 876/1734] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:29:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 03:29:55.978229 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ff6719-0c7e-4046-b041-00d03b3ef7a7 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:55.994798 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:29:56.157422 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca69ba-a172-4e8e-ac3b-6cda9885321b None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:56.157689 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca69ba-a172-4e8e-ac3b-6cda9885321b None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:56.157962 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca69ba-a172-4e8e-ac3b-6cda9885321b None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:56.159844 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 877/1735] 10.222.0.60 () {54 vars in 912 bytes} [Sat Jul 2 03:29:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:29:56.160673 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ff6719-0c7e-4046-b041-00d03b3ef7a7 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:56.166720 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac3e259-e5c9-4bcd-bb54-d46f69ae9901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:56.168354 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a9278-114e-4a8f-9cd8-6ac33c664a0f None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:56.168672 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a9278-114e-4a8f-9cd8-6ac33c664a0f None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:56.168964 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a9278-114e-4a8f-9cd8-6ac33c664a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:56.182158 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3e259-e5c9-4bcd-bb54-d46f69ae9901 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:56.189184 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3e259-e5c9-4bcd-bb54-d46f69ae9901 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:56.189524 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3e259-e5c9-4bcd-bb54-d46f69ae9901 admin admin] PATH_INFO: `/v3/users/52be19705db34470b7798d2c81481600` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:56.193482 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac3e259-e5c9-4bcd-bb54-d46f69ae9901 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52be19705db34470b7798d2c81481600)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:56.195428 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac3e259-e5c9-4bcd-bb54-d46f69ae9901 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:56.219392 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-152a9278-114e-4a8f-9cd8-6ac33c664a0f None None] MFA Rules not processed for user `b0e8a3ba6f84477bb9b4780918f357c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:29:56.220707 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-152a9278-114e-4a8f-9cd8-6ac33c664a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:56.271165 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 878/1736] 10.222.0.60 () {58 vars in 1009 bytes} [Sat Jul 2 03:29:56 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 03:29:56.361421 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6ac3e259-e5c9-4bcd-bb54-d46f69ae9901 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52be19705db34470b7798d2c81481600'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:29:56.379176 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6ac3e259-e5c9-4bcd-bb54-d46f69ae9901 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52be19705db34470b7798d2c81481600'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:29:56.383474 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6ac3e259-e5c9-4bcd-bb54-d46f69ae9901 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52be19705db34470b7798d2c81481600'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:29:56.409136 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6ac3e259-e5c9-4bcd-bb54-d46f69ae9901 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52be19705db34470b7798d2c81481600'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:29:56.419688 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6ac3e259-e5c9-4bcd-bb54-d46f69ae9901 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52be19705db34470b7798d2c81481600'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:29:56.482453 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 859/1737] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:29:55 2022] DELETE /identity/v3/users/52be19705db34470b7798d2c81481600 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:29:56.487029 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a5230-bd5a-4c54-aee3-4a71245f2d4a None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:56.487792 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a5230-bd5a-4c54-aee3-4a71245f2d4a None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:56.488433 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a5230-bd5a-4c54-aee3-4a71245f2d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:56.544946 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-e93a5230-bd5a-4c54-aee3-4a71245f2d4a None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:29:56.557754 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-e93a5230-bd5a-4c54-aee3-4a71245f2d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:56.816037 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:29:56.836116 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 879/1738] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:29:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:29:56.937889 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac3e259-e5c9-4bcd-bb54-d46f69ae9901 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:56.940757 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-6ac3e259-e5c9-4bcd-bb54-d46f69ae9901 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:56.992261 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93a5230-bd5a-4c54-aee3-4a71245f2d4a None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:56.994173 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-e93a5230-bd5a-4c54-aee3-4a71245f2d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:57.215284 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac3e259-e5c9-4bcd-bb54-d46f69ae9901 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:57.232649 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225bc6d-ceef-4df5-ac4e-7eee35b936bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:57.233717 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93a5230-bd5a-4c54-aee3-4a71245f2d4a None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:57.234948 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225bc6d-ceef-4df5-ac4e-7eee35b936bd service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:57.235849 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225bc6d-ceef-4df5-ac4e-7eee35b936bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:57.236166 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225bc6d-ceef-4df5-ac4e-7eee35b936bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:57.240022 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b225bc6d-ceef-4df5-ac4e-7eee35b936bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:57.244937 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b11d25d-37be-4a91-a0a4-bf822544c1a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:57.245698 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11d25d-37be-4a91-a0a4-bf822544c1a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:57.245980 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11d25d-37be-4a91-a0a4-bf822544c1a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:57.246261 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11d25d-37be-4a91-a0a4-bf822544c1a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:57.299727 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b225bc6d-ceef-4df5-ac4e-7eee35b936bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:57.301247 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b225bc6d-ceef-4df5-ac4e-7eee35b936bd service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:57.309145 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b11d25d-37be-4a91-a0a4-bf822544c1a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:57.311570 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b11d25d-37be-4a91-a0a4-bf822544c1a1 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:57.335239 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 860/1739] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:29:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:29:57.339858 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 880/1740] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:29:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:29:57.430624 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c59b2-354f-4693-b343-1110288623b8 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:57.431028 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c59b2-354f-4693-b343-1110288623b8 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:57.431344 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c59b2-354f-4693-b343-1110288623b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:57.469603 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-c63c59b2-354f-4693-b343-1110288623b8 None None] MFA Rules not processed for user `5caffa5bd8804abd96e411fb45383c5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:29:57.481001 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c63c59b2-354f-4693-b343-1110288623b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:57.545583 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:29:57.701935 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 861/1741] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:29:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:29:58.800441 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b11d25d-37be-4a91-a0a4-bf822544c1a1 service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:58.806874 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-7b11d25d-37be-4a91-a0a4-bf822544c1a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:58.848399 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b11d25d-37be-4a91-a0a4-bf822544c1a1 service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:58.859842 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b399719-a6da-4c14-a83a-69e5002168d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:58.861190 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b399719-a6da-4c14-a83a-69e5002168d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:58.861686 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b399719-a6da-4c14-a83a-69e5002168d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:58.862117 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b399719-a6da-4c14-a83a-69e5002168d0 admin admin] PATH_INFO: `/v3/projects/ebb13fcda85e40f6a0d6dbe0e66ff6e1` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:58.865110 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b399719-a6da-4c14-a83a-69e5002168d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebb13fcda85e40f6a0d6dbe0e66ff6e1)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:58.867359 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b399719-a6da-4c14-a83a-69e5002168d0 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:58.977760 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-4b399719-a6da-4c14-a83a-69e5002168d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebb13fcda85e40f6a0d6dbe0e66ff6e1', 'request_id': 'req-4b399719-a6da-4c14-a83a-69e5002168d0'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:29:58.989815 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-4b399719-a6da-4c14-a83a-69e5002168d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebb13fcda85e40f6a0d6dbe0e66ff6e1', 'request_id': 'req-4b399719-a6da-4c14-a83a-69e5002168d0'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:29:59.006688 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-4b399719-a6da-4c14-a83a-69e5002168d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebb13fcda85e40f6a0d6dbe0e66ff6e1', 'request_id': 'req-4b399719-a6da-4c14-a83a-69e5002168d0'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:29:59.037716 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-4b399719-a6da-4c14-a83a-69e5002168d0 admin admin] The token cache is being invalidate because project ebb13fcda85e40f6a0d6dbe0e66ff6e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:29:59.038438 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-4b399719-a6da-4c14-a83a-69e5002168d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:29:59.043599 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-4b399719-a6da-4c14-a83a-69e5002168d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:29:59.045652 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 881/1742] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:29:58 2022] DELETE /identity/v3/projects/ebb13fcda85e40f6a0d6dbe0e66ff6e1 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:29:59.051053 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a00ab-479b-476b-8e72-40af2fbbae5a None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:59.052078 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a00ab-479b-476b-8e72-40af2fbbae5a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:59.052626 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a00ab-479b-476b-8e72-40af2fbbae5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:59.092906 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-9c0a00ab-479b-476b-8e72-40af2fbbae5a None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:29:59.095519 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9c0a00ab-479b-476b-8e72-40af2fbbae5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:59.236652 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 862/1743] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:29:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:29:59.245109 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0576e4b-a15f-466f-9a82-d477e0c40598 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:59.245907 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0576e4b-a15f-466f-9a82-d477e0c40598 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:59.246258 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0576e4b-a15f-466f-9a82-d477e0c40598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:59.279020 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-d0576e4b-a15f-466f-9a82-d477e0c40598 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:29:59.287691 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-d0576e4b-a15f-466f-9a82-d477e0c40598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:59.328057 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a00ab-479b-476b-8e72-40af2fbbae5a None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:59.353643 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 882/1744] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:29:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:29:59.356291 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a00ab-479b-476b-8e72-40af2fbbae5a None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:59.389507 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5158344-1d5a-4949-9423-1ebe4cb7bf5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:59.390227 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5158344-1d5a-4949-9423-1ebe4cb7bf5e admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:59.390566 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5158344-1d5a-4949-9423-1ebe4cb7bf5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:59.390849 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5158344-1d5a-4949-9423-1ebe4cb7bf5e admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:59.391632 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5158344-1d5a-4949-9423-1ebe4cb7bf5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:29:59.391944 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5158344-1d5a-4949-9423-1ebe4cb7bf5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:59.395140 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5158344-1d5a-4949-9423-1ebe4cb7bf5e admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:59.425460 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 863/1745] 10.222.0.60 () {58 vars in 1152 bytes} [Sat Jul 2 03:29:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:29:59.426161 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0576e4b-a15f-466f-9a82-d477e0c40598 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:59.439965 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0576e4b-a15f-466f-9a82-d477e0c40598 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:59.456586 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c7080-445d-419e-a0b5-ae2116177685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:59.457435 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c7080-445d-419e-a0b5-ae2116177685 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:59.457718 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c7080-445d-419e-a0b5-ae2116177685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:59.459506 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c7080-445d-419e-a0b5-ae2116177685 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:59.460458 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283c7080-445d-419e-a0b5-ae2116177685 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:59.466070 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283c7080-445d-419e-a0b5-ae2116177685 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:59.529281 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 883/1746] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:29:59 2022] POST /identity/v3/projects => generated 403 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 03:29:59.534162 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5158344-1d5a-4949-9423-1ebe4cb7bf5e admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:59.550143 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5158344-1d5a-4949-9423-1ebe4cb7bf5e admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:59.740053 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c94e434-7f7b-4094-84d8-5cae1633b626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:59.743414 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94e434-7f7b-4094-84d8-5cae1633b626 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:59.743704 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94e434-7f7b-4094-84d8-5cae1633b626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:59.743977 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94e434-7f7b-4094-84d8-5cae1633b626 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:59.753593 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c94e434-7f7b-4094-84d8-5cae1633b626 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:59.753593 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c94e434-7f7b-4094-84d8-5cae1633b626 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:59.800882 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 864/1747] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:29:59 2022] POST /identity/v3/users => generated 302 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:29:59.801068 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c7080-445d-419e-a0b5-ae2116177685 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:59.822640 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c7080-445d-419e-a0b5-ae2116177685 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:59.840055 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcaf720-bb4c-4648-a064-3beaa617a29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:59.841835 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcaf720-bb4c-4648-a064-3beaa617a29a admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:59.846391 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcaf720-bb4c-4648-a064-3beaa617a29a admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:59.846794 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcaf720-bb4c-4648-a064-3beaa617a29a admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:59.849247 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcaf720-bb4c-4648-a064-3beaa617a29a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:59.853963 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b63d7-f567-4c30-8c96-c4c1b82a7efe None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:59.854250 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b63d7-f567-4c30-8c96-c4c1b82a7efe None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:59.854523 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b63d7-f567-4c30-8c96-c4c1b82a7efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:59.857140 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcaf720-bb4c-4648-a064-3beaa617a29a admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:59.873922 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 884/1748] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:29:59.879818 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcaf720-bb4c-4648-a064-3beaa617a29a admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:59.883534 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-832b63d7-f567-4c30-8c96-c4c1b82a7efe None None] MFA Rules not processed for user `3333e7495b9546d882e2a2211ff8875c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:29:59.884762 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-832b63d7-f567-4c30-8c96-c4c1b82a7efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:59.896050 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcaf720-bb4c-4648-a064-3beaa617a29a admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:59.901749 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bee086c-a465-49ec-963b-893dde284759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:59.902923 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee086c-a465-49ec-963b-893dde284759 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:59.903444 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee086c-a465-49ec-963b-893dde284759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:59.903958 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee086c-a465-49ec-963b-893dde284759 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:59.904965 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bee086c-a465-49ec-963b-893dde284759 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:59.907078 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bee086c-a465-49ec-963b-893dde284759 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:29:59.924401 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 885/1749] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:29:59.925773 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bee086c-a465-49ec-963b-893dde284759 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:59.937658 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bee086c-a465-49ec-963b-893dde284759 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:29:59.938292 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:29:59.948584 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e069c3-32f3-4461-a457-c2012779c672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:29:59.949023 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e069c3-32f3-4461-a457-c2012779c672 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:29:59.949476 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e069c3-32f3-4461-a457-c2012779c672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:29:59.950140 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e069c3-32f3-4461-a457-c2012779c672 admin admin] PATH_INFO: `/v3/projects/033ec426b8274b31ad5a2e947d1ff88d/users/f38dc40bf7504c5093f0df187a73b049/roles/c43aada0326446c4ade0ab1262918fa4` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:29:59.964748 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 865/1750] 10.222.0.60 () {58 vars in 1009 bytes} [Sat Jul 2 03:29:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 03:29:59.965791 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b63d7-f567-4c30-8c96-c4c1b82a7efe None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:29:59.967240 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-832b63d7-f567-4c30-8c96-c4c1b82a7efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:29:59.976171 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e069c3-32f3-4461-a457-c2012779c672 admin admin] RBAC: Authorizing `identity:create_grant(project_id=033ec426b8274b31ad5a2e947d1ff88d, user_id=f38dc40bf7504c5093f0df187a73b049, role_id=c43aada0326446c4ade0ab1262918fa4)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:29:59.980308 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e069c3-32f3-4461-a457-c2012779c672 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:00.014989 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 886/1751] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:29:59 2022] PUT /identity/v3/projects/033ec426b8274b31ad5a2e947d1ff88d/users/f38dc40bf7504c5093f0df187a73b049/roles/c43aada0326446c4ade0ab1262918fa4 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:30:00.023932 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcbb68e-1574-4358-9d07-bf60fd7cba9f None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:00.025285 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcbb68e-1574-4358-9d07-bf60fd7cba9f None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:00.026031 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcbb68e-1574-4358-9d07-bf60fd7cba9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:00.099525 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-6bcbb68e-1574-4358-9d07-bf60fd7cba9f None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:30:00.101128 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-6bcbb68e-1574-4358-9d07-bf60fd7cba9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:00.111698 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b63d7-f567-4c30-8c96-c4c1b82a7efe None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:00.116992 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:00.308839 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e8849-804b-436b-b415-4d7fd4fe47ee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '692ec343bf9f4339ba691440f55a6c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:00.311816 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e8849-804b-436b-b415-4d7fd4fe47ee service swift] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:00.312944 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e8849-804b-436b-b415-4d7fd4fe47ee service swift] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:00.313883 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e8849-804b-436b-b415-4d7fd4fe47ee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:00.328450 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 887/1752] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:30:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:30:00.330425 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7bc665-864b-4c07-bdb6-799974f9aa4a None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:00.330863 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7bc665-864b-4c07-bdb6-799974f9aa4a None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:00.334247 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7bc665-864b-4c07-bdb6-799974f9aa4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:00.422327 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-dd7bc665-864b-4c07-bdb6-799974f9aa4a None None] MFA Rules not processed for user `ac2f872367a9463ab4c7c56cec0c79dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:30:00.427888 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-dd7bc665-864b-4c07-bdb6-799974f9aa4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:00.600394 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e8849-804b-436b-b415-4d7fd4fe47ee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:00.615679 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e8849-804b-436b-b415-4d7fd4fe47ee service swift] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:00.676027 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 866/1753] 10.222.0.60 () {60 vars in 1384 bytes} [Sat Jul 2 03:29:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 711 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 03:30:00.681610 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e8849-804b-436b-b415-4d7fd4fe47ee service swift] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:00.683667 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-001e8849-804b-436b-b415-4d7fd4fe47ee service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:00.799781 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 888/1754] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:30:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 470 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:30:00.801805 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6acfa6a-1d8c-4bcf-91b5-3cad15fcaede None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:00.804676 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6acfa6a-1d8c-4bcf-91b5-3cad15fcaede None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:00.805566 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6acfa6a-1d8c-4bcf-91b5-3cad15fcaede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:00.892807 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-b6acfa6a-1d8c-4bcf-91b5-3cad15fcaede None None] MFA Rules not processed for user `11ccfa53ebb7405d9325a22f0295bf61`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:30:00.892807 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-b6acfa6a-1d8c-4bcf-91b5-3cad15fcaede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:00.939901 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:00.988598 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e8849-804b-436b-b415-4d7fd4fe47ee service swift] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:01.007398 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fafd73-ec34-4036-9387-7e7125761d76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:01.013023 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fafd73-ec34-4036-9387-7e7125761d76 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:01.013475 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fafd73-ec34-4036-9387-7e7125761d76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:01.014385 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fafd73-ec34-4036-9387-7e7125761d76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:01.032739 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 889/1755] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:30:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:30:01.035586 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fafd73-ec34-4036-9387-7e7125761d76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:01.037406 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fafd73-ec34-4036-9387-7e7125761d76 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:01.070754 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 867/1756] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:30:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:30:03.473891 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8666d-89c5-4fbb-8c1e-d35f0157eae9 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:03.474950 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8666d-89c5-4fbb-8c1e-d35f0157eae9 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:03.475439 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8666d-89c5-4fbb-8c1e-d35f0157eae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:03.519563 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-7de8666d-89c5-4fbb-8c1e-d35f0157eae9 None None] MFA Rules not processed for user `f38dc40bf7504c5093f0df187a73b049`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:30:03.520812 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-7de8666d-89c5-4fbb-8c1e-d35f0157eae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:03.644526 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:03.664473 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 890/1757] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:30:03 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:30:03.669582 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fafd73-ec34-4036-9387-7e7125761d76 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:03.680672 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fafd73-ec34-4036-9387-7e7125761d76 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:03.686279 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecca443-1815-42e5-a4c1-f34cc8f5933b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:03.687706 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecca443-1815-42e5-a4c1-f34cc8f5933b admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:03.688245 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecca443-1815-42e5-a4c1-f34cc8f5933b admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:03.688732 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecca443-1815-42e5-a4c1-f34cc8f5933b admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:03.689872 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecca443-1815-42e5-a4c1-f34cc8f5933b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:03.692233 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecca443-1815-42e5-a4c1-f34cc8f5933b admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:03.720321 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 868/1758] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:30:03 2022] POST /identity/v3/projects => generated 403 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:30:03.724572 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de8666d-89c5-4fbb-8c1e-d35f0157eae9 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:03.738390 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de8666d-89c5-4fbb-8c1e-d35f0157eae9 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:03.817035 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe26281b-45ca-4a92-8b7f-166e34757eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:03.818227 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26281b-45ca-4a92-8b7f-166e34757eab admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:03.818535 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26281b-45ca-4a92-8b7f-166e34757eab admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:03.818792 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26281b-45ca-4a92-8b7f-166e34757eab admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:03.819718 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe26281b-45ca-4a92-8b7f-166e34757eab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:03.821999 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe26281b-45ca-4a92-8b7f-166e34757eab admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:03.852376 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 891/1759] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:30:03 2022] POST /identity/v3/users => generated 308 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 03:30:03.853900 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecca443-1815-42e5-a4c1-f34cc8f5933b admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:03.871180 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecca443-1815-42e5-a4c1-f34cc8f5933b admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:03.879092 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed170281-ed4c-4d8a-8cda-86ea38e25029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:03.880142 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed170281-ed4c-4d8a-8cda-86ea38e25029 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:03.880578 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed170281-ed4c-4d8a-8cda-86ea38e25029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:03.880906 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed170281-ed4c-4d8a-8cda-86ea38e25029 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:03.881904 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed170281-ed4c-4d8a-8cda-86ea38e25029 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:03.884436 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed170281-ed4c-4d8a-8cda-86ea38e25029 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:03.898909 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 869/1760] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:30:03 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:30:03.903896 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe26281b-45ca-4a92-8b7f-166e34757eab admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:03.926175 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe26281b-45ca-4a92-8b7f-166e34757eab admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:03.932812 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f75ff-f68a-4b9d-a5cd-712db873758b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:03.933947 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f75ff-f68a-4b9d-a5cd-712db873758b admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:03.934229 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f75ff-f68a-4b9d-a5cd-712db873758b admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:03.934500 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f75ff-f68a-4b9d-a5cd-712db873758b admin admin] PATH_INFO: `/v3/projects/4547ea6fb1d448d692afe501814e603b/users/e7a5bd8a10c84bfb9d4e6ebc87ba5191/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:03.951017 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1f75ff-f68a-4b9d-a5cd-712db873758b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4547ea6fb1d448d692afe501814e603b, user_id=e7a5bd8a10c84bfb9d4e6ebc87ba5191, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:03.953744 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1f75ff-f68a-4b9d-a5cd-712db873758b admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:03.968508 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 892/1761] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:30:03 2022] PUT /identity/v3/projects/4547ea6fb1d448d692afe501814e603b/users/e7a5bd8a10c84bfb9d4e6ebc87ba5191/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:30:03.972516 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed170281-ed4c-4d8a-8cda-86ea38e25029 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:03.989368 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed170281-ed4c-4d8a-8cda-86ea38e25029 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:04.081982 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d7ded-d319-4875-936f-30cd2dc803c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:04.082670 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d7ded-d319-4875-936f-30cd2dc803c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:04.082950 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d7ded-d319-4875-936f-30cd2dc803c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:04.083272 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d7ded-d319-4875-936f-30cd2dc803c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:04.084282 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2d7ded-d319-4875-936f-30cd2dc803c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:04.086241 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2d7ded-d319-4875-936f-30cd2dc803c4 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:04.097336 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 870/1762] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:30:03 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:30:04.101798 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f75ff-f68a-4b9d-a5cd-712db873758b admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:04.113959 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f75ff-f68a-4b9d-a5cd-712db873758b admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:04.119098 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fa3e4d-1763-4933-a370-b2e3aede3971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:04.120011 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa3e4d-1763-4933-a370-b2e3aede3971 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:04.120292 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa3e4d-1763-4933-a370-b2e3aede3971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:04.120571 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa3e4d-1763-4933-a370-b2e3aede3971 admin admin] PATH_INFO: `/v3/projects/4547ea6fb1d448d692afe501814e603b/users/e7a5bd8a10c84bfb9d4e6ebc87ba5191/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:04.122663 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fa3e4d-1763-4933-a370-b2e3aede3971 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4547ea6fb1d448d692afe501814e603b, user_id=e7a5bd8a10c84bfb9d4e6ebc87ba5191, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:04.125404 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fa3e4d-1763-4933-a370-b2e3aede3971 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:04.137225 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 893/1763] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:30:04 2022] PUT /identity/v3/projects/4547ea6fb1d448d692afe501814e603b/users/e7a5bd8a10c84bfb9d4e6ebc87ba5191/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:30:04.982315 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d7ded-d319-4875-936f-30cd2dc803c4 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:04.984885 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ce2d7ded-d319-4875-936f-30cd2dc803c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:05.022787 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d7ded-d319-4875-936f-30cd2dc803c4 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:05.181745 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f9428-159d-40b7-a068-6efb1b20f462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:05.183019 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f9428-159d-40b7-a068-6efb1b20f462 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:05.183471 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f9428-159d-40b7-a068-6efb1b20f462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:05.183903 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f9428-159d-40b7-a068-6efb1b20f462 admin admin] PATH_INFO: `/v3/users/b8b4090be5cb41a4a75d5a4e25659edc` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:05.185481 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434f9428-159d-40b7-a068-6efb1b20f462 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8b4090be5cb41a4a75d5a4e25659edc)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:05.200754 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434f9428-159d-40b7-a068-6efb1b20f462 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:05.327712 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:05.332216 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-434f9428-159d-40b7-a068-6efb1b20f462 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8b4090be5cb41a4a75d5a4e25659edc'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:05.335479 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-434f9428-159d-40b7-a068-6efb1b20f462 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8b4090be5cb41a4a75d5a4e25659edc'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:05.337458 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-434f9428-159d-40b7-a068-6efb1b20f462 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8b4090be5cb41a4a75d5a4e25659edc'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:05.377602 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-434f9428-159d-40b7-a068-6efb1b20f462 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8b4090be5cb41a4a75d5a4e25659edc'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:05.397463 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-434f9428-159d-40b7-a068-6efb1b20f462 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8b4090be5cb41a4a75d5a4e25659edc'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:05.433518 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 871/1764] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:30:04 2022] DELETE /identity/v3/users/b8b4090be5cb41a4a75d5a4e25659edc => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:30:05.438032 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9add9cc-42b2-4b21-bb0a-1d64569752e6 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:05.438653 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9add9cc-42b2-4b21-bb0a-1d64569752e6 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:05.438653 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9add9cc-42b2-4b21-bb0a-1d64569752e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:05.474827 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-d9add9cc-42b2-4b21-bb0a-1d64569752e6 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:30:05.476131 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-d9add9cc-42b2-4b21-bb0a-1d64569752e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:05.598147 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 894/1765] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:30:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:30:05.610114 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f9428-159d-40b7-a068-6efb1b20f462 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:05.616835 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-434f9428-159d-40b7-a068-6efb1b20f462 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:05.634944 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81445d-9e73-4c63-95a9-ffd9c1679670 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:05.635424 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81445d-9e73-4c63-95a9-ffd9c1679670 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:05.635840 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81445d-9e73-4c63-95a9-ffd9c1679670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:05.693682 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-0e81445d-9e73-4c63-95a9-ffd9c1679670 None None] MFA Rules not processed for user `e7a5bd8a10c84bfb9d4e6ebc87ba5191`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:30:05.695068 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-0e81445d-9e73-4c63-95a9-ffd9c1679670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:05.741822 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:05.768402 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f9428-159d-40b7-a068-6efb1b20f462 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:05.776740 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d90217-c21e-474d-9086-1f373d8854fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:05.778166 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d90217-c21e-474d-9086-1f373d8854fa service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:05.779398 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d90217-c21e-474d-9086-1f373d8854fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:05.779720 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d90217-c21e-474d-9086-1f373d8854fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:05.808666 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d90217-c21e-474d-9086-1f373d8854fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:05.810124 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d90217-c21e-474d-9086-1f373d8854fa service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:05.851279 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 872/1766] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:30:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:30:05.880432 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 895/1767] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:30:05 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 03:30:06.424486 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d90217-c21e-474d-9086-1f373d8854fa service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:06.425926 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f6d90217-c21e-474d-9086-1f373d8854fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:06.447613 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d90217-c21e-474d-9086-1f373d8854fa service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:06.457811 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c30530c-287b-4f03-ae0c-267690246239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:06.464956 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c30530c-287b-4f03-ae0c-267690246239 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:06.465246 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c30530c-287b-4f03-ae0c-267690246239 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:06.465525 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c30530c-287b-4f03-ae0c-267690246239 admin admin] PATH_INFO: `/v3/projects/96a954a9715049719627ea06b84ccff3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:06.466998 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c30530c-287b-4f03-ae0c-267690246239 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96a954a9715049719627ea06b84ccff3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:06.468975 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c30530c-287b-4f03-ae0c-267690246239 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:06.585199 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4c30530c-287b-4f03-ae0c-267690246239 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96a954a9715049719627ea06b84ccff3', 'request_id': 'req-4c30530c-287b-4f03-ae0c-267690246239'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:06.597087 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4c30530c-287b-4f03-ae0c-267690246239 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96a954a9715049719627ea06b84ccff3', 'request_id': 'req-4c30530c-287b-4f03-ae0c-267690246239'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:06.622124 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4c30530c-287b-4f03-ae0c-267690246239 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96a954a9715049719627ea06b84ccff3', 'request_id': 'req-4c30530c-287b-4f03-ae0c-267690246239'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:06.640254 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4c30530c-287b-4f03-ae0c-267690246239 admin admin] The token cache is being invalidate because project 96a954a9715049719627ea06b84ccff3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:30:06.640544 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4c30530c-287b-4f03-ae0c-267690246239 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:06.641216 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4c30530c-287b-4f03-ae0c-267690246239 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:06.642801 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 873/1768] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:30:06 2022] DELETE /identity/v3/projects/96a954a9715049719627ea06b84ccff3 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 03:30:06.647179 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e81445d-9e73-4c63-95a9-ffd9c1679670 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:06.676990 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e81445d-9e73-4c63-95a9-ffd9c1679670 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:06.760506 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee9943d-7582-4722-8911-bef22d79ee07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:06.761934 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9943d-7582-4722-8911-bef22d79ee07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:06.762227 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9943d-7582-4722-8911-bef22d79ee07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:06.762502 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9943d-7582-4722-8911-bef22d79ee07 admin admin] PATH_INFO: `/v3/users/2c6b6bef596645b68a8241bb1ff8ad34` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:06.763752 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee9943d-7582-4722-8911-bef22d79ee07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c6b6bef596645b68a8241bb1ff8ad34)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:06.795763 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee9943d-7582-4722-8911-bef22d79ee07 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:06.931296 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-1ee9943d-7582-4722-8911-bef22d79ee07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c6b6bef596645b68a8241bb1ff8ad34'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:06.932500 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-1ee9943d-7582-4722-8911-bef22d79ee07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c6b6bef596645b68a8241bb1ff8ad34'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:06.942074 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-1ee9943d-7582-4722-8911-bef22d79ee07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c6b6bef596645b68a8241bb1ff8ad34'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:06.943066 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-1ee9943d-7582-4722-8911-bef22d79ee07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c6b6bef596645b68a8241bb1ff8ad34'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:06.955998 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-1ee9943d-7582-4722-8911-bef22d79ee07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c6b6bef596645b68a8241bb1ff8ad34'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:06.993321 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 896/1769] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:30:06 2022] DELETE /identity/v3/users/2c6b6bef596645b68a8241bb1ff8ad34 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:30:07.195376 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25862050-0450-45ff-b4a2-76422a291de4 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:07.195931 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25862050-0450-45ff-b4a2-76422a291de4 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:07.196335 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25862050-0450-45ff-b4a2-76422a291de4 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:07.198258 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 874/1770] 10.222.0.60 () {54 vars in 921 bytes} [Sat Jul 2 03:30:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:30:07.226041 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27798643-b5f7-4944-ac28-400d1f752df3 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:07.226480 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27798643-b5f7-4944-ac28-400d1f752df3 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:07.226948 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27798643-b5f7-4944-ac28-400d1f752df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:07.270695 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-27798643-b5f7-4944-ac28-400d1f752df3 None None] MFA Rules not processed for user `9dafc9be75a64db095fe08b9cbb04cbd`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:30:07.275335 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-27798643-b5f7-4944-ac28-400d1f752df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:07.605790 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:07.670160 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 897/1771] 10.222.0.60 () {58 vars in 1018 bytes} [Sat Jul 2 03:30:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 445 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:30:07.708030 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25862050-0450-45ff-b4a2-76422a291de4 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:07.710005 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-25862050-0450-45ff-b4a2-76422a291de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:07.738850 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25862050-0450-45ff-b4a2-76422a291de4 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:07.751171 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa4360-0df2-4719-b91d-7555dd0f0b6b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dafc9be75a64db095fe08b9cbb04cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:07.751171 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa4360-0df2-4719-b91d-7555dd0f0b6b service placement] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:07.751171 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa4360-0df2-4719-b91d-7555dd0f0b6b service placement] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:07.751578 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa4360-0df2-4719-b91d-7555dd0f0b6b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:07.782978 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27798643-b5f7-4944-ac28-400d1f752df3 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:07.785491 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-27798643-b5f7-4944-ac28-400d1f752df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:07.790978 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aa4360-0df2-4719-b91d-7555dd0f0b6b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:07.794858 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aa4360-0df2-4719-b91d-7555dd0f0b6b service placement] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:07.808713 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 875/1772] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:30:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:30:07.976142 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27798643-b5f7-4944-ac28-400d1f752df3 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:07.983109 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43fa8a6-3aa9-465c-a512-2d4bc778a7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:07.984912 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43fa8a6-3aa9-465c-a512-2d4bc778a7d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:07.984912 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43fa8a6-3aa9-465c-a512-2d4bc778a7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:07.984912 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43fa8a6-3aa9-465c-a512-2d4bc778a7d3 admin admin] PATH_INFO: `/v3/projects/84c442fe1ccd4763a5869164fb9b50a1` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:07.988324 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43fa8a6-3aa9-465c-a512-2d4bc778a7d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84c442fe1ccd4763a5869164fb9b50a1)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:07.989977 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43fa8a6-3aa9-465c-a512-2d4bc778a7d3 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:08.092563 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e43fa8a6-3aa9-465c-a512-2d4bc778a7d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84c442fe1ccd4763a5869164fb9b50a1', 'request_id': 'req-e43fa8a6-3aa9-465c-a512-2d4bc778a7d3'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:08.105822 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e43fa8a6-3aa9-465c-a512-2d4bc778a7d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84c442fe1ccd4763a5869164fb9b50a1', 'request_id': 'req-e43fa8a6-3aa9-465c-a512-2d4bc778a7d3'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:08.121232 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e43fa8a6-3aa9-465c-a512-2d4bc778a7d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84c442fe1ccd4763a5869164fb9b50a1', 'request_id': 'req-e43fa8a6-3aa9-465c-a512-2d4bc778a7d3'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:08.141483 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e43fa8a6-3aa9-465c-a512-2d4bc778a7d3 admin admin] The token cache is being invalidate because project 84c442fe1ccd4763a5869164fb9b50a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:30:08.141778 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e43fa8a6-3aa9-465c-a512-2d4bc778a7d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:08.142469 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e43fa8a6-3aa9-465c-a512-2d4bc778a7d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:08.144654 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 898/1773] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:30:07 2022] DELETE /identity/v3/projects/84c442fe1ccd4763a5869164fb9b50a1 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 03:30:08.149650 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6800041-6c8e-43cf-9843-79b8cda9601f None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:08.152267 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6800041-6c8e-43cf-9843-79b8cda9601f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:08.156249 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6800041-6c8e-43cf-9843-79b8cda9601f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:08.183637 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-c6800041-6c8e-43cf-9843-79b8cda9601f None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:30:08.184946 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c6800041-6c8e-43cf-9843-79b8cda9601f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:08.230223 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:08.315184 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 876/1774] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:30:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 03:30:08.318697 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50166d52-001f-4082-b1f8-baae22c04e3a None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:08.319058 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50166d52-001f-4082-b1f8-baae22c04e3a None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:08.321317 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50166d52-001f-4082-b1f8-baae22c04e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:08.342223 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-50166d52-001f-4082-b1f8-baae22c04e3a None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:30:08.343475 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-50166d52-001f-4082-b1f8-baae22c04e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:08.357616 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6800041-6c8e-43cf-9843-79b8cda9601f None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:08.362951 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 899/1775] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:30:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:30:08.376249 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6800041-6c8e-43cf-9843-79b8cda9601f None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:08.390168 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1894a0f-5373-43c6-b985-37d78f9f5aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:08.390846 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1894a0f-5373-43c6-b985-37d78f9f5aea admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:08.391209 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1894a0f-5373-43c6-b985-37d78f9f5aea admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:08.391423 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1894a0f-5373-43c6-b985-37d78f9f5aea admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:08.392162 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1894a0f-5373-43c6-b985-37d78f9f5aea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:30:08.392460 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1894a0f-5373-43c6-b985-37d78f9f5aea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:08.394064 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1894a0f-5373-43c6-b985-37d78f9f5aea admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:08.432581 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50166d52-001f-4082-b1f8-baae22c04e3a None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:08.441855 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 877/1776] 10.222.0.60 () {58 vars in 1152 bytes} [Sat Jul 2 03:30:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:30:08.447041 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50166d52-001f-4082-b1f8-baae22c04e3a None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:08.453248 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1056d1-586b-402a-bdeb-87af3997fe6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:08.454511 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1056d1-586b-402a-bdeb-87af3997fe6e admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:08.455291 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1056d1-586b-402a-bdeb-87af3997fe6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:08.455993 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1056d1-586b-402a-bdeb-87af3997fe6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:08.456846 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1056d1-586b-402a-bdeb-87af3997fe6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:08.459909 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1056d1-586b-402a-bdeb-87af3997fe6e admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:08.543329 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1894a0f-5373-43c6-b985-37d78f9f5aea admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:08.551328 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 900/1777] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:30:08 2022] POST /identity/v3/projects => generated 377 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 03:30:08.556579 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1894a0f-5373-43c6-b985-37d78f9f5aea admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:08.670753 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7a343b-30d6-42c9-82a5-af717284564c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:08.671994 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a343b-30d6-42c9-82a5-af717284564c admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:08.672372 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a343b-30d6-42c9-82a5-af717284564c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:08.672741 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a343b-30d6-42c9-82a5-af717284564c admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:08.673541 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7a343b-30d6-42c9-82a5-af717284564c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:08.689916 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7a343b-30d6-42c9-82a5-af717284564c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:08.721840 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 878/1778] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:30:08 2022] POST /identity/v3/users => generated 289 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:30:08.727815 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1056d1-586b-402a-bdeb-87af3997fe6e admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:08.751182 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1056d1-586b-402a-bdeb-87af3997fe6e admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:08.763633 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f11442-1c17-4e1c-b269-44b11957f4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:08.764391 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f11442-1c17-4e1c-b269-44b11957f4a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:08.764603 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f11442-1c17-4e1c-b269-44b11957f4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:08.764932 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f11442-1c17-4e1c-b269-44b11957f4a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:08.767589 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f11442-1c17-4e1c-b269-44b11957f4a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:08.769473 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f11442-1c17-4e1c-b269-44b11957f4a2 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:08.797392 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 901/1779] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:30:08.803275 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7a343b-30d6-42c9-82a5-af717284564c admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:08.816362 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7a343b-30d6-42c9-82a5-af717284564c admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:08.824979 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd47c7d-ad8c-42eb-9333-87353b68897f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:08.825931 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd47c7d-ad8c-42eb-9333-87353b68897f admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:08.826417 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd47c7d-ad8c-42eb-9333-87353b68897f admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:08.826835 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd47c7d-ad8c-42eb-9333-87353b68897f admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:08.827814 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd47c7d-ad8c-42eb-9333-87353b68897f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:08.848512 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd47c7d-ad8c-42eb-9333-87353b68897f admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:08.869751 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa12464-6d4a-4790-b2ad-b24459a88268 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:08.870080 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa12464-6d4a-4790-b2ad-b24459a88268 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:08.870376 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa12464-6d4a-4790-b2ad-b24459a88268 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:08.871985 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 902/1780] 10.222.0.60 () {54 vars in 921 bytes} [Sat Jul 2 03:30:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:30:08.873032 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 879/1781] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 03:30:08.877212 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa12464-6d4a-4790-b2ad-b24459a88268 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:08.887457 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f6c6d-76ba-4013-8242-b7e74c46fcf7 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:08.887873 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f6c6d-76ba-4013-8242-b7e74c46fcf7 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:08.888408 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f6c6d-76ba-4013-8242-b7e74c46fcf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:08.897526 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa12464-6d4a-4790-b2ad-b24459a88268 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:08.903462 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971aa16c-2353-4a49-bce5-b13d0a114a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:08.904758 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971aa16c-2353-4a49-bce5-b13d0a114a7c admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:08.905454 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971aa16c-2353-4a49-bce5-b13d0a114a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:08.906010 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971aa16c-2353-4a49-bce5-b13d0a114a7c admin admin] PATH_INFO: `/v3/projects/4deed07ac018474490e72f7da7fc2185/users/90b3c3e84e8d426b8b76f475be40522a/roles/c43aada0326446c4ade0ab1262918fa4` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:08.926099 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971aa16c-2353-4a49-bce5-b13d0a114a7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4deed07ac018474490e72f7da7fc2185, user_id=90b3c3e84e8d426b8b76f475be40522a, role_id=c43aada0326446c4ade0ab1262918fa4)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:08.928956 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-b97f6c6d-76ba-4013-8242-b7e74c46fcf7 None None] MFA Rules not processed for user `9dafc9be75a64db095fe08b9cbb04cbd`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:30:08.931929 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b97f6c6d-76ba-4013-8242-b7e74c46fcf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:08.933641 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971aa16c-2353-4a49-bce5-b13d0a114a7c admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:08.958451 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 903/1782] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:30:08 2022] PUT /identity/v3/projects/4deed07ac018474490e72f7da7fc2185/users/90b3c3e84e8d426b8b76f475be40522a/roles/c43aada0326446c4ade0ab1262918fa4 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 03:30:08.959804 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971aa16c-2353-4a49-bce5-b13d0a114a7c admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:08.973043 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-971aa16c-2353-4a49-bce5-b13d0a114a7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:08.987370 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:09.085422 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971aa16c-2353-4a49-bce5-b13d0a114a7c admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:09.086384 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 880/1783] 10.222.0.60 () {58 vars in 1018 bytes} [Sat Jul 2 03:30:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 03:30:09.088741 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa955c-8b1b-41e5-a1f0-4fbf8934a0c9 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:09.089173 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa955c-8b1b-41e5-a1f0-4fbf8934a0c9 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:09.089588 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa955c-8b1b-41e5-a1f0-4fbf8934a0c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:09.092215 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355597de-25ae-4707-b2f9-e29ff5d47dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:09.093382 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355597de-25ae-4707-b2f9-e29ff5d47dfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:09.093777 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355597de-25ae-4707-b2f9-e29ff5d47dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:09.094156 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355597de-25ae-4707-b2f9-e29ff5d47dfa admin admin] PATH_INFO: `/v3/users/f38dc40bf7504c5093f0df187a73b049` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:09.095647 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355597de-25ae-4707-b2f9-e29ff5d47dfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=f38dc40bf7504c5093f0df187a73b049)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:09.099147 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355597de-25ae-4707-b2f9-e29ff5d47dfa admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:09.139203 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-3aaa955c-8b1b-41e5-a1f0-4fbf8934a0c9 None None] MFA Rules not processed for user `90b3c3e84e8d426b8b76f475be40522a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:30:09.140539 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3aaa955c-8b1b-41e5-a1f0-4fbf8934a0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:09.167817 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-355597de-25ae-4707-b2f9-e29ff5d47dfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f38dc40bf7504c5093f0df187a73b049'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:09.169687 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-355597de-25ae-4707-b2f9-e29ff5d47dfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f38dc40bf7504c5093f0df187a73b049'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:09.171631 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:09.182401 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-355597de-25ae-4707-b2f9-e29ff5d47dfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f38dc40bf7504c5093f0df187a73b049'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:09.183632 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-355597de-25ae-4707-b2f9-e29ff5d47dfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f38dc40bf7504c5093f0df187a73b049'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:09.198496 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-355597de-25ae-4707-b2f9-e29ff5d47dfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f38dc40bf7504c5093f0df187a73b049'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:09.215114 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 904/1784] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:30:08 2022] DELETE /identity/v3/users/f38dc40bf7504c5093f0df187a73b049 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:30:09.215114 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355597de-25ae-4707-b2f9-e29ff5d47dfa admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:09.215114 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-355597de-25ae-4707-b2f9-e29ff5d47dfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:09.242616 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 881/1785] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:30:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:30:09.246910 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaa955c-8b1b-41e5-a1f0-4fbf8934a0c9 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:09.253735 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3aaa955c-8b1b-41e5-a1f0-4fbf8934a0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:09.301065 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaa955c-8b1b-41e5-a1f0-4fbf8934a0c9 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:09.322060 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355597de-25ae-4707-b2f9-e29ff5d47dfa admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:09.329201 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736e9139-caee-424e-b8c3-e1ccd2c7f20f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dafc9be75a64db095fe08b9cbb04cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:09.329861 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e9139-caee-424e-b8c3-e1ccd2c7f20f service placement] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:09.330141 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e9139-caee-424e-b8c3-e1ccd2c7f20f service placement] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:09.330420 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e9139-caee-424e-b8c3-e1ccd2c7f20f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:09.332418 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-736e9139-caee-424e-b8c3-e1ccd2c7f20f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:09.350447 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736e9139-caee-424e-b8c3-e1ccd2c7f20f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:09.359752 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736e9139-caee-424e-b8c3-e1ccd2c7f20f service placement] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:09.368501 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 905/1786] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:30:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:30:09.417406 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8e46ce-0f69-475d-8dac-c55505faa17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:09.418225 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e46ce-0f69-475d-8dac-c55505faa17a admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:09.418583 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e46ce-0f69-475d-8dac-c55505faa17a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:09.418963 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e46ce-0f69-475d-8dac-c55505faa17a admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:09.419798 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8e46ce-0f69-475d-8dac-c55505faa17a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:09.421911 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8e46ce-0f69-475d-8dac-c55505faa17a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:09.453028 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 882/1787] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:30:09 2022] POST /identity/v3/projects => generated 373 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 03:30:09.457036 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736e9139-caee-424e-b8c3-e1ccd2c7f20f service placement] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:09.468725 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8e46ce-0f69-475d-8dac-c55505faa17a admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:09.470456 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0b8e46ce-0f69-475d-8dac-c55505faa17a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:09.472565 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736e9139-caee-424e-b8c3-e1ccd2c7f20f service placement] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:09.490731 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:09.548437 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8d55ff-d386-4d62-9638-bcffeafafdcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:09.549246 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d55ff-d386-4d62-9638-bcffeafafdcf admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:09.549531 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d55ff-d386-4d62-9638-bcffeafafdcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:09.550104 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d55ff-d386-4d62-9638-bcffeafafdcf admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:09.558003 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8d55ff-d386-4d62-9638-bcffeafafdcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:09.561237 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8d55ff-d386-4d62-9638-bcffeafafdcf admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:09.567981 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8e46ce-0f69-475d-8dac-c55505faa17a admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:09.574068 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae67d59a-db7f-467b-8aa9-cba3412706c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:09.575311 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae67d59a-db7f-467b-8aa9-cba3412706c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:09.575699 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae67d59a-db7f-467b-8aa9-cba3412706c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:09.575931 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae67d59a-db7f-467b-8aa9-cba3412706c5 admin admin] PATH_INFO: `/v3/projects/033ec426b8274b31ad5a2e947d1ff88d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:09.577367 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae67d59a-db7f-467b-8aa9-cba3412706c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=033ec426b8274b31ad5a2e947d1ff88d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:09.579431 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae67d59a-db7f-467b-8aa9-cba3412706c5 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:09.586015 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 906/1788] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:30:09 2022] POST /identity/v3/users => generated 293 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 03:30:09.590254 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8d55ff-d386-4d62-9638-bcffeafafdcf admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:09.603826 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8d55ff-d386-4d62-9638-bcffeafafdcf admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:09.609728 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e26569-07c1-41f5-8c2f-a7e7bc2d386a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:09.610429 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e26569-07c1-41f5-8c2f-a7e7bc2d386a admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:09.610711 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e26569-07c1-41f5-8c2f-a7e7bc2d386a admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:09.611539 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e26569-07c1-41f5-8c2f-a7e7bc2d386a admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:09.612310 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e26569-07c1-41f5-8c2f-a7e7bc2d386a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:09.614842 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e26569-07c1-41f5-8c2f-a7e7bc2d386a admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:09.627587 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 907/1789] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:30:09 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 03:30:09.632665 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e26569-07c1-41f5-8c2f-a7e7bc2d386a admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:09.642994 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e26569-07c1-41f5-8c2f-a7e7bc2d386a admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:09.644110 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ae67d59a-db7f-467b-8aa9-cba3412706c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '033ec426b8274b31ad5a2e947d1ff88d', 'request_id': 'req-ae67d59a-db7f-467b-8aa9-cba3412706c5'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:09.648464 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:09.656484 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ae67d59a-db7f-467b-8aa9-cba3412706c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '033ec426b8274b31ad5a2e947d1ff88d', 'request_id': 'req-ae67d59a-db7f-467b-8aa9-cba3412706c5'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:09.668686 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ae67d59a-db7f-467b-8aa9-cba3412706c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '033ec426b8274b31ad5a2e947d1ff88d', 'request_id': 'req-ae67d59a-db7f-467b-8aa9-cba3412706c5'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:09.684273 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ae67d59a-db7f-467b-8aa9-cba3412706c5 admin admin] The token cache is being invalidate because project 033ec426b8274b31ad5a2e947d1ff88d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:30:09.684571 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ae67d59a-db7f-467b-8aa9-cba3412706c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:09.685253 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ae67d59a-db7f-467b-8aa9-cba3412706c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:09.690074 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 883/1790] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:30:09 2022] DELETE /identity/v3/projects/033ec426b8274b31ad5a2e947d1ff88d => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 03:30:09.691565 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae67d59a-db7f-467b-8aa9-cba3412706c5 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:09.698399 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ae67d59a-db7f-467b-8aa9-cba3412706c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:09.714370 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b7e3d8-5a2c-4da7-bf32-84abf2f7d636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:09.715296 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b7e3d8-5a2c-4da7-bf32-84abf2f7d636 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:09.715579 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b7e3d8-5a2c-4da7-bf32-84abf2f7d636 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:09.715853 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b7e3d8-5a2c-4da7-bf32-84abf2f7d636 admin admin] PATH_INFO: `/v3/projects/2e17b3c1bb9843249b8965fe67618815/users/7bb879a51b684f76ab190eb11c9cdd28/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:09.743940 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b7e3d8-5a2c-4da7-bf32-84abf2f7d636 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e17b3c1bb9843249b8965fe67618815, user_id=7bb879a51b684f76ab190eb11c9cdd28, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:09.746911 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b7e3d8-5a2c-4da7-bf32-84abf2f7d636 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:09.767386 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 908/1791] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:30:09 2022] PUT /identity/v3/projects/2e17b3c1bb9843249b8965fe67618815/users/7bb879a51b684f76ab190eb11c9cdd28/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:30:09.768537 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b7e3d8-5a2c-4da7-bf32-84abf2f7d636 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:09.771755 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-b3b7e3d8-5a2c-4da7-bf32-84abf2f7d636 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:09.802679 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae67d59a-db7f-467b-8aa9-cba3412706c5 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:09.872441 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b7e3d8-5a2c-4da7-bf32-84abf2f7d636 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:09.877258 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab2e867-1ddc-4f84-94d8-e7e79cfb7d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:09.877960 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2e867-1ddc-4f84-94d8-e7e79cfb7d3c admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:09.878238 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2e867-1ddc-4f84-94d8-e7e79cfb7d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:09.878505 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2e867-1ddc-4f84-94d8-e7e79cfb7d3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:09.879265 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab2e867-1ddc-4f84-94d8-e7e79cfb7d3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:09.881123 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9838c909-0067-46e5-8e8c-cb055f55d364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:09.881251 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab2e867-1ddc-4f84-94d8-e7e79cfb7d3c admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:09.882072 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9838c909-0067-46e5-8e8c-cb055f55d364 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:09.882422 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9838c909-0067-46e5-8e8c-cb055f55d364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:09.882869 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9838c909-0067-46e5-8e8c-cb055f55d364 admin admin] PATH_INFO: `/v3/users/e7a5bd8a10c84bfb9d4e6ebc87ba5191` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:09.884427 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9838c909-0067-46e5-8e8c-cb055f55d364 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7a5bd8a10c84bfb9d4e6ebc87ba5191)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:09.886506 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9838c909-0067-46e5-8e8c-cb055f55d364 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:09.895217 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 909/1792] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:30:09 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:30:09.896303 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab2e867-1ddc-4f84-94d8-e7e79cfb7d3c admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:09.913619 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab2e867-1ddc-4f84-94d8-e7e79cfb7d3c admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:09.918722 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7464a0ce-e689-4c16-aea4-2bb5ca607426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:09.919696 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7464a0ce-e689-4c16-aea4-2bb5ca607426 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:09.920030 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7464a0ce-e689-4c16-aea4-2bb5ca607426 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:09.920305 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7464a0ce-e689-4c16-aea4-2bb5ca607426 admin admin] PATH_INFO: `/v3/projects/2e17b3c1bb9843249b8965fe67618815/users/7bb879a51b684f76ab190eb11c9cdd28/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:09.922341 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7464a0ce-e689-4c16-aea4-2bb5ca607426 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e17b3c1bb9843249b8965fe67618815, user_id=7bb879a51b684f76ab190eb11c9cdd28, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:09.925050 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7464a0ce-e689-4c16-aea4-2bb5ca607426 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:09.946357 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 910/1793] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:30:09 2022] PUT /identity/v3/projects/2e17b3c1bb9843249b8965fe67618815/users/7bb879a51b684f76ab190eb11c9cdd28/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:30:09.957031 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4953152-abbd-43e4-a4e6-3875739db905 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:09.957365 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4953152-abbd-43e4-a4e6-3875739db905 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:09.957605 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4953152-abbd-43e4-a4e6-3875739db905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:09.963578 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:09.966269 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9838c909-0067-46e5-8e8c-cb055f55d364 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7a5bd8a10c84bfb9d4e6ebc87ba5191'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:09.967153 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9838c909-0067-46e5-8e8c-cb055f55d364 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7a5bd8a10c84bfb9d4e6ebc87ba5191'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:09.967867 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9838c909-0067-46e5-8e8c-cb055f55d364 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7a5bd8a10c84bfb9d4e6ebc87ba5191'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:09.989128 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9838c909-0067-46e5-8e8c-cb055f55d364 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7a5bd8a10c84bfb9d4e6ebc87ba5191'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:09.989889 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-f4953152-abbd-43e4-a4e6-3875739db905 None None] MFA Rules not processed for user `7bb879a51b684f76ab190eb11c9cdd28`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:30:09.991172 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-f4953152-abbd-43e4-a4e6-3875739db905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:09.997131 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9838c909-0067-46e5-8e8c-cb055f55d364 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7a5bd8a10c84bfb9d4e6ebc87ba5191'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:10.014106 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 884/1794] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:30:09 2022] DELETE /identity/v3/users/e7a5bd8a10c84bfb9d4e6ebc87ba5191 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:30:10.073581 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 911/1795] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:30:09 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:30:10.087564 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9838c909-0067-46e5-8e8c-cb055f55d364 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:10.087564 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9838c909-0067-46e5-8e8c-cb055f55d364 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:10.103226 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:10.178136 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9838c909-0067-46e5-8e8c-cb055f55d364 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:10.183636 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020007d6-61a2-4bc0-98f8-cc3b3e53a314 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:10.184510 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020007d6-61a2-4bc0-98f8-cc3b3e53a314 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:10.184823 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020007d6-61a2-4bc0-98f8-cc3b3e53a314 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:10.185368 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020007d6-61a2-4bc0-98f8-cc3b3e53a314 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:10.188625 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-020007d6-61a2-4bc0-98f8-cc3b3e53a314 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:10.236188 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4953152-abbd-43e4-a4e6-3875739db905 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:10.238055 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-f4953152-abbd-43e4-a4e6-3875739db905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:10.295783 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020007d6-61a2-4bc0-98f8-cc3b3e53a314 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:10.297363 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020007d6-61a2-4bc0-98f8-cc3b3e53a314 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:10.312514 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 885/1796] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:30:10 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:30:10.329650 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4953152-abbd-43e4-a4e6-3875739db905 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:10.424363 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad48a91f-32fc-4890-91e7-a1af6d102a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:10.425384 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48a91f-32fc-4890-91e7-a1af6d102a35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:10.425765 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48a91f-32fc-4890-91e7-a1af6d102a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:10.426279 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48a91f-32fc-4890-91e7-a1af6d102a35 admin admin] PATH_INFO: `/v3/projects/4547ea6fb1d448d692afe501814e603b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:10.441340 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad48a91f-32fc-4890-91e7-a1af6d102a35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4547ea6fb1d448d692afe501814e603b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:10.451002 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad48a91f-32fc-4890-91e7-a1af6d102a35 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:10.545722 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:10.570777 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-ad48a91f-32fc-4890-91e7-a1af6d102a35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4547ea6fb1d448d692afe501814e603b', 'request_id': 'req-ad48a91f-32fc-4890-91e7-a1af6d102a35'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:10.585506 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-ad48a91f-32fc-4890-91e7-a1af6d102a35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4547ea6fb1d448d692afe501814e603b', 'request_id': 'req-ad48a91f-32fc-4890-91e7-a1af6d102a35'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:10.600314 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-ad48a91f-32fc-4890-91e7-a1af6d102a35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4547ea6fb1d448d692afe501814e603b', 'request_id': 'req-ad48a91f-32fc-4890-91e7-a1af6d102a35'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:10.654238 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-ad48a91f-32fc-4890-91e7-a1af6d102a35 admin admin] The token cache is being invalidate because project 4547ea6fb1d448d692afe501814e603b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:30:10.654881 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-ad48a91f-32fc-4890-91e7-a1af6d102a35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:10.658638 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-ad48a91f-32fc-4890-91e7-a1af6d102a35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:10.676070 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 912/1797] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:30:10 2022] DELETE /identity/v3/projects/4547ea6fb1d448d692afe501814e603b => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:30:10.681269 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de05a0c6-4005-4f48-abe6-a567fb47a429 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:10.681625 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de05a0c6-4005-4f48-abe6-a567fb47a429 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:10.681996 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de05a0c6-4005-4f48-abe6-a567fb47a429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:10.726156 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-de05a0c6-4005-4f48-abe6-a567fb47a429 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:30:10.727407 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-de05a0c6-4005-4f48-abe6-a567fb47a429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:10.865201 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 886/1798] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:30:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:30:10.872148 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba33b3b-899f-45fc-8150-2deda7aa2971 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:10.872960 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba33b3b-899f-45fc-8150-2deda7aa2971 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:10.875999 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba33b3b-899f-45fc-8150-2deda7aa2971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:10.937537 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-eba33b3b-899f-45fc-8150-2deda7aa2971 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:30:10.938755 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-eba33b3b-899f-45fc-8150-2deda7aa2971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:10.966842 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 913/1799] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:30:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 03:30:10.969760 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de05a0c6-4005-4f48-abe6-a567fb47a429 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:10.982963 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de05a0c6-4005-4f48-abe6-a567fb47a429 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:10.993837 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bfcaf6-cc8a-4dae-8023-8b79d03ce650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:10.994686 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bfcaf6-cc8a-4dae-8023-8b79d03ce650 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:10.995232 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bfcaf6-cc8a-4dae-8023-8b79d03ce650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:10.995641 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bfcaf6-cc8a-4dae-8023-8b79d03ce650 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:10.996655 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bfcaf6-cc8a-4dae-8023-8b79d03ce650 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:30:10.997253 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bfcaf6-cc8a-4dae-8023-8b79d03ce650 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:10.999586 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bfcaf6-cc8a-4dae-8023-8b79d03ce650 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:11.036006 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 887/1800] 10.222.0.60 () {58 vars in 1152 bytes} [Sat Jul 2 03:30:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:30:11.037284 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba33b3b-899f-45fc-8150-2deda7aa2971 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:11.060183 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba33b3b-899f-45fc-8150-2deda7aa2971 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:11.075579 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e3d879-f781-4ccf-9a35-1b2853a065d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:11.076422 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e3d879-f781-4ccf-9a35-1b2853a065d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:11.076809 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e3d879-f781-4ccf-9a35-1b2853a065d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:11.077174 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e3d879-f781-4ccf-9a35-1b2853a065d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:11.078130 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e3d879-f781-4ccf-9a35-1b2853a065d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:11.080485 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e3d879-f781-4ccf-9a35-1b2853a065d5 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:11.130328 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 914/1801] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:30:11 2022] POST /identity/v3/projects => generated 377 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:30:11.131412 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bfcaf6-cc8a-4dae-8023-8b79d03ce650 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:11.152847 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bfcaf6-cc8a-4dae-8023-8b79d03ce650 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:11.230235 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:11.243844 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5369c9-65db-46ee-b47e-2cce4fdf6348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:11.244535 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5369c9-65db-46ee-b47e-2cce4fdf6348 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:11.244821 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5369c9-65db-46ee-b47e-2cce4fdf6348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:11.245105 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5369c9-65db-46ee-b47e-2cce4fdf6348 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:11.245823 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5369c9-65db-46ee-b47e-2cce4fdf6348 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:11.247849 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5369c9-65db-46ee-b47e-2cce4fdf6348 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:11.275090 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 888/1802] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:30:11 2022] POST /identity/v3/users => generated 289 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 03:30:11.278994 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e3d879-f781-4ccf-9a35-1b2853a065d5 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:11.296837 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e3d879-f781-4ccf-9a35-1b2853a065d5 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:11.309878 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b42193f-a5d7-4101-beeb-688986a5bba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:11.311332 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42193f-a5d7-4101-beeb-688986a5bba8 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:11.311746 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42193f-a5d7-4101-beeb-688986a5bba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:11.312161 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42193f-a5d7-4101-beeb-688986a5bba8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:11.313011 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b42193f-a5d7-4101-beeb-688986a5bba8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:11.315049 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b42193f-a5d7-4101-beeb-688986a5bba8 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:11.327633 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 915/1803] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:30:11 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 03:30:11.332156 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5369c9-65db-46ee-b47e-2cce4fdf6348 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:11.352048 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5369c9-65db-46ee-b47e-2cce4fdf6348 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:11.357845 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46647061-106b-48f3-a6cf-8f9e29701c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:11.358645 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46647061-106b-48f3-a6cf-8f9e29701c95 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:11.359062 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46647061-106b-48f3-a6cf-8f9e29701c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:11.359497 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46647061-106b-48f3-a6cf-8f9e29701c95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:11.360450 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46647061-106b-48f3-a6cf-8f9e29701c95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:11.362493 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46647061-106b-48f3-a6cf-8f9e29701c95 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:11.381248 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 889/1804] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:30:11 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:30:11.385110 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b42193f-a5d7-4101-beeb-688986a5bba8 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:11.395827 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b42193f-a5d7-4101-beeb-688986a5bba8 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:11.401698 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc6fc2-15a1-4b9e-a53b-2d3d921044ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:11.402604 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc6fc2-15a1-4b9e-a53b-2d3d921044ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:11.402886 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc6fc2-15a1-4b9e-a53b-2d3d921044ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:11.403183 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc6fc2-15a1-4b9e-a53b-2d3d921044ab admin admin] PATH_INFO: `/v3/projects/ed653008a8384034b0e79f8f65b8b0f3/users/6eb7add637ea47278e6ac71d0251a5b3/roles/c43aada0326446c4ade0ab1262918fa4` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:11.423869 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dc6fc2-15a1-4b9e-a53b-2d3d921044ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed653008a8384034b0e79f8f65b8b0f3, user_id=6eb7add637ea47278e6ac71d0251a5b3, role_id=c43aada0326446c4ade0ab1262918fa4)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:11.426534 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dc6fc2-15a1-4b9e-a53b-2d3d921044ab admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:11.441726 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 916/1805] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:30:11 2022] PUT /identity/v3/projects/ed653008a8384034b0e79f8f65b8b0f3/users/6eb7add637ea47278e6ac71d0251a5b3/roles/c43aada0326446c4ade0ab1262918fa4 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 03:30:11.452168 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa892106-445a-47f2-bf34-e2e150f638ea None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:11.452457 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa892106-445a-47f2-bf34-e2e150f638ea None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:11.452731 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa892106-445a-47f2-bf34-e2e150f638ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:11.480282 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-fa892106-445a-47f2-bf34-e2e150f638ea None None] MFA Rules not processed for user `6eb7add637ea47278e6ac71d0251a5b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:30:11.481476 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-fa892106-445a-47f2-bf34-e2e150f638ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:11.548708 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 890/1806] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:30:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:30:11.553239 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc6fc2-15a1-4b9e-a53b-2d3d921044ab admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:11.627417 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc6fc2-15a1-4b9e-a53b-2d3d921044ab admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:11.636642 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b2858f-ca07-425b-81c3-bb3cc2cfd133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:11.637187 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2858f-ca07-425b-81c3-bb3cc2cfd133 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:11.637481 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2858f-ca07-425b-81c3-bb3cc2cfd133 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:11.637756 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2858f-ca07-425b-81c3-bb3cc2cfd133 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:11.638536 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b2858f-ca07-425b-81c3-bb3cc2cfd133 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:11.640868 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b2858f-ca07-425b-81c3-bb3cc2cfd133 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:11.669695 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 917/1807] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:30:11 2022] POST /identity/v3/projects => generated 377 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:30:11.674084 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa892106-445a-47f2-bf34-e2e150f638ea None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:11.685286 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa892106-445a-47f2-bf34-e2e150f638ea None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:11.742701 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5892ae21-0019-4888-bb43-24caac28ec78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:11.743403 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892ae21-0019-4888-bb43-24caac28ec78 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:11.743684 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892ae21-0019-4888-bb43-24caac28ec78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:11.743959 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892ae21-0019-4888-bb43-24caac28ec78 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:11.744690 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5892ae21-0019-4888-bb43-24caac28ec78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:11.746619 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5892ae21-0019-4888-bb43-24caac28ec78 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:11.767024 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 891/1808] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:30:11 2022] POST /identity/v3/users => generated 295 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 03:30:11.771390 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b2858f-ca07-425b-81c3-bb3cc2cfd133 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:11.782970 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b2858f-ca07-425b-81c3-bb3cc2cfd133 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:11.787949 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c76cc-9855-4507-aee4-1913fb16c598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:11.788605 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c76cc-9855-4507-aee4-1913fb16c598 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:11.788886 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c76cc-9855-4507-aee4-1913fb16c598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:11.789156 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c76cc-9855-4507-aee4-1913fb16c598 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:11.789883 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86c76cc-9855-4507-aee4-1913fb16c598 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:11.791842 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86c76cc-9855-4507-aee4-1913fb16c598 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:11.802767 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 918/1809] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:30:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:30:11.807025 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5892ae21-0019-4888-bb43-24caac28ec78 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:11.818794 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5892ae21-0019-4888-bb43-24caac28ec78 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:11.824976 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1327e073-cf2d-4819-ba1e-18a1428d3810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:11.825866 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1327e073-cf2d-4819-ba1e-18a1428d3810 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:11.826143 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1327e073-cf2d-4819-ba1e-18a1428d3810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:11.826418 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1327e073-cf2d-4819-ba1e-18a1428d3810 admin admin] PATH_INFO: `/v3/projects/1eff73f7e5af435c91354d633d12ec9b/users/78f8a799e4394c4a9244934856dc4902/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:11.843079 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1327e073-cf2d-4819-ba1e-18a1428d3810 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eff73f7e5af435c91354d633d12ec9b, user_id=78f8a799e4394c4a9244934856dc4902, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:11.845874 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1327e073-cf2d-4819-ba1e-18a1428d3810 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:11.861414 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 892/1810] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:30:11 2022] PUT /identity/v3/projects/1eff73f7e5af435c91354d633d12ec9b/users/78f8a799e4394c4a9244934856dc4902/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:30:11.865656 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c76cc-9855-4507-aee4-1913fb16c598 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:11.875774 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c76cc-9855-4507-aee4-1913fb16c598 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:11.910660 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:11.937578 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d25546e-2458-4a09-91fd-e96ba0ed786e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:11.938256 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25546e-2458-4a09-91fd-e96ba0ed786e admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:11.938531 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25546e-2458-4a09-91fd-e96ba0ed786e admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:11.938794 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25546e-2458-4a09-91fd-e96ba0ed786e admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:11.939529 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d25546e-2458-4a09-91fd-e96ba0ed786e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:11.941112 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d25546e-2458-4a09-91fd-e96ba0ed786e admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:11.951285 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 919/1811] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:30:11 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:30:11.955527 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1327e073-cf2d-4819-ba1e-18a1428d3810 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:11.966630 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1327e073-cf2d-4819-ba1e-18a1428d3810 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:11.971636 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a222642c-2bd1-4582-ab97-6c8a799f5507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:11.972536 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222642c-2bd1-4582-ab97-6c8a799f5507 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:11.972797 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222642c-2bd1-4582-ab97-6c8a799f5507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:11.973078 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222642c-2bd1-4582-ab97-6c8a799f5507 admin admin] PATH_INFO: `/v3/projects/1eff73f7e5af435c91354d633d12ec9b/users/78f8a799e4394c4a9244934856dc4902/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:11.975074 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a222642c-2bd1-4582-ab97-6c8a799f5507 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eff73f7e5af435c91354d633d12ec9b, user_id=78f8a799e4394c4a9244934856dc4902, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:11.977804 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a222642c-2bd1-4582-ab97-6c8a799f5507 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:11.987918 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 893/1812] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:30:11 2022] PUT /identity/v3/projects/1eff73f7e5af435c91354d633d12ec9b/users/78f8a799e4394c4a9244934856dc4902/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 03:30:11.999552 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f105e0-9114-47f2-b709-693a152d4c07 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:11.999898 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f105e0-9114-47f2-b709-693a152d4c07 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:12.000247 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f105e0-9114-47f2-b709-693a152d4c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:12.031004 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-27f105e0-9114-47f2-b709-693a152d4c07 None None] MFA Rules not processed for user `78f8a799e4394c4a9244934856dc4902`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:30:12.032627 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-27f105e0-9114-47f2-b709-693a152d4c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:12.155286 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 920/1813] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:30:11 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:30:12.172053 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a222642c-2bd1-4582-ab97-6c8a799f5507 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:12.174150 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a222642c-2bd1-4582-ab97-6c8a799f5507 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:12.196206 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:12.285526 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a222642c-2bd1-4582-ab97-6c8a799f5507 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:12.290686 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63f6fb-6e1d-4b41-81eb-064c4dbbcd69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:12.291705 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63f6fb-6e1d-4b41-81eb-064c4dbbcd69 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:12.291983 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63f6fb-6e1d-4b41-81eb-064c4dbbcd69 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:12.292238 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63f6fb-6e1d-4b41-81eb-064c4dbbcd69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:12.367760 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb63f6fb-6e1d-4b41-81eb-064c4dbbcd69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:12.369142 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb63f6fb-6e1d-4b41-81eb-064c4dbbcd69 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:12.383235 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 894/1814] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:30:12 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:30:13.379053 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f105e0-9114-47f2-b709-693a152d4c07 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:13.406895 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f105e0-9114-47f2-b709-693a152d4c07 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:13.417027 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f282d22-4494-4baf-a178-0d5aff92e578 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:13.417693 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f282d22-4494-4baf-a178-0d5aff92e578 service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:13.417975 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f282d22-4494-4baf-a178-0d5aff92e578 service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:13.418248 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f282d22-4494-4baf-a178-0d5aff92e578 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:13.420514 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-2f282d22-4494-4baf-a178-0d5aff92e578 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:13.502243 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f282d22-4494-4baf-a178-0d5aff92e578 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:13.503933 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f282d22-4494-4baf-a178-0d5aff92e578 service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:13.514296 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 921/1815] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:30:13 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:30:13.797172 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63f6fb-6e1d-4b41-81eb-064c4dbbcd69 service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:13.806096 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63f6fb-6e1d-4b41-81eb-064c4dbbcd69 service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:13.813793 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75313e29-15b0-4154-bc85-a3a8fc41faf3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:13.814527 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75313e29-15b0-4154-bc85-a3a8fc41faf3 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:13.814780 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75313e29-15b0-4154-bc85-a3a8fc41faf3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:13.815095 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75313e29-15b0-4154-bc85-a3a8fc41faf3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:13.825272 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75313e29-15b0-4154-bc85-a3a8fc41faf3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:13.827050 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75313e29-15b0-4154-bc85-a3a8fc41faf3 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:13.838654 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 895/1816] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:30:13 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:30:15.095967 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f282d22-4494-4baf-a178-0d5aff92e578 service cinder] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:15.097530 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-2f282d22-4494-4baf-a178-0d5aff92e578 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:15.177398 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:15.194345 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f282d22-4494-4baf-a178-0d5aff92e578 service cinder] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:15.201180 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9fb0ef-536d-4e3b-868a-5581787d259c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:15.202122 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9fb0ef-536d-4e3b-868a-5581787d259c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:15.202422 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9fb0ef-536d-4e3b-868a-5581787d259c admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:15.202733 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9fb0ef-536d-4e3b-868a-5581787d259c admin admin] PATH_INFO: `/v3/users/a732fa2ee0eb48bbab89a6d6b73cef14` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:15.204118 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9fb0ef-536d-4e3b-868a-5581787d259c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a732fa2ee0eb48bbab89a6d6b73cef14)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:15.206105 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9fb0ef-536d-4e3b-868a-5581787d259c admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:15.283596 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-9e9fb0ef-536d-4e3b-868a-5581787d259c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a732fa2ee0eb48bbab89a6d6b73cef14'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:15.284422 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-9e9fb0ef-536d-4e3b-868a-5581787d259c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a732fa2ee0eb48bbab89a6d6b73cef14'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:15.293432 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-9e9fb0ef-536d-4e3b-868a-5581787d259c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a732fa2ee0eb48bbab89a6d6b73cef14'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:15.294705 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-9e9fb0ef-536d-4e3b-868a-5581787d259c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a732fa2ee0eb48bbab89a6d6b73cef14'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:15.308341 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-9e9fb0ef-536d-4e3b-868a-5581787d259c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a732fa2ee0eb48bbab89a6d6b73cef14'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:15.322242 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 922/1817] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:30:15 2022] DELETE /identity/v3/users/a732fa2ee0eb48bbab89a6d6b73cef14 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:30:15.326868 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244aaa4-c8f5-4ea3-86b9-6c1f01b59f1c None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:15.327413 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244aaa4-c8f5-4ea3-86b9-6c1f01b59f1c None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:15.327507 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244aaa4-c8f5-4ea3-86b9-6c1f01b59f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:15.351790 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-9244aaa4-c8f5-4ea3-86b9-6c1f01b59f1c None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:30:15.352994 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9244aaa4-c8f5-4ea3-86b9-6c1f01b59f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:15.436259 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 896/1818] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:30:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:30:15.446444 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9fb0ef-536d-4e3b-868a-5581787d259c admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:15.448190 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-9e9fb0ef-536d-4e3b-868a-5581787d259c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:15.510567 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9fb0ef-536d-4e3b-868a-5581787d259c admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:15.514459 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb13de4-1017-4a9a-b4be-15f1eae5c726 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:15.515111 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb13de4-1017-4a9a-b4be-15f1eae5c726 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:15.515413 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb13de4-1017-4a9a-b4be-15f1eae5c726 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:15.515686 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb13de4-1017-4a9a-b4be-15f1eae5c726 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:15.525214 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb13de4-1017-4a9a-b4be-15f1eae5c726 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:15.526634 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb13de4-1017-4a9a-b4be-15f1eae5c726 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:15.536235 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 923/1819] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:30:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:30:15.809745 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9244aaa4-c8f5-4ea3-86b9-6c1f01b59f1c None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:15.812124 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9244aaa4-c8f5-4ea3-86b9-6c1f01b59f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:15.838019 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9244aaa4-c8f5-4ea3-86b9-6c1f01b59f1c None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:15.844095 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dedcec-fe2c-4403-9469-06988d5395f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:15.845350 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dedcec-fe2c-4403-9469-06988d5395f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:15.845808 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dedcec-fe2c-4403-9469-06988d5395f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:15.846331 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dedcec-fe2c-4403-9469-06988d5395f8 admin admin] PATH_INFO: `/v3/projects/13d7a18399114dfba7d0dfb4e1d51ab3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:15.848084 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dedcec-fe2c-4403-9469-06988d5395f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13d7a18399114dfba7d0dfb4e1d51ab3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:15.851840 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dedcec-fe2c-4403-9469-06988d5395f8 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:15.913663 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:15.915728 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-76dedcec-fe2c-4403-9469-06988d5395f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13d7a18399114dfba7d0dfb4e1d51ab3', 'request_id': 'req-76dedcec-fe2c-4403-9469-06988d5395f8'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:15.925226 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-76dedcec-fe2c-4403-9469-06988d5395f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13d7a18399114dfba7d0dfb4e1d51ab3', 'request_id': 'req-76dedcec-fe2c-4403-9469-06988d5395f8'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:15.937211 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-76dedcec-fe2c-4403-9469-06988d5395f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13d7a18399114dfba7d0dfb4e1d51ab3', 'request_id': 'req-76dedcec-fe2c-4403-9469-06988d5395f8'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:15.952558 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-76dedcec-fe2c-4403-9469-06988d5395f8 admin admin] The token cache is being invalidate because project 13d7a18399114dfba7d0dfb4e1d51ab3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:30:15.952874 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-76dedcec-fe2c-4403-9469-06988d5395f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:15.953522 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-76dedcec-fe2c-4403-9469-06988d5395f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:15.955100 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 897/1820] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:30:15 2022] DELETE /identity/v3/projects/13d7a18399114dfba7d0dfb4e1d51ab3 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:30:15.960146 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8f9d9d-1ba0-4405-8efe-48e0207f2e3c None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:15.960429 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8f9d9d-1ba0-4405-8efe-48e0207f2e3c None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:15.960726 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8f9d9d-1ba0-4405-8efe-48e0207f2e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:15.979530 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-be8f9d9d-1ba0-4405-8efe-48e0207f2e3c None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:30:15.980760 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-be8f9d9d-1ba0-4405-8efe-48e0207f2e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:16.043039 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 924/1821] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:30:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:30:16.050977 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fe296-1c1a-4afb-aac5-ea5bcc643eac None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:16.051295 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fe296-1c1a-4afb-aac5-ea5bcc643eac None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:16.051576 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fe296-1c1a-4afb-aac5-ea5bcc643eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:16.070628 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-008fe296-1c1a-4afb-aac5-ea5bcc643eac None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:30:16.071838 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-008fe296-1c1a-4afb-aac5-ea5bcc643eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:16.080122 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 898/1822] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:30:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:30:16.084364 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8f9d9d-1ba0-4405-8efe-48e0207f2e3c None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:16.093943 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8f9d9d-1ba0-4405-8efe-48e0207f2e3c None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:16.098679 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851c1623-0e53-48a8-a0bb-7da8a05f8e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:16.099414 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c1623-0e53-48a8-a0bb-7da8a05f8e3b admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:16.099678 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c1623-0e53-48a8-a0bb-7da8a05f8e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:16.099945 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c1623-0e53-48a8-a0bb-7da8a05f8e3b admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:16.100665 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851c1623-0e53-48a8-a0bb-7da8a05f8e3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:30:16.100963 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851c1623-0e53-48a8-a0bb-7da8a05f8e3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:16.102557 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851c1623-0e53-48a8-a0bb-7da8a05f8e3b admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:16.111074 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:16.115378 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 925/1823] 10.222.0.60 () {58 vars in 1152 bytes} [Sat Jul 2 03:30:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:30:16.119820 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008fe296-1c1a-4afb-aac5-ea5bcc643eac None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:16.129293 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008fe296-1c1a-4afb-aac5-ea5bcc643eac None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:16.136933 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338e6d93-765d-494a-a0c4-c8f9a9bf8589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:16.137898 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338e6d93-765d-494a-a0c4-c8f9a9bf8589 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:16.138365 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338e6d93-765d-494a-a0c4-c8f9a9bf8589 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:16.138725 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338e6d93-765d-494a-a0c4-c8f9a9bf8589 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:16.139778 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338e6d93-765d-494a-a0c4-c8f9a9bf8589 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:16.142474 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338e6d93-765d-494a-a0c4-c8f9a9bf8589 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:16.180193 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 899/1824] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:30:16 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:30:16.184245 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851c1623-0e53-48a8-a0bb-7da8a05f8e3b admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:16.194592 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851c1623-0e53-48a8-a0bb-7da8a05f8e3b admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:16.252665 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dceb133-70af-4e39-883c-d2691681c382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:16.253412 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dceb133-70af-4e39-883c-d2691681c382 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:16.253736 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dceb133-70af-4e39-883c-d2691681c382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:16.254071 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dceb133-70af-4e39-883c-d2691681c382 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:16.254893 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dceb133-70af-4e39-883c-d2691681c382 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:16.257171 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dceb133-70af-4e39-883c-d2691681c382 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:16.282203 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 926/1825] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:30:16 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:30:16.283487 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338e6d93-765d-494a-a0c4-c8f9a9bf8589 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:16.295454 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338e6d93-765d-494a-a0c4-c8f9a9bf8589 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:16.305201 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d075305-e62b-44ad-9fce-a02414fdcae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:16.305857 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d075305-e62b-44ad-9fce-a02414fdcae1 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:16.306192 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d075305-e62b-44ad-9fce-a02414fdcae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:16.306475 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d075305-e62b-44ad-9fce-a02414fdcae1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:16.307267 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d075305-e62b-44ad-9fce-a02414fdcae1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:16.308879 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d075305-e62b-44ad-9fce-a02414fdcae1 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:16.320828 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 900/1826] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:30:16 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:30:16.324814 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dceb133-70af-4e39-883c-d2691681c382 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:16.335612 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dceb133-70af-4e39-883c-d2691681c382 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:16.341202 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67172c22-32e1-4dfc-9882-85357095d020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:16.341875 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67172c22-32e1-4dfc-9882-85357095d020 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:16.342153 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67172c22-32e1-4dfc-9882-85357095d020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:16.342422 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67172c22-32e1-4dfc-9882-85357095d020 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:16.343175 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67172c22-32e1-4dfc-9882-85357095d020 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:16.344800 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67172c22-32e1-4dfc-9882-85357095d020 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:16.355682 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 927/1827] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:30:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:30:16.359922 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d075305-e62b-44ad-9fce-a02414fdcae1 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:16.370543 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d075305-e62b-44ad-9fce-a02414fdcae1 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:16.374947 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c8b728-281f-4a0c-9b68-bff50d115347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:16.375865 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8b728-281f-4a0c-9b68-bff50d115347 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:16.376145 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8b728-281f-4a0c-9b68-bff50d115347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:16.376420 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8b728-281f-4a0c-9b68-bff50d115347 admin admin] PATH_INFO: `/v3/projects/7342b3d695634e7fa265e4460e1b60db/users/bcb684b7b4ed414997054a11dd90a620/roles/c43aada0326446c4ade0ab1262918fa4` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:16.391888 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c8b728-281f-4a0c-9b68-bff50d115347 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7342b3d695634e7fa265e4460e1b60db, user_id=bcb684b7b4ed414997054a11dd90a620, role_id=c43aada0326446c4ade0ab1262918fa4)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:16.394538 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c8b728-281f-4a0c-9b68-bff50d115347 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:16.412898 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 901/1828] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:30:16 2022] PUT /identity/v3/projects/7342b3d695634e7fa265e4460e1b60db/users/bcb684b7b4ed414997054a11dd90a620/roles/c43aada0326446c4ade0ab1262918fa4 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:30:16.423468 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93a3c1-b71d-4b39-8115-1188080bf3e5 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:16.423840 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93a3c1-b71d-4b39-8115-1188080bf3e5 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:16.424189 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93a3c1-b71d-4b39-8115-1188080bf3e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:16.454866 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-3d93a3c1-b71d-4b39-8115-1188080bf3e5 None None] MFA Rules not processed for user `bcb684b7b4ed414997054a11dd90a620`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:30:16.456218 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-3d93a3c1-b71d-4b39-8115-1188080bf3e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:16.559178 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 928/1829] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:30:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:30:16.563556 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c8b728-281f-4a0c-9b68-bff50d115347 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:16.657842 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c8b728-281f-4a0c-9b68-bff50d115347 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:16.663933 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cc830c-a322-4586-9028-16dc5b08a9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:16.665076 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc830c-a322-4586-9028-16dc5b08a9a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:16.665594 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc830c-a322-4586-9028-16dc5b08a9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:16.666049 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc830c-a322-4586-9028-16dc5b08a9a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:16.667321 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cc830c-a322-4586-9028-16dc5b08a9a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:16.670250 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cc830c-a322-4586-9028-16dc5b08a9a3 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:16.708772 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 902/1830] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:30:16 2022] POST /identity/v3/projects => generated 369 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:30:16.712927 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d93a3c1-b71d-4b39-8115-1188080bf3e5 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:16.730751 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d93a3c1-b71d-4b39-8115-1188080bf3e5 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:16.785502 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a44774f-b3b7-410a-a4f8-346063fca716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:16.786383 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44774f-b3b7-410a-a4f8-346063fca716 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:16.786672 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44774f-b3b7-410a-a4f8-346063fca716 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:16.786989 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44774f-b3b7-410a-a4f8-346063fca716 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:16.787736 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a44774f-b3b7-410a-a4f8-346063fca716 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:16.789785 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a44774f-b3b7-410a-a4f8-346063fca716 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:16.805854 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:16.812647 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 929/1831] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:30:16 2022] POST /identity/v3/users => generated 291 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:30:16.816686 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cc830c-a322-4586-9028-16dc5b08a9a3 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:16.827409 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cc830c-a322-4586-9028-16dc5b08a9a3 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:16.832429 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee2123-8ac2-4b77-b27c-3543ce47d0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:16.833108 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee2123-8ac2-4b77-b27c-3543ce47d0b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:16.833403 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee2123-8ac2-4b77-b27c-3543ce47d0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:16.833681 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee2123-8ac2-4b77-b27c-3543ce47d0b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:16.835077 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bee2123-8ac2-4b77-b27c-3543ce47d0b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:16.836097 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bee2123-8ac2-4b77-b27c-3543ce47d0b1 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:16.847381 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 903/1832] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:30:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:30:16.851874 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a44774f-b3b7-410a-a4f8-346063fca716 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:16.862008 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a44774f-b3b7-410a-a4f8-346063fca716 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:16.866953 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99642f82-7101-49e3-a0ec-d66077b85074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:16.867889 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99642f82-7101-49e3-a0ec-d66077b85074 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:16.868178 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99642f82-7101-49e3-a0ec-d66077b85074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:16.868442 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99642f82-7101-49e3-a0ec-d66077b85074 admin admin] PATH_INFO: `/v3/projects/2ba9ef9e71074c32bb5e2c70e4653d41/users/f22d8eb2df794d9c8218e4d2580b690b/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:16.885002 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99642f82-7101-49e3-a0ec-d66077b85074 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ba9ef9e71074c32bb5e2c70e4653d41, user_id=f22d8eb2df794d9c8218e4d2580b690b, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:16.887897 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99642f82-7101-49e3-a0ec-d66077b85074 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:16.902196 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 930/1833] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:30:16 2022] PUT /identity/v3/projects/2ba9ef9e71074c32bb5e2c70e4653d41/users/f22d8eb2df794d9c8218e4d2580b690b/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:30:16.906335 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee2123-8ac2-4b77-b27c-3543ce47d0b1 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:16.916968 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee2123-8ac2-4b77-b27c-3543ce47d0b1 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:16.966627 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:16.986964 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330093d9-02b1-4c2c-9ee9-c9aebf1e6a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:16.987926 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330093d9-02b1-4c2c-9ee9-c9aebf1e6a77 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:16.988278 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330093d9-02b1-4c2c-9ee9-c9aebf1e6a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:16.988644 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330093d9-02b1-4c2c-9ee9-c9aebf1e6a77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:16.989499 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330093d9-02b1-4c2c-9ee9-c9aebf1e6a77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:16.991724 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330093d9-02b1-4c2c-9ee9-c9aebf1e6a77 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:17.006532 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 904/1834] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:30:16 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:30:17.007889 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99642f82-7101-49e3-a0ec-d66077b85074 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:17.018412 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99642f82-7101-49e3-a0ec-d66077b85074 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:17.023799 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf9df9-20a5-45b0-875f-485f30fb455d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:17.024766 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf9df9-20a5-45b0-875f-485f30fb455d admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:17.025126 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf9df9-20a5-45b0-875f-485f30fb455d admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:17.027537 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf9df9-20a5-45b0-875f-485f30fb455d admin admin] PATH_INFO: `/v3/projects/2ba9ef9e71074c32bb5e2c70e4653d41/users/f22d8eb2df794d9c8218e4d2580b690b/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:17.029980 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edf9df9-20a5-45b0-875f-485f30fb455d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ba9ef9e71074c32bb5e2c70e4653d41, user_id=f22d8eb2df794d9c8218e4d2580b690b, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:17.032732 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edf9df9-20a5-45b0-875f-485f30fb455d admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:17.050354 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 931/1835] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:30:17 2022] PUT /identity/v3/projects/2ba9ef9e71074c32bb5e2c70e4653d41/users/f22d8eb2df794d9c8218e4d2580b690b/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:30:17.065334 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0cf732-e712-4f85-b2be-09a5224c6d57 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:17.065627 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0cf732-e712-4f85-b2be-09a5224c6d57 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:17.065906 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0cf732-e712-4f85-b2be-09a5224c6d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:17.101178 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-fe0cf732-e712-4f85-b2be-09a5224c6d57 None None] MFA Rules not processed for user `f22d8eb2df794d9c8218e4d2580b690b`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:30:17.102614 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-fe0cf732-e712-4f85-b2be-09a5224c6d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:17.176532 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 905/1836] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:30:17 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:30:17.188581 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf9df9-20a5-45b0-875f-485f30fb455d admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:17.190427 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-1edf9df9-20a5-45b0-875f-485f30fb455d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:17.253916 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf9df9-20a5-45b0-875f-485f30fb455d admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:17.257821 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db76b32-e5cc-4127-bf9b-ad9f4448257a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:17.258469 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db76b32-e5cc-4127-bf9b-ad9f4448257a service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:17.258750 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db76b32-e5cc-4127-bf9b-ad9f4448257a service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:17.259027 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db76b32-e5cc-4127-bf9b-ad9f4448257a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:17.269323 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db76b32-e5cc-4127-bf9b-ad9f4448257a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:17.270837 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db76b32-e5cc-4127-bf9b-ad9f4448257a service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:17.280889 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 932/1837] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:30:17 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:30:17.532342 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b69240-4d19-43b2-be96-7f0a5aa9a764 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:17.532848 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b69240-4d19-43b2-be96-7f0a5aa9a764 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:17.532848 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b69240-4d19-43b2-be96-7f0a5aa9a764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:17.570440 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-42b69240-4d19-43b2-be96-7f0a5aa9a764 None None] MFA Rules not processed for user `b0e8a3ba6f84477bb9b4780918f357c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:30:17.571957 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-42b69240-4d19-43b2-be96-7f0a5aa9a764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:17.647968 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 906/1838] 10.222.0.64 () {58 vars in 1015 bytes} [Sat Jul 2 03:30:17 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:30:17.797152 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db76b32-e5cc-4127-bf9b-ad9f4448257a service cinder] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:17.798988 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-0db76b32-e5cc-4127-bf9b-ad9f4448257a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:17.840076 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db76b32-e5cc-4127-bf9b-ad9f4448257a service cinder] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:17.852955 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c652f4f5-8ddd-4c50-b9b0-9ca06d79f2fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:17.862456 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b69240-4d19-43b2-be96-7f0a5aa9a764 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:17.864638 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c652f4f5-8ddd-4c50-b9b0-9ca06d79f2fa service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:17.864954 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c652f4f5-8ddd-4c50-b9b0-9ca06d79f2fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:17.865226 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c652f4f5-8ddd-4c50-b9b0-9ca06d79f2fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:17.893848 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c652f4f5-8ddd-4c50-b9b0-9ca06d79f2fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:17.898354 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c652f4f5-8ddd-4c50-b9b0-9ca06d79f2fa service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:17.928577 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 933/1839] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:30:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:30:17.930651 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c652f4f5-8ddd-4c50-b9b0-9ca06d79f2fa service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:17.936172 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-c652f4f5-8ddd-4c50-b9b0-9ca06d79f2fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:18.029322 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b69240-4d19-43b2-be96-7f0a5aa9a764 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:18.054558 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c2788-11b5-4314-8379-cbd004a9b6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:18.055730 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c2788-11b5-4314-8379-cbd004a9b6de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:18.056138 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c2788-11b5-4314-8379-cbd004a9b6de admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:18.056471 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c2788-11b5-4314-8379-cbd004a9b6de admin admin] PATH_INFO: `/v3/users/bcb684b7b4ed414997054a11dd90a620` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:18.057960 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602c2788-11b5-4314-8379-cbd004a9b6de admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcb684b7b4ed414997054a11dd90a620)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:18.060040 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602c2788-11b5-4314-8379-cbd004a9b6de admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:18.061248 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c652f4f5-8ddd-4c50-b9b0-9ca06d79f2fa service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:18.072061 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0276058-7480-4735-a4cd-e1c729e3a7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:18.073182 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0276058-7480-4735-a4cd-e1c729e3a7d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:18.073503 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0276058-7480-4735-a4cd-e1c729e3a7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:18.074024 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0276058-7480-4735-a4cd-e1c729e3a7d1 admin admin] PATH_INFO: `/v3/users/6eb7add637ea47278e6ac71d0251a5b3` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:18.075229 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0276058-7480-4735-a4cd-e1c729e3a7d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6eb7add637ea47278e6ac71d0251a5b3)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:18.077209 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0276058-7480-4735-a4cd-e1c729e3a7d1 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:18.102807 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:18.196286 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-b0276058-7480-4735-a4cd-e1c729e3a7d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6eb7add637ea47278e6ac71d0251a5b3'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:18.197433 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-b0276058-7480-4735-a4cd-e1c729e3a7d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6eb7add637ea47278e6ac71d0251a5b3'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:18.200176 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-602c2788-11b5-4314-8379-cbd004a9b6de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcb684b7b4ed414997054a11dd90a620'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:18.201624 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-602c2788-11b5-4314-8379-cbd004a9b6de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcb684b7b4ed414997054a11dd90a620'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:18.202244 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:18.203326 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-602c2788-11b5-4314-8379-cbd004a9b6de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcb684b7b4ed414997054a11dd90a620'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:18.223200 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-b0276058-7480-4735-a4cd-e1c729e3a7d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6eb7add637ea47278e6ac71d0251a5b3'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:18.224489 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-b0276058-7480-4735-a4cd-e1c729e3a7d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6eb7add637ea47278e6ac71d0251a5b3'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:18.256564 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-602c2788-11b5-4314-8379-cbd004a9b6de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcb684b7b4ed414997054a11dd90a620'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:18.277666 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-b0276058-7480-4735-a4cd-e1c729e3a7d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6eb7add637ea47278e6ac71d0251a5b3'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:18.287814 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-602c2788-11b5-4314-8379-cbd004a9b6de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcb684b7b4ed414997054a11dd90a620'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:18.308431 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 934/1840] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:30:17 2022] DELETE /identity/v3/users/6eb7add637ea47278e6ac71d0251a5b3 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:30:18.318503 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 907/1841] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:30:17 2022] DELETE /identity/v3/users/bcb684b7b4ed414997054a11dd90a620 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:30:18.320054 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf34a1-451c-45fb-a48d-93a126035907 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:18.320446 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf34a1-451c-45fb-a48d-93a126035907 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:18.320711 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06bbbc6-44ac-4b14-8263-38f1de87dff9 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:18.320819 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf34a1-451c-45fb-a48d-93a126035907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:18.321009 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06bbbc6-44ac-4b14-8263-38f1de87dff9 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:18.321292 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06bbbc6-44ac-4b14-8263-38f1de87dff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:18.351203 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-c06bbbc6-44ac-4b14-8263-38f1de87dff9 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:30:18.352610 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-c06bbbc6-44ac-4b14-8263-38f1de87dff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:18.357200 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-4faf34a1-451c-45fb-a48d-93a126035907 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:30:18.366844 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4faf34a1-451c-45fb-a48d-93a126035907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:18.476881 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 908/1842] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:30:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:30:18.492992 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 935/1843] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:30:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:30:18.503870 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf34a1-451c-45fb-a48d-93a126035907 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:18.505729 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4faf34a1-451c-45fb-a48d-93a126035907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:18.551030 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06bbbc6-44ac-4b14-8263-38f1de87dff9 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:18.554786 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-c06bbbc6-44ac-4b14-8263-38f1de87dff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:18.609971 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf34a1-451c-45fb-a48d-93a126035907 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:18.614487 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22d3564-c5de-4c6e-8fc9-fed6d878adf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:18.615192 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d3564-c5de-4c6e-8fc9-fed6d878adf9 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:18.615843 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d3564-c5de-4c6e-8fc9-fed6d878adf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:18.616123 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d3564-c5de-4c6e-8fc9-fed6d878adf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:18.633765 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22d3564-c5de-4c6e-8fc9-fed6d878adf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:18.635400 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22d3564-c5de-4c6e-8fc9-fed6d878adf9 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:18.651781 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 909/1844] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:30:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:30:18.662211 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06bbbc6-44ac-4b14-8263-38f1de87dff9 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:18.665791 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c9e14-3279-4a5a-a1b9-6e1fa76ed729 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:18.666769 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c9e14-3279-4a5a-a1b9-6e1fa76ed729 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:18.667048 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c9e14-3279-4a5a-a1b9-6e1fa76ed729 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:18.667369 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c9e14-3279-4a5a-a1b9-6e1fa76ed729 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:18.677138 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1c9e14-3279-4a5a-a1b9-6e1fa76ed729 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:18.678577 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1c9e14-3279-4a5a-a1b9-6e1fa76ed729 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:18.688820 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 936/1845] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:30:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:30:20.237152 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1764e250-00f7-4664-a4dd-8f50f8f3d3ac None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:20.237788 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1764e250-00f7-4664-a4dd-8f50f8f3d3ac None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:20.237788 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1764e250-00f7-4664-a4dd-8f50f8f3d3ac None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:20.243677 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 910/1846] 10.222.0.60 () {54 vars in 921 bytes} [Sat Jul 2 03:30:20 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:30:20.268043 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865fe75-ac4a-413b-8125-4351de61d59a None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:20.268655 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865fe75-ac4a-413b-8125-4351de61d59a None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:20.268655 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865fe75-ac4a-413b-8125-4351de61d59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:20.303640 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-e865fe75-ac4a-413b-8125-4351de61d59a None None] MFA Rules not processed for user `13530240e2d446b6bf26a431d001362a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:30:20.304876 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-e865fe75-ac4a-413b-8125-4351de61d59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:20.516781 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 937/1847] 10.222.0.60 () {58 vars in 1018 bytes} [Sat Jul 2 03:30:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:30:20.524718 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1764e250-00f7-4664-a4dd-8f50f8f3d3ac None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:20.526442 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1764e250-00f7-4664-a4dd-8f50f8f3d3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:20.553301 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1764e250-00f7-4664-a4dd-8f50f8f3d3ac None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:20.566401 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3173af2a-a56c-440b-a844-c6e53848fd63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:20.568076 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e865fe75-ac4a-413b-8125-4351de61d59a None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:20.568600 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173af2a-a56c-440b-a844-c6e53848fd63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:20.569962 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173af2a-a56c-440b-a844-c6e53848fd63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:20.570972 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173af2a-a56c-440b-a844-c6e53848fd63 admin admin] PATH_INFO: `/v3/projects/7342b3d695634e7fa265e4460e1b60db` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:20.572367 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-e865fe75-ac4a-413b-8125-4351de61d59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:20.575766 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3173af2a-a56c-440b-a844-c6e53848fd63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7342b3d695634e7fa265e4460e1b60db)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:20.577759 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3173af2a-a56c-440b-a844-c6e53848fd63 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:20.590001 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:20.607492 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e865fe75-ac4a-413b-8125-4351de61d59a None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:20.624159 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a6d95b-7d47-4103-913c-62cd8f1e8577 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13530240e2d446b6bf26a431d001362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:20.628125 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6d95b-7d47-4103-913c-62cd8f1e8577 service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:20.628670 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6d95b-7d47-4103-913c-62cd8f1e8577 service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:20.629407 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6d95b-7d47-4103-913c-62cd8f1e8577 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:20.653704 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a6d95b-7d47-4103-913c-62cd8f1e8577 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:20.655397 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a6d95b-7d47-4103-913c-62cd8f1e8577 service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:20.690850 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 938/1848] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:30:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:30:20.691803 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a6d95b-7d47-4103-913c-62cd8f1e8577 service nova] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:20.696111 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-56a6d95b-7d47-4103-913c-62cd8f1e8577 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:20.708701 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:20.723467 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3173af2a-a56c-440b-a844-c6e53848fd63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7342b3d695634e7fa265e4460e1b60db', 'request_id': 'req-3173af2a-a56c-440b-a844-c6e53848fd63'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:20.733964 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3173af2a-a56c-440b-a844-c6e53848fd63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7342b3d695634e7fa265e4460e1b60db', 'request_id': 'req-3173af2a-a56c-440b-a844-c6e53848fd63'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:20.749180 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3173af2a-a56c-440b-a844-c6e53848fd63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7342b3d695634e7fa265e4460e1b60db', 'request_id': 'req-3173af2a-a56c-440b-a844-c6e53848fd63'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:20.750437 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a6d95b-7d47-4103-913c-62cd8f1e8577 service nova] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:20.774197 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3173af2a-a56c-440b-a844-c6e53848fd63 admin admin] The token cache is being invalidate because project 7342b3d695634e7fa265e4460e1b60db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:30:20.774925 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3173af2a-a56c-440b-a844-c6e53848fd63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:20.776124 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3173af2a-a56c-440b-a844-c6e53848fd63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:20.779852 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 911/1849] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:30:20 2022] DELETE /identity/v3/projects/7342b3d695634e7fa265e4460e1b60db => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:30:20.784415 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3173af2a-a56c-440b-a844-c6e53848fd63 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:20.794574 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3173af2a-a56c-440b-a844-c6e53848fd63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:20.895539 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd52f9-6f7a-47e5-abd7-67bb1096e96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:20.896635 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd52f9-6f7a-47e5-abd7-67bb1096e96a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:20.896920 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd52f9-6f7a-47e5-abd7-67bb1096e96a admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:20.897810 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd52f9-6f7a-47e5-abd7-67bb1096e96a admin admin] PATH_INFO: `/v3/projects/ed653008a8384034b0e79f8f65b8b0f3` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:20.900590 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cd52f9-6f7a-47e5-abd7-67bb1096e96a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed653008a8384034b0e79f8f65b8b0f3)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:20.904595 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cd52f9-6f7a-47e5-abd7-67bb1096e96a admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:20.980944 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3173af2a-a56c-440b-a844-c6e53848fd63 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:20.999862 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-f0cd52f9-6f7a-47e5-abd7-67bb1096e96a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed653008a8384034b0e79f8f65b8b0f3', 'request_id': 'req-f0cd52f9-6f7a-47e5-abd7-67bb1096e96a'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:21.007628 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-f0cd52f9-6f7a-47e5-abd7-67bb1096e96a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed653008a8384034b0e79f8f65b8b0f3', 'request_id': 'req-f0cd52f9-6f7a-47e5-abd7-67bb1096e96a'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:21.016469 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-f0cd52f9-6f7a-47e5-abd7-67bb1096e96a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed653008a8384034b0e79f8f65b8b0f3', 'request_id': 'req-f0cd52f9-6f7a-47e5-abd7-67bb1096e96a'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:21.040098 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-f0cd52f9-6f7a-47e5-abd7-67bb1096e96a admin admin] The token cache is being invalidate because project ed653008a8384034b0e79f8f65b8b0f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:30:21.042928 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-f0cd52f9-6f7a-47e5-abd7-67bb1096e96a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:21.043721 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-f0cd52f9-6f7a-47e5-abd7-67bb1096e96a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:21.045537 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 939/1850] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:30:20 2022] DELETE /identity/v3/projects/ed653008a8384034b0e79f8f65b8b0f3 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:30:21.050485 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd52f9-6f7a-47e5-abd7-67bb1096e96a admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:21.052462 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-f0cd52f9-6f7a-47e5-abd7-67bb1096e96a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:21.078025 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd572f1-ee5c-4b36-b5a6-c7792ca07ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:21.079264 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd572f1-ee5c-4b36-b5a6-c7792ca07ed2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:21.080342 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd572f1-ee5c-4b36-b5a6-c7792ca07ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:21.080698 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd572f1-ee5c-4b36-b5a6-c7792ca07ed2 admin admin] PATH_INFO: `/v3/users/f22d8eb2df794d9c8218e4d2580b690b` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:21.082371 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd572f1-ee5c-4b36-b5a6-c7792ca07ed2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f22d8eb2df794d9c8218e4d2580b690b)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:21.086573 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd572f1-ee5c-4b36-b5a6-c7792ca07ed2 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:21.176834 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd52f9-6f7a-47e5-abd7-67bb1096e96a admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:21.191742 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47deb74e-13d5-4d50-bf51-39737fa95481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:21.192693 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47deb74e-13d5-4d50-bf51-39737fa95481 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:21.192976 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47deb74e-13d5-4d50-bf51-39737fa95481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:21.193246 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47deb74e-13d5-4d50-bf51-39737fa95481 admin admin] PATH_INFO: `/v3/users/78f8a799e4394c4a9244934856dc4902` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:21.194134 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-dfd572f1-ee5c-4b36-b5a6-c7792ca07ed2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f22d8eb2df794d9c8218e4d2580b690b'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:21.194505 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47deb74e-13d5-4d50-bf51-39737fa95481 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78f8a799e4394c4a9244934856dc4902)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:21.194880 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-dfd572f1-ee5c-4b36-b5a6-c7792ca07ed2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f22d8eb2df794d9c8218e4d2580b690b'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:21.196292 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-dfd572f1-ee5c-4b36-b5a6-c7792ca07ed2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f22d8eb2df794d9c8218e4d2580b690b'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:21.196793 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47deb74e-13d5-4d50-bf51-39737fa95481 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:21.210707 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-dfd572f1-ee5c-4b36-b5a6-c7792ca07ed2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f22d8eb2df794d9c8218e4d2580b690b'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:21.216845 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:21.219843 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-dfd572f1-ee5c-4b36-b5a6-c7792ca07ed2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f22d8eb2df794d9c8218e4d2580b690b'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:21.231668 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:21.249595 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 912/1851] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:30:20 2022] DELETE /identity/v3/users/f22d8eb2df794d9c8218e4d2580b690b => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 03:30:21.269192 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-47deb74e-13d5-4d50-bf51-39737fa95481 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78f8a799e4394c4a9244934856dc4902'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:21.270185 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-47deb74e-13d5-4d50-bf51-39737fa95481 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78f8a799e4394c4a9244934856dc4902'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:21.282471 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-47deb74e-13d5-4d50-bf51-39737fa95481 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78f8a799e4394c4a9244934856dc4902'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:21.283487 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-47deb74e-13d5-4d50-bf51-39737fa95481 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78f8a799e4394c4a9244934856dc4902'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:21.307363 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-47deb74e-13d5-4d50-bf51-39737fa95481 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78f8a799e4394c4a9244934856dc4902'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:21.336305 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 940/1852] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:30:21 2022] DELETE /identity/v3/users/78f8a799e4394c4a9244934856dc4902 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:30:21.979512 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd572f1-ee5c-4b36-b5a6-c7792ca07ed2 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:21.981368 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-dfd572f1-ee5c-4b36-b5a6-c7792ca07ed2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:22.010339 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47deb74e-13d5-4d50-bf51-39737fa95481 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:22.011578 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-47deb74e-13d5-4d50-bf51-39737fa95481 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:22.188749 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd572f1-ee5c-4b36-b5a6-c7792ca07ed2 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:22.228860 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47deb74e-13d5-4d50-bf51-39737fa95481 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:22.294013 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f951c484-41fe-454a-963b-1d5574ab330d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:22.298729 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951c484-41fe-454a-963b-1d5574ab330d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:22.299500 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951c484-41fe-454a-963b-1d5574ab330d admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:22.300456 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951c484-41fe-454a-963b-1d5574ab330d admin admin] PATH_INFO: `/v3/projects/1eff73f7e5af435c91354d633d12ec9b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:22.308065 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f951c484-41fe-454a-963b-1d5574ab330d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1eff73f7e5af435c91354d633d12ec9b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:22.315347 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f951c484-41fe-454a-963b-1d5574ab330d admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:22.397407 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce8ca5f-c3d9-4936-a09b-103ba97f525d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:22.398296 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce8ca5f-c3d9-4936-a09b-103ba97f525d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:22.398570 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce8ca5f-c3d9-4936-a09b-103ba97f525d admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:22.399020 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce8ca5f-c3d9-4936-a09b-103ba97f525d admin admin] PATH_INFO: `/v3/projects/2ba9ef9e71074c32bb5e2c70e4653d41` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:22.400590 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce8ca5f-c3d9-4936-a09b-103ba97f525d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ba9ef9e71074c32bb5e2c70e4653d41)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:22.403654 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce8ca5f-c3d9-4936-a09b-103ba97f525d admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:22.512061 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-8ce8ca5f-c3d9-4936-a09b-103ba97f525d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ba9ef9e71074c32bb5e2c70e4653d41', 'request_id': 'req-8ce8ca5f-c3d9-4936-a09b-103ba97f525d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:22.522517 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-f951c484-41fe-454a-963b-1d5574ab330d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1eff73f7e5af435c91354d633d12ec9b', 'request_id': 'req-f951c484-41fe-454a-963b-1d5574ab330d'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:22.528864 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-8ce8ca5f-c3d9-4936-a09b-103ba97f525d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ba9ef9e71074c32bb5e2c70e4653d41', 'request_id': 'req-8ce8ca5f-c3d9-4936-a09b-103ba97f525d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:22.543342 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-8ce8ca5f-c3d9-4936-a09b-103ba97f525d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ba9ef9e71074c32bb5e2c70e4653d41', 'request_id': 'req-8ce8ca5f-c3d9-4936-a09b-103ba97f525d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:22.567240 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-f951c484-41fe-454a-963b-1d5574ab330d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1eff73f7e5af435c91354d633d12ec9b', 'request_id': 'req-f951c484-41fe-454a-963b-1d5574ab330d'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:22.568374 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-8ce8ca5f-c3d9-4936-a09b-103ba97f525d admin admin] The token cache is being invalidate because project 2ba9ef9e71074c32bb5e2c70e4653d41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:30:22.570758 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-8ce8ca5f-c3d9-4936-a09b-103ba97f525d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:22.572639 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-8ce8ca5f-c3d9-4936-a09b-103ba97f525d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:22.578199 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 913/1853] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:30:21 2022] DELETE /identity/v3/projects/2ba9ef9e71074c32bb5e2c70e4653d41 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:30:22.586387 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368662f6-e336-47d9-a415-6da3d2349a7e None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:22.586997 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368662f6-e336-47d9-a415-6da3d2349a7e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:22.587841 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368662f6-e336-47d9-a415-6da3d2349a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:22.600414 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-f951c484-41fe-454a-963b-1d5574ab330d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1eff73f7e5af435c91354d633d12ec9b', 'request_id': 'req-f951c484-41fe-454a-963b-1d5574ab330d'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:22.632177 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-f951c484-41fe-454a-963b-1d5574ab330d admin admin] The token cache is being invalidate because project 1eff73f7e5af435c91354d633d12ec9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:30:22.632663 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-f951c484-41fe-454a-963b-1d5574ab330d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:22.633506 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-f951c484-41fe-454a-963b-1d5574ab330d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:22.634102 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-368662f6-e336-47d9-a415-6da3d2349a7e None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:30:22.635351 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-368662f6-e336-47d9-a415-6da3d2349a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:22.639928 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 941/1854] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:30:22 2022] DELETE /identity/v3/projects/1eff73f7e5af435c91354d633d12ec9b => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 03:30:22.645985 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2029ace9-72cc-436f-90fd-4bb73966d222 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:22.646331 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2029ace9-72cc-436f-90fd-4bb73966d222 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:22.648089 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2029ace9-72cc-436f-90fd-4bb73966d222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:22.685747 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:22.719716 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-2029ace9-72cc-436f-90fd-4bb73966d222 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:30:22.721460 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-2029ace9-72cc-436f-90fd-4bb73966d222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:22.788020 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:22.835714 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 914/1855] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:30:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:30:22.842818 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf7c95c-bf4a-4d10-a622-ec3d5ff8bb01 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:22.843442 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf7c95c-bf4a-4d10-a622-ec3d5ff8bb01 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:22.847054 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf7c95c-bf4a-4d10-a622-ec3d5ff8bb01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:22.901008 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 942/1856] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:30:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:30:22.915318 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-5bf7c95c-bf4a-4d10-a622-ec3d5ff8bb01 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:30:22.916924 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5bf7c95c-bf4a-4d10-a622-ec3d5ff8bb01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:22.918208 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890124e3-a79c-4461-8699-9892315a3966 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:22.920575 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890124e3-a79c-4461-8699-9892315a3966 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:22.923252 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890124e3-a79c-4461-8699-9892315a3966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:22.926919 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 915/1857] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:30:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:30:22.930878 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf7c95c-bf4a-4d10-a622-ec3d5ff8bb01 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:22.940354 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf7c95c-bf4a-4d10-a622-ec3d5ff8bb01 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:22.945581 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03f62c0-5dd4-46db-a09a-1fbe434ad7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:22.946248 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f62c0-5dd4-46db-a09a-1fbe434ad7f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:22.946528 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f62c0-5dd4-46db-a09a-1fbe434ad7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:22.946796 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f62c0-5dd4-46db-a09a-1fbe434ad7f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:22.947563 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03f62c0-5dd4-46db-a09a-1fbe434ad7f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:30:22.947861 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03f62c0-5dd4-46db-a09a-1fbe434ad7f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:22.949471 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03f62c0-5dd4-46db-a09a-1fbe434ad7f8 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:22.966507 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 916/1858] 10.222.0.60 () {58 vars in 1152 bytes} [Sat Jul 2 03:30:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:30:22.967473 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03f62c0-5dd4-46db-a09a-1fbe434ad7f8 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:22.973817 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-890124e3-a79c-4461-8699-9892315a3966 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:30:22.977394 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-890124e3-a79c-4461-8699-9892315a3966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:22.978822 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03f62c0-5dd4-46db-a09a-1fbe434ad7f8 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:22.984892 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca7db57-e81c-4156-b9f2-53528830b724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:22.985501 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7db57-e81c-4156-b9f2-53528830b724 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:22.985780 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7db57-e81c-4156-b9f2-53528830b724 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:22.986101 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7db57-e81c-4156-b9f2-53528830b724 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:22.986804 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca7db57-e81c-4156-b9f2-53528830b724 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:22.988829 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca7db57-e81c-4156-b9f2-53528830b724 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:23.006337 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 943/1859] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:30:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:30:23.011176 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890124e3-a79c-4461-8699-9892315a3966 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:23.024082 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890124e3-a79c-4461-8699-9892315a3966 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:23.037010 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 917/1860] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:30:22 2022] POST /identity/v3/projects => generated 365 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:30:23.038220 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb70e4-7fc6-4f7a-a257-d6eccd90ca9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:23.038533 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca7db57-e81c-4156-b9f2-53528830b724 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:23.038901 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb70e4-7fc6-4f7a-a257-d6eccd90ca9b admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:23.039441 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb70e4-7fc6-4f7a-a257-d6eccd90ca9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:23.039550 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb70e4-7fc6-4f7a-a257-d6eccd90ca9b admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:23.040204 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cb70e4-7fc6-4f7a-a257-d6eccd90ca9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:30:23.040512 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cb70e4-7fc6-4f7a-a257-d6eccd90ca9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:23.042556 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cb70e4-7fc6-4f7a-a257-d6eccd90ca9b admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:23.069012 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 944/1861] 10.222.0.60 () {58 vars in 1152 bytes} [Sat Jul 2 03:30:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:30:23.073391 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb70e4-7fc6-4f7a-a257-d6eccd90ca9b admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:23.085214 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb70e4-7fc6-4f7a-a257-d6eccd90ca9b admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:23.174241 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca7db57-e81c-4156-b9f2-53528830b724 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:23.179245 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803523cb-6243-445d-9e3b-a85fa72b4f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:23.180200 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803523cb-6243-445d-9e3b-a85fa72b4f27 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:23.180711 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803523cb-6243-445d-9e3b-a85fa72b4f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:23.181148 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803523cb-6243-445d-9e3b-a85fa72b4f27 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:23.182171 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803523cb-6243-445d-9e3b-a85fa72b4f27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:23.182702 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0836e41-681f-43f0-9fbb-b3e622b8087e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:23.183601 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0836e41-681f-43f0-9fbb-b3e622b8087e admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:23.184928 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803523cb-6243-445d-9e3b-a85fa72b4f27 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:23.185321 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0836e41-681f-43f0-9fbb-b3e622b8087e admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:23.185761 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0836e41-681f-43f0-9fbb-b3e622b8087e admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:23.186812 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0836e41-681f-43f0-9fbb-b3e622b8087e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:23.189430 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0836e41-681f-43f0-9fbb-b3e622b8087e admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:23.224170 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 945/1862] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:30:23 2022] POST /identity/v3/projects => generated 373 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:30:23.235359 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803523cb-6243-445d-9e3b-a85fa72b4f27 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:23.243884 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 918/1863] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:30:23 2022] POST /identity/v3/users => generated 283 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:30:23.247966 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0836e41-681f-43f0-9fbb-b3e622b8087e admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:23.293151 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0836e41-681f-43f0-9fbb-b3e622b8087e admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:23.360745 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803523cb-6243-445d-9e3b-a85fa72b4f27 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:23.373002 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deb0171-9f44-46cc-a757-21c0296dcea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:23.373002 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb0171-9f44-46cc-a757-21c0296dcea6 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:23.373002 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb0171-9f44-46cc-a757-21c0296dcea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:23.373002 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb0171-9f44-46cc-a757-21c0296dcea6 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:23.374151 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deb0171-9f44-46cc-a757-21c0296dcea6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:23.376056 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deb0171-9f44-46cc-a757-21c0296dcea6 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:23.407431 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 946/1864] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:30:23 2022] POST /identity/v3/users => generated 287 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:30:23.412245 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a7fd6-6702-4457-b92e-e6fdacb747bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:23.412855 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a7fd6-6702-4457-b92e-e6fdacb747bd admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:23.413049 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deb0171-9f44-46cc-a757-21c0296dcea6 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:23.413174 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a7fd6-6702-4457-b92e-e6fdacb747bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:23.413403 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a7fd6-6702-4457-b92e-e6fdacb747bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:23.414222 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6a7fd6-6702-4457-b92e-e6fdacb747bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:23.415974 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6a7fd6-6702-4457-b92e-e6fdacb747bd admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:23.431946 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 919/1865] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:30:23.433851 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a7fd6-6702-4457-b92e-e6fdacb747bd admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:23.448202 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deb0171-9f44-46cc-a757-21c0296dcea6 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:23.452757 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a7fd6-6702-4457-b92e-e6fdacb747bd admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:23.461229 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b36584-bfff-4ac4-b400-29ef52dfdc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:23.462230 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b36584-bfff-4ac4-b400-29ef52dfdc2c admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:23.462230 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b36584-bfff-4ac4-b400-29ef52dfdc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:23.462490 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b36584-bfff-4ac4-b400-29ef52dfdc2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:23.465195 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb58f44-7c41-4e9d-af9b-7e01bfe25e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:23.465891 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb58f44-7c41-4e9d-af9b-7e01bfe25e77 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:23.466181 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb58f44-7c41-4e9d-af9b-7e01bfe25e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:23.474175 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b36584-bfff-4ac4-b400-29ef52dfdc2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:23.476424 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb58f44-7c41-4e9d-af9b-7e01bfe25e77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:23.477746 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb58f44-7c41-4e9d-af9b-7e01bfe25e77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:23.479809 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb58f44-7c41-4e9d-af9b-7e01bfe25e77 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:23.484803 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b36584-bfff-4ac4-b400-29ef52dfdc2c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:23.494276 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:23.506040 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 947/1866] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 03:30:23.508182 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 920/1867] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:30:23.512365 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b36584-bfff-4ac4-b400-29ef52dfdc2c admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:23.514722 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb58f44-7c41-4e9d-af9b-7e01bfe25e77 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:23.525201 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b36584-bfff-4ac4-b400-29ef52dfdc2c admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:23.535785 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ab6a0b-3fa1-45ca-8a90-8808c74c2d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:23.536870 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab6a0b-3fa1-45ca-8a90-8808c74c2d7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:23.537325 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab6a0b-3fa1-45ca-8a90-8808c74c2d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:23.537760 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab6a0b-3fa1-45ca-8a90-8808c74c2d7b admin admin] PATH_INFO: `/v3/projects/42dfdcfa91fe42478eee520dfe5ac57f/users/4ba5735c0af04f2885152e154c470b32/roles/c43aada0326446c4ade0ab1262918fa4` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:23.549816 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb58f44-7c41-4e9d-af9b-7e01bfe25e77 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:23.558777 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ab6a0b-3fa1-45ca-8a90-8808c74c2d7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=42dfdcfa91fe42478eee520dfe5ac57f, user_id=4ba5735c0af04f2885152e154c470b32, role_id=c43aada0326446c4ade0ab1262918fa4)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:23.564768 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ab6a0b-3fa1-45ca-8a90-8808c74c2d7b admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:23.571085 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b708055f-83d7-4192-b626-e2be748cef91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:23.571085 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b708055f-83d7-4192-b626-e2be748cef91 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:23.571085 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b708055f-83d7-4192-b626-e2be748cef91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:23.571085 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b708055f-83d7-4192-b626-e2be748cef91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:23.571702 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b708055f-83d7-4192-b626-e2be748cef91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:23.572631 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b708055f-83d7-4192-b626-e2be748cef91 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:23.613525 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 948/1868] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:30:23.613727 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 921/1869] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:30:23 2022] PUT /identity/v3/projects/42dfdcfa91fe42478eee520dfe5ac57f/users/4ba5735c0af04f2885152e154c470b32/roles/c43aada0326446c4ade0ab1262918fa4 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:30:23.614676 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b708055f-83d7-4192-b626-e2be748cef91 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:23.627827 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:23.635108 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b708055f-83d7-4192-b626-e2be748cef91 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:23.638340 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dcdac8-201c-46f0-a82c-d9ee9d7f10cf None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:23.639701 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dcdac8-201c-46f0-a82c-d9ee9d7f10cf None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:23.640284 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dcdac8-201c-46f0-a82c-d9ee9d7f10cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:23.690066 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-12dcdac8-201c-46f0-a82c-d9ee9d7f10cf None None] MFA Rules not processed for user `4ba5735c0af04f2885152e154c470b32`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:30:23.691888 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-12dcdac8-201c-46f0-a82c-d9ee9d7f10cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:23.754454 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668f4956-5c62-484a-8d39-de938c9070b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:23.755849 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f4956-5c62-484a-8d39-de938c9070b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:23.756952 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f4956-5c62-484a-8d39-de938c9070b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:23.756952 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f4956-5c62-484a-8d39-de938c9070b9 admin admin] PATH_INFO: `/v3/projects/7657296bbf764ac4a92e570b02589973/users/7d13955bcc234bedb4a991d5f81efdf9/roles/c43aada0326446c4ade0ab1262918fa4` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:23.775345 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668f4956-5c62-484a-8d39-de938c9070b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7657296bbf764ac4a92e570b02589973, user_id=7d13955bcc234bedb4a991d5f81efdf9, role_id=c43aada0326446c4ade0ab1262918fa4)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:23.778867 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668f4956-5c62-484a-8d39-de938c9070b9 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:23.792308 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 922/1870] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:30:23 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:30:23.802974 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dcdac8-201c-46f0-a82c-d9ee9d7f10cf None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:23.809296 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dcdac8-201c-46f0-a82c-d9ee9d7f10cf None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:23.813846 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 949/1871] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:30:23 2022] PUT /identity/v3/projects/7657296bbf764ac4a92e570b02589973/users/7d13955bcc234bedb4a991d5f81efdf9/roles/c43aada0326446c4ade0ab1262918fa4 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:30:23.820092 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b9c7b-a68e-4c3e-bf89-7e805decd3a6 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:23.820092 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b9c7b-a68e-4c3e-bf89-7e805decd3a6 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:23.820367 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b9c7b-a68e-4c3e-bf89-7e805decd3a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:23.840362 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-6a5b9c7b-a68e-4c3e-bf89-7e805decd3a6 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:30:23.842099 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-6a5b9c7b-a68e-4c3e-bf89-7e805decd3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:23.891048 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f206a-7edd-424c-873d-1639736b0946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:23.891805 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f206a-7edd-424c-873d-1639736b0946 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:23.892087 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f206a-7edd-424c-873d-1639736b0946 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:23.892379 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f206a-7edd-424c-873d-1639736b0946 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:23.893052 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506f206a-7edd-424c-873d-1639736b0946 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:23.895038 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506f206a-7edd-424c-873d-1639736b0946 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:23.918175 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 950/1872] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:30:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 03:30:23.927651 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b9c7b-a68e-4c3e-bf89-7e805decd3a6 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:23.929034 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-6a5b9c7b-a68e-4c3e-bf89-7e805decd3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:23.938946 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 923/1873] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:30:23 2022] POST /identity/v3/projects => generated 365 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:30:23.939895 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f206a-7edd-424c-873d-1639736b0946 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:23.997260 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:24.001928 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b9c7b-a68e-4c3e-bf89-7e805decd3a6 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:24.009952 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f206a-7edd-424c-873d-1639736b0946 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:24.016122 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28d6731-ed00-4db2-b835-27bd29254d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:24.016989 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d6731-ed00-4db2-b835-27bd29254d6a admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:24.017352 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d6731-ed00-4db2-b835-27bd29254d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:24.017691 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d6731-ed00-4db2-b835-27bd29254d6a admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:24.018596 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28d6731-ed00-4db2-b835-27bd29254d6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:24.020906 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28d6731-ed00-4db2-b835-27bd29254d6a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:24.044834 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 924/1874] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:30:23 2022] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:30:24.048341 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28d6731-ed00-4db2-b835-27bd29254d6a admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:24.050712 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:24.059563 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28d6731-ed00-4db2-b835-27bd29254d6a admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:24.060475 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c470d5f1-3dac-42e6-875b-132584a8cf44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:24.061152 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470d5f1-3dac-42e6-875b-132584a8cf44 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:24.061427 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470d5f1-3dac-42e6-875b-132584a8cf44 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:24.061696 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470d5f1-3dac-42e6-875b-132584a8cf44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:24.065353 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f996d26-aa73-445e-b547-1a8faf7e8cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:24.066266 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f996d26-aa73-445e-b547-1a8faf7e8cdd admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:24.066648 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f996d26-aa73-445e-b547-1a8faf7e8cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:24.067004 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f996d26-aa73-445e-b547-1a8faf7e8cdd admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:24.068957 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f996d26-aa73-445e-b547-1a8faf7e8cdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:24.069866 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f996d26-aa73-445e-b547-1a8faf7e8cdd admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:24.073859 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c470d5f1-3dac-42e6-875b-132584a8cf44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:24.075694 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c470d5f1-3dac-42e6-875b-132584a8cf44 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:24.085253 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 925/1875] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:30:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 03:30:24.086311 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f996d26-aa73-445e-b547-1a8faf7e8cdd admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:24.091297 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 951/1876] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:30:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 03:30:24.106422 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f996d26-aa73-445e-b547-1a8faf7e8cdd admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:24.113249 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac76f89e-1d8e-4085-8d89-12a2c13e83d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:24.114212 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76f89e-1d8e-4085-8d89-12a2c13e83d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:24.114852 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76f89e-1d8e-4085-8d89-12a2c13e83d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:24.114852 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76f89e-1d8e-4085-8d89-12a2c13e83d5 admin admin] PATH_INFO: `/v3/projects/16402bfddaf74eb3af5cec83ba81252f/users/942ee89c665b4c72bd57c65577f5622b/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:24.139412 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac76f89e-1d8e-4085-8d89-12a2c13e83d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16402bfddaf74eb3af5cec83ba81252f, user_id=942ee89c665b4c72bd57c65577f5622b, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:24.142033 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac76f89e-1d8e-4085-8d89-12a2c13e83d5 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:24.158149 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 926/1877] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:30:24 2022] PUT /identity/v3/projects/16402bfddaf74eb3af5cec83ba81252f/users/942ee89c665b4c72bd57c65577f5622b/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:30:24.162786 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c470d5f1-3dac-42e6-875b-132584a8cf44 service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:24.173580 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c470d5f1-3dac-42e6-875b-132584a8cf44 service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:24.246868 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf48c9f-3c8e-4525-b3af-d9e0946e125e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:24.247772 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf48c9f-3c8e-4525-b3af-d9e0946e125e admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:24.248087 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf48c9f-3c8e-4525-b3af-d9e0946e125e admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:24.249228 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf48c9f-3c8e-4525-b3af-d9e0946e125e admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:24.250166 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf48c9f-3c8e-4525-b3af-d9e0946e125e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:24.252069 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf48c9f-3c8e-4525-b3af-d9e0946e125e admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:24.268331 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 952/1878] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:30:24 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 03:30:24.272396 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac76f89e-1d8e-4085-8d89-12a2c13e83d5 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:24.283706 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac76f89e-1d8e-4085-8d89-12a2c13e83d5 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:24.290543 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8d1d66-74e4-4964-902a-c7a169797c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:24.292015 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d1d66-74e4-4964-902a-c7a169797c35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:24.292467 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d1d66-74e4-4964-902a-c7a169797c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:24.292887 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d1d66-74e4-4964-902a-c7a169797c35 admin admin] PATH_INFO: `/v3/projects/16402bfddaf74eb3af5cec83ba81252f/users/942ee89c665b4c72bd57c65577f5622b/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:24.310792 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8d1d66-74e4-4964-902a-c7a169797c35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16402bfddaf74eb3af5cec83ba81252f, user_id=942ee89c665b4c72bd57c65577f5622b, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:24.315455 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8d1d66-74e4-4964-902a-c7a169797c35 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:24.345340 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 927/1879] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:30:24 2022] PUT /identity/v3/projects/16402bfddaf74eb3af5cec83ba81252f/users/942ee89c665b4c72bd57c65577f5622b/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:30:24.357278 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8989bbc3-b267-4c74-a2f0-d58f13a60664 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:24.357823 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8989bbc3-b267-4c74-a2f0-d58f13a60664 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:24.358206 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8989bbc3-b267-4c74-a2f0-d58f13a60664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:24.419444 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-8989bbc3-b267-4c74-a2f0-d58f13a60664 None None] MFA Rules not processed for user `942ee89c665b4c72bd57c65577f5622b`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:30:24.420831 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-8989bbc3-b267-4c74-a2f0-d58f13a60664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:24.515435 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 953/1880] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:30:24 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:30:24.528022 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8d1d66-74e4-4964-902a-c7a169797c35 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:24.529943 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2e8d1d66-74e4-4964-902a-c7a169797c35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:24.612648 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8d1d66-74e4-4964-902a-c7a169797c35 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:24.619952 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712880ac-48b8-46de-990e-8bb1b360c662 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:24.621110 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712880ac-48b8-46de-990e-8bb1b360c662 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:24.622508 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712880ac-48b8-46de-990e-8bb1b360c662 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:24.622965 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712880ac-48b8-46de-990e-8bb1b360c662 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:24.636980 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712880ac-48b8-46de-990e-8bb1b360c662 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:24.638777 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712880ac-48b8-46de-990e-8bb1b360c662 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:24.653787 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 928/1881] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:30:24 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:30:24.752688 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8989bbc3-b267-4c74-a2f0-d58f13a60664 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:24.757317 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-8989bbc3-b267-4c74-a2f0-d58f13a60664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:24.773367 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8989bbc3-b267-4c74-a2f0-d58f13a60664 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:24.778123 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa3fd7-0d89-4ce7-8f0b-9e3498e22f80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:24.778802 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa3fd7-0d89-4ce7-8f0b-9e3498e22f80 service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:24.779699 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa3fd7-0d89-4ce7-8f0b-9e3498e22f80 service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:24.781539 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa3fd7-0d89-4ce7-8f0b-9e3498e22f80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:24.884584 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baa3fd7-0d89-4ce7-8f0b-9e3498e22f80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:24.886111 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baa3fd7-0d89-4ce7-8f0b-9e3498e22f80 service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:24.915467 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 954/1882] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:30:24 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:30:26.158314 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902e5f1-75ca-4c19-b5c3-83ebf7cbc945 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:26.159428 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902e5f1-75ca-4c19-b5c3-83ebf7cbc945 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:26.159819 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902e5f1-75ca-4c19-b5c3-83ebf7cbc945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:26.227650 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-1902e5f1-75ca-4c19-b5c3-83ebf7cbc945 None None] MFA Rules not processed for user `7d13955bcc234bedb4a991d5f81efdf9`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:30:26.235324 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1902e5f1-75ca-4c19-b5c3-83ebf7cbc945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:26.458492 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 929/1883] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:30:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:30:26.462674 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa3fd7-0d89-4ce7-8f0b-9e3498e22f80 service cinder] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:26.477618 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:26.570807 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa3fd7-0d89-4ce7-8f0b-9e3498e22f80 service cinder] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:26.620931 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa6233-0552-4c2a-9924-7453fe3cecc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:26.625852 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa6233-0552-4c2a-9924-7453fe3cecc8 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:26.627808 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa6233-0552-4c2a-9924-7453fe3cecc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:26.628312 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa6233-0552-4c2a-9924-7453fe3cecc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:26.629263 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caa6233-0552-4c2a-9924-7453fe3cecc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:26.641459 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caa6233-0552-4c2a-9924-7453fe3cecc8 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:26.729990 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 955/1884] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:30:26 2022] POST /identity/v3/projects => generated 371 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:30:26.733306 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1902e5f1-75ca-4c19-b5c3-83ebf7cbc945 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:26.751109 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1902e5f1-75ca-4c19-b5c3-83ebf7cbc945 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:26.800228 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:26.852730 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860e5caf-aee4-4dfe-aa33-7a22e7e9e578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:26.853637 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e5caf-aee4-4dfe-aa33-7a22e7e9e578 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:26.853928 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e5caf-aee4-4dfe-aa33-7a22e7e9e578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:26.854551 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e5caf-aee4-4dfe-aa33-7a22e7e9e578 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:26.855060 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860e5caf-aee4-4dfe-aa33-7a22e7e9e578 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:26.857487 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860e5caf-aee4-4dfe-aa33-7a22e7e9e578 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:26.898034 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 930/1885] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:30:26 2022] POST /identity/v3/users => generated 292 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 03:30:26.905688 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa6233-0552-4c2a-9924-7453fe3cecc8 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:26.931769 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa6233-0552-4c2a-9924-7453fe3cecc8 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:26.951908 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b51bab-87ba-4aec-a45e-ccd99ca9b500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:26.952728 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b51bab-87ba-4aec-a45e-ccd99ca9b500 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:26.953005 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b51bab-87ba-4aec-a45e-ccd99ca9b500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:26.953278 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b51bab-87ba-4aec-a45e-ccd99ca9b500 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:26.954010 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b51bab-87ba-4aec-a45e-ccd99ca9b500 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:26.955659 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b51bab-87ba-4aec-a45e-ccd99ca9b500 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:26.985410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 956/1886] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:30:26 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:30:26.990182 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860e5caf-aee4-4dfe-aa33-7a22e7e9e578 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:27.029287 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860e5caf-aee4-4dfe-aa33-7a22e7e9e578 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:27.052625 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cee0e6-94a7-45f1-84bf-9a556ec1455c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:27.056201 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cee0e6-94a7-45f1-84bf-9a556ec1455c admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:27.056515 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cee0e6-94a7-45f1-84bf-9a556ec1455c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:27.056772 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cee0e6-94a7-45f1-84bf-9a556ec1455c admin admin] PATH_INFO: `/v3/projects/79d46c14a2554ed8b775e3c147563420/users/ce6323c35a5d4b1da6e074381c77b677/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:27.094336 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cee0e6-94a7-45f1-84bf-9a556ec1455c admin admin] RBAC: Authorizing `identity:create_grant(project_id=79d46c14a2554ed8b775e3c147563420, user_id=ce6323c35a5d4b1da6e074381c77b677, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:27.097018 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cee0e6-94a7-45f1-84bf-9a556ec1455c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:27.133556 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 931/1887] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:30:26 2022] PUT /identity/v3/projects/79d46c14a2554ed8b775e3c147563420/users/ce6323c35a5d4b1da6e074381c77b677/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:30:27.138399 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b51bab-87ba-4aec-a45e-ccd99ca9b500 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:27.154282 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b51bab-87ba-4aec-a45e-ccd99ca9b500 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:27.284190 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00268314-e15e-4a18-9681-e2cf6702923a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:27.286921 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00268314-e15e-4a18-9681-e2cf6702923a admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:27.286921 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00268314-e15e-4a18-9681-e2cf6702923a admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:27.286921 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00268314-e15e-4a18-9681-e2cf6702923a admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:27.287391 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00268314-e15e-4a18-9681-e2cf6702923a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:27.293322 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00268314-e15e-4a18-9681-e2cf6702923a admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:27.302698 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 957/1888] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 03:30:27.307022 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cee0e6-94a7-45f1-84bf-9a556ec1455c admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:27.318505 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cee0e6-94a7-45f1-84bf-9a556ec1455c admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:27.323252 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff6ead0-3fab-45bd-a869-541c03013d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:27.324142 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6ead0-3fab-45bd-a869-541c03013d6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:27.324415 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6ead0-3fab-45bd-a869-541c03013d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:27.324672 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6ead0-3fab-45bd-a869-541c03013d6e admin admin] PATH_INFO: `/v3/projects/79d46c14a2554ed8b775e3c147563420/users/ce6323c35a5d4b1da6e074381c77b677/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:27.326612 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff6ead0-3fab-45bd-a869-541c03013d6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=79d46c14a2554ed8b775e3c147563420, user_id=ce6323c35a5d4b1da6e074381c77b677, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:27.329414 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff6ead0-3fab-45bd-a869-541c03013d6e admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:27.351079 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 932/1889] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:30:27 2022] PUT /identity/v3/projects/79d46c14a2554ed8b775e3c147563420/users/ce6323c35a5d4b1da6e074381c77b677/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:30:27.408414 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9443ec3-eb7b-49f9-8e06-5762471e95b1 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:27.410515 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9443ec3-eb7b-49f9-8e06-5762471e95b1 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:27.411041 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9443ec3-eb7b-49f9-8e06-5762471e95b1 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:27.413390 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 958/1890] 10.222.0.60 () {54 vars in 921 bytes} [Sat Jul 2 03:30:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:30:27.435957 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a717499-4970-45ec-b4c2-0b8e1540c204 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:27.436236 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a717499-4970-45ec-b4c2-0b8e1540c204 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:27.436923 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a717499-4970-45ec-b4c2-0b8e1540c204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:27.472452 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-7a717499-4970-45ec-b4c2-0b8e1540c204 None None] MFA Rules not processed for user `13530240e2d446b6bf26a431d001362a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:30:27.473657 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7a717499-4970-45ec-b4c2-0b8e1540c204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:27.603851 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 933/1891] 10.222.0.60 () {58 vars in 1018 bytes} [Sat Jul 2 03:30:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:30:27.740869 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9443ec3-eb7b-49f9-8e06-5762471e95b1 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:27.743535 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-f9443ec3-eb7b-49f9-8e06-5762471e95b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:27.775821 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9443ec3-eb7b-49f9-8e06-5762471e95b1 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:27.799245 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2944e543-52ad-4432-bb82-2ff856025ff6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13530240e2d446b6bf26a431d001362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:27.800733 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2944e543-52ad-4432-bb82-2ff856025ff6 service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:27.801232 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2944e543-52ad-4432-bb82-2ff856025ff6 service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:27.802179 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2944e543-52ad-4432-bb82-2ff856025ff6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:27.816495 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2944e543-52ad-4432-bb82-2ff856025ff6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:27.819262 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2944e543-52ad-4432-bb82-2ff856025ff6 service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:27.845845 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 959/1892] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:30:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:30:27.861445 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a717499-4970-45ec-b4c2-0b8e1540c204 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:27.863905 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7a717499-4970-45ec-b4c2-0b8e1540c204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:27.997337 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a717499-4970-45ec-b4c2-0b8e1540c204 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:28.007455 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c3f3f-5f1d-4548-9425-df5f4ef6bda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:28.008522 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c3f3f-5f1d-4548-9425-df5f4ef6bda7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:28.008812 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c3f3f-5f1d-4548-9425-df5f4ef6bda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:28.009236 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c3f3f-5f1d-4548-9425-df5f4ef6bda7 admin admin] PATH_INFO: `/v3/users/90b3c3e84e8d426b8b76f475be40522a` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:28.020316 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c3f3f-5f1d-4548-9425-df5f4ef6bda7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90b3c3e84e8d426b8b76f475be40522a)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:28.022669 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c3f3f-5f1d-4548-9425-df5f4ef6bda7 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:28.036765 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:28.098046 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-b63c3f3f-5f1d-4548-9425-df5f4ef6bda7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90b3c3e84e8d426b8b76f475be40522a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:28.098886 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-b63c3f3f-5f1d-4548-9425-df5f4ef6bda7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90b3c3e84e8d426b8b76f475be40522a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:28.099917 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-b63c3f3f-5f1d-4548-9425-df5f4ef6bda7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90b3c3e84e8d426b8b76f475be40522a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:28.138925 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-b63c3f3f-5f1d-4548-9425-df5f4ef6bda7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90b3c3e84e8d426b8b76f475be40522a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:28.146947 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-b63c3f3f-5f1d-4548-9425-df5f4ef6bda7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90b3c3e84e8d426b8b76f475be40522a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:28.164947 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 934/1893] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:30:27 2022] DELETE /identity/v3/users/90b3c3e84e8d426b8b76f475be40522a => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:30:28.170126 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a29ee9-9403-48eb-a394-3f762f2b2497 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:28.170425 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a29ee9-9403-48eb-a394-3f762f2b2497 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:28.170753 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a29ee9-9403-48eb-a394-3f762f2b2497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:28.217552 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-58a29ee9-9403-48eb-a394-3f762f2b2497 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:30:28.221359 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-58a29ee9-9403-48eb-a394-3f762f2b2497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:28.404178 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 960/1894] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:30:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:30:28.413136 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c3f3f-5f1d-4548-9425-df5f4ef6bda7 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:28.415478 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b63c3f3f-5f1d-4548-9425-df5f4ef6bda7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:28.519893 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c3f3f-5f1d-4548-9425-df5f4ef6bda7 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:28.524596 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d7e68b-379e-4c6f-adf1-a142679fc47e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:28.525738 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d7e68b-379e-4c6f-adf1-a142679fc47e service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:28.526225 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d7e68b-379e-4c6f-adf1-a142679fc47e service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:28.526764 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d7e68b-379e-4c6f-adf1-a142679fc47e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:28.545739 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d7e68b-379e-4c6f-adf1-a142679fc47e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:28.547866 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d7e68b-379e-4c6f-adf1-a142679fc47e service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:28.572883 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 935/1895] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:30:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 03:30:28.598598 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4683f-db82-437e-a93b-61f429da6f57 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:28.599111 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4683f-db82-437e-a93b-61f429da6f57 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:28.599675 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4683f-db82-437e-a93b-61f429da6f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:28.609745 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:28.615363 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a44a44-1d73-4038-98b2-1c867078942d None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:28.617236 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a44a44-1d73-4038-98b2-1c867078942d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:28.617754 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a44a44-1d73-4038-98b2-1c867078942d None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:28.619830 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 936/1896] 10.222.0.60 () {54 vars in 921 bytes} [Sat Jul 2 03:30:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:30:28.654745 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c66cce7-0543-4c99-a875-6bfbf4ce99c8 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:28.655596 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c66cce7-0543-4c99-a875-6bfbf4ce99c8 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:28.656686 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c66cce7-0543-4c99-a875-6bfbf4ce99c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:28.678437 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-f0c4683f-db82-437e-a93b-61f429da6f57 None None] MFA Rules not processed for user `ce6323c35a5d4b1da6e074381c77b677`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:30:28.682437 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-f0c4683f-db82-437e-a93b-61f429da6f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:28.693048 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-9c66cce7-0543-4c99-a875-6bfbf4ce99c8 None None] MFA Rules not processed for user `13530240e2d446b6bf26a431d001362a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:30:28.695156 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9c66cce7-0543-4c99-a875-6bfbf4ce99c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:28.827528 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 937/1897] 10.222.0.60 () {58 vars in 1018 bytes} [Sat Jul 2 03:30:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:30:28.921662 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 961/1898] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:30:28 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:30:28.933816 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05091f90-5550-4c34-a1e8-ef63513fcf64 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:28.934207 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05091f90-5550-4c34-a1e8-ef63513fcf64 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:28.934862 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05091f90-5550-4c34-a1e8-ef63513fcf64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:28.984089 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-05091f90-5550-4c34-a1e8-ef63513fcf64 None None] MFA Rules not processed for user `7d13955bcc234bedb4a991d5f81efdf9`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:30:28.985331 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-05091f90-5550-4c34-a1e8-ef63513fcf64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:29.005406 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:29.063665 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 938/1899] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:30:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 03:30:29.196559 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c4683f-db82-437e-a93b-61f429da6f57 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:29.198609 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-f0c4683f-db82-437e-a93b-61f429da6f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:29.222747 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05091f90-5550-4c34-a1e8-ef63513fcf64 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:29.224514 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-05091f90-5550-4c34-a1e8-ef63513fcf64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:29.228994 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c4683f-db82-437e-a93b-61f429da6f57 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:29.249394 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f8e7af-2ef7-42a5-bc3b-9ff39486cf70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13530240e2d446b6bf26a431d001362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:29.250336 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8e7af-2ef7-42a5-bc3b-9ff39486cf70 service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:29.250771 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8e7af-2ef7-42a5-bc3b-9ff39486cf70 service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:29.251236 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8e7af-2ef7-42a5-bc3b-9ff39486cf70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:29.253099 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05091f90-5550-4c34-a1e8-ef63513fcf64 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:29.268664 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f8e7af-2ef7-42a5-bc3b-9ff39486cf70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:29.270852 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f8e7af-2ef7-42a5-bc3b-9ff39486cf70 service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:29.274954 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c76b29a-7d30-42d1-aa6e-f56683a54700 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13530240e2d446b6bf26a431d001362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:29.275667 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c76b29a-7d30-42d1-aa6e-f56683a54700 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:29.275944 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c76b29a-7d30-42d1-aa6e-f56683a54700 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:29.276239 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c76b29a-7d30-42d1-aa6e-f56683a54700 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:29.282160 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7c76b29a-7d30-42d1-aa6e-f56683a54700 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:29.301086 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c76b29a-7d30-42d1-aa6e-f56683a54700 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:29.301236 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 962/1900] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:30:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:30:29.304862 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c76b29a-7d30-42d1-aa6e-f56683a54700 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:29.332647 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 939/1901] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:30:29 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 03:30:30.233560 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f8e7af-2ef7-42a5-bc3b-9ff39486cf70 service nova] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:30.235307 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-04f8e7af-2ef7-42a5-bc3b-9ff39486cf70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:30.255557 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f8e7af-2ef7-42a5-bc3b-9ff39486cf70 service nova] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:30.262132 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be9437-cfcd-400f-a59b-258c9c8c3e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:30.263340 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be9437-cfcd-400f-a59b-258c9c8c3e73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:30.263639 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be9437-cfcd-400f-a59b-258c9c8c3e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:30.264353 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be9437-cfcd-400f-a59b-258c9c8c3e73 admin admin] PATH_INFO: `/v3/projects/4deed07ac018474490e72f7da7fc2185` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:30.265860 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06be9437-cfcd-400f-a59b-258c9c8c3e73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4deed07ac018474490e72f7da7fc2185)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:30.268151 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06be9437-cfcd-400f-a59b-258c9c8c3e73 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:30.326683 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-06be9437-cfcd-400f-a59b-258c9c8c3e73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4deed07ac018474490e72f7da7fc2185', 'request_id': 'req-06be9437-cfcd-400f-a59b-258c9c8c3e73'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:30.332954 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-06be9437-cfcd-400f-a59b-258c9c8c3e73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4deed07ac018474490e72f7da7fc2185', 'request_id': 'req-06be9437-cfcd-400f-a59b-258c9c8c3e73'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:30.339834 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-06be9437-cfcd-400f-a59b-258c9c8c3e73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4deed07ac018474490e72f7da7fc2185', 'request_id': 'req-06be9437-cfcd-400f-a59b-258c9c8c3e73'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:30.398230 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-06be9437-cfcd-400f-a59b-258c9c8c3e73 admin admin] The token cache is being invalidate because project 4deed07ac018474490e72f7da7fc2185 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:30:30.398576 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-06be9437-cfcd-400f-a59b-258c9c8c3e73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:30.407248 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-06be9437-cfcd-400f-a59b-258c9c8c3e73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:30.413637 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c76b29a-7d30-42d1-aa6e-f56683a54700 service nova] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:30.415317 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 963/1902] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:30:30 2022] DELETE /identity/v3/projects/4deed07ac018474490e72f7da7fc2185 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:30:30.424774 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c76b29a-7d30-42d1-aa6e-f56683a54700 service nova] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:30.518063 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86513a82-1d24-4c6e-8086-8ad6076aac82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:30.519341 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86513a82-1d24-4c6e-8086-8ad6076aac82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:30.519697 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86513a82-1d24-4c6e-8086-8ad6076aac82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:30.520425 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86513a82-1d24-4c6e-8086-8ad6076aac82 admin admin] PATH_INFO: `/v3/users/7bb879a51b684f76ab190eb11c9cdd28` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:30.522271 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86513a82-1d24-4c6e-8086-8ad6076aac82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bb879a51b684f76ab190eb11c9cdd28)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:30.525905 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86513a82-1d24-4c6e-8086-8ad6076aac82 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:30.587761 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-86513a82-1d24-4c6e-8086-8ad6076aac82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bb879a51b684f76ab190eb11c9cdd28'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:30.588509 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-86513a82-1d24-4c6e-8086-8ad6076aac82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bb879a51b684f76ab190eb11c9cdd28'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:30.589415 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-86513a82-1d24-4c6e-8086-8ad6076aac82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bb879a51b684f76ab190eb11c9cdd28'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:30.606915 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-86513a82-1d24-4c6e-8086-8ad6076aac82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bb879a51b684f76ab190eb11c9cdd28'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:30.616093 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-86513a82-1d24-4c6e-8086-8ad6076aac82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bb879a51b684f76ab190eb11c9cdd28'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:30.636429 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 940/1903] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:30:30 2022] DELETE /identity/v3/users/7bb879a51b684f76ab190eb11c9cdd28 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:30:30.986697 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be9437-cfcd-400f-a59b-258c9c8c3e73 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:30.988344 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-06be9437-cfcd-400f-a59b-258c9c8c3e73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:31.005134 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be9437-cfcd-400f-a59b-258c9c8c3e73 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:31.089468 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26be0356-9f33-4d49-a681-94b839450fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:31.090548 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be0356-9f33-4d49-a681-94b839450fdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:31.090900 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be0356-9f33-4d49-a681-94b839450fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:31.091254 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be0356-9f33-4d49-a681-94b839450fdd admin admin] PATH_INFO: `/v3/projects/2e17b3c1bb9843249b8965fe67618815` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:31.093239 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26be0356-9f33-4d49-a681-94b839450fdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e17b3c1bb9843249b8965fe67618815)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:31.095441 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26be0356-9f33-4d49-a681-94b839450fdd admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:31.097651 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:31.187666 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-26be0356-9f33-4d49-a681-94b839450fdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e17b3c1bb9843249b8965fe67618815', 'request_id': 'req-26be0356-9f33-4d49-a681-94b839450fdd'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:31.196267 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-26be0356-9f33-4d49-a681-94b839450fdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e17b3c1bb9843249b8965fe67618815', 'request_id': 'req-26be0356-9f33-4d49-a681-94b839450fdd'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:31.204754 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-26be0356-9f33-4d49-a681-94b839450fdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e17b3c1bb9843249b8965fe67618815', 'request_id': 'req-26be0356-9f33-4d49-a681-94b839450fdd'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:31.231369 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-26be0356-9f33-4d49-a681-94b839450fdd admin admin] The token cache is being invalidate because project 2e17b3c1bb9843249b8965fe67618815 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:30:31.231840 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-26be0356-9f33-4d49-a681-94b839450fdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:31.233873 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-26be0356-9f33-4d49-a681-94b839450fdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:31.240021 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 964/1904] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:30:30 2022] DELETE /identity/v3/projects/2e17b3c1bb9843249b8965fe67618815 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:30:31.242611 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b867887-fba8-4039-95b6-39a4ae8b7227 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:31.243974 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b867887-fba8-4039-95b6-39a4ae8b7227 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:31.244443 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b867887-fba8-4039-95b6-39a4ae8b7227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:31.269525 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-4b867887-fba8-4039-95b6-39a4ae8b7227 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:30:31.275358 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4b867887-fba8-4039-95b6-39a4ae8b7227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:31.341167 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:31.411456 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 941/1905] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:30:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:30:31.413406 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d3c4f-6b9c-49e3-ac97-ef7456e02ae6 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:31.413691 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d3c4f-6b9c-49e3-ac97-ef7456e02ae6 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:31.414022 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d3c4f-6b9c-49e3-ac97-ef7456e02ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:31.442887 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-662d3c4f-6b9c-49e3-ac97-ef7456e02ae6 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:30:31.444107 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-662d3c4f-6b9c-49e3-ac97-ef7456e02ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:31.457627 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 965/1906] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:30:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:30:31.463508 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b867887-fba8-4039-95b6-39a4ae8b7227 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:31.478189 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b867887-fba8-4039-95b6-39a4ae8b7227 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:31.484427 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ea1bd-dba7-457e-a85b-365a0fffe5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:31.485360 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ea1bd-dba7-457e-a85b-365a0fffe5f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:31.485496 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ea1bd-dba7-457e-a85b-365a0fffe5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:31.485960 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ea1bd-dba7-457e-a85b-365a0fffe5f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:31.486722 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831ea1bd-dba7-457e-a85b-365a0fffe5f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:30:31.487014 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831ea1bd-dba7-457e-a85b-365a0fffe5f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:31.488888 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831ea1bd-dba7-457e-a85b-365a0fffe5f5 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:31.509210 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 942/1907] 10.222.0.60 () {58 vars in 1152 bytes} [Sat Jul 2 03:30:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:30:31.513788 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662d3c4f-6b9c-49e3-ac97-ef7456e02ae6 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:31.528363 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662d3c4f-6b9c-49e3-ac97-ef7456e02ae6 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:31.532999 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc4caee-861f-4467-8270-ec324faf91e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:31.534061 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4caee-861f-4467-8270-ec324faf91e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:31.534358 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4caee-861f-4467-8270-ec324faf91e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:31.534654 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4caee-861f-4467-8270-ec324faf91e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:31.535445 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc4caee-861f-4467-8270-ec324faf91e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:31.537441 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc4caee-861f-4467-8270-ec324faf91e4 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:31.572233 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 966/1908] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:30:31 2022] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:30:31.576127 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ea1bd-dba7-457e-a85b-365a0fffe5f5 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:31.591793 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ea1bd-dba7-457e-a85b-365a0fffe5f5 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:31.703003 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1c2256-df8f-47a4-9c61-073e55df7e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:31.705767 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c2256-df8f-47a4-9c61-073e55df7e10 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:31.706299 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c2256-df8f-47a4-9c61-073e55df7e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:31.706897 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c2256-df8f-47a4-9c61-073e55df7e10 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:31.708628 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1c2256-df8f-47a4-9c61-073e55df7e10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:31.712458 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1c2256-df8f-47a4-9c61-073e55df7e10 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:31.764794 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 943/1909] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:30:31 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 03:30:31.771088 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc4caee-861f-4467-8270-ec324faf91e4 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:31.802961 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc4caee-861f-4467-8270-ec324faf91e4 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:31.853762 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47afeeb-f950-4c76-ab6d-7ff047d6adb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:31.855098 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47afeeb-f950-4c76-ab6d-7ff047d6adb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:31.855603 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47afeeb-f950-4c76-ab6d-7ff047d6adb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:31.856030 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47afeeb-f950-4c76-ab6d-7ff047d6adb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:31.856968 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47afeeb-f950-4c76-ab6d-7ff047d6adb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:31.860192 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47afeeb-f950-4c76-ab6d-7ff047d6adb3 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:31.894675 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 967/1910] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:30:31 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 03:30:31.895810 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1c2256-df8f-47a4-9c61-073e55df7e10 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:31.914820 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1c2256-df8f-47a4-9c61-073e55df7e10 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:31.924324 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d7c4f3-1f43-4b98-9461-64035cfb885f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:31.925029 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d7c4f3-1f43-4b98-9461-64035cfb885f admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:31.925303 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d7c4f3-1f43-4b98-9461-64035cfb885f admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:31.925579 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d7c4f3-1f43-4b98-9461-64035cfb885f admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:31.926321 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d7c4f3-1f43-4b98-9461-64035cfb885f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:31.928160 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d7c4f3-1f43-4b98-9461-64035cfb885f admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:31.954332 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 944/1911] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:30:31 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 03:30:31.955565 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47afeeb-f950-4c76-ab6d-7ff047d6adb3 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:32.007572 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47afeeb-f950-4c76-ab6d-7ff047d6adb3 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:32.029511 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a6e331-691d-4468-b68f-3ac57bc87956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:32.031008 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6e331-691d-4468-b68f-3ac57bc87956 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:32.031377 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6e331-691d-4468-b68f-3ac57bc87956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:32.031798 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6e331-691d-4468-b68f-3ac57bc87956 admin admin] PATH_INFO: `/v3/projects/45cd037e91f44d02a9c03b9200280d97/users/1f1716573912489a991f447b63700edc/roles/c43aada0326446c4ade0ab1262918fa4` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:32.054384 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a6e331-691d-4468-b68f-3ac57bc87956 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45cd037e91f44d02a9c03b9200280d97, user_id=1f1716573912489a991f447b63700edc, role_id=c43aada0326446c4ade0ab1262918fa4)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:32.060162 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a6e331-691d-4468-b68f-3ac57bc87956 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:32.083476 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 968/1912] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:30:31 2022] PUT /identity/v3/projects/45cd037e91f44d02a9c03b9200280d97/users/1f1716573912489a991f447b63700edc/roles/c43aada0326446c4ade0ab1262918fa4 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:30:32.092012 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12585c36-1b2e-49f2-a92d-b7c9faa8e7b3 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:32.092903 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12585c36-1b2e-49f2-a92d-b7c9faa8e7b3 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:32.093401 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12585c36-1b2e-49f2-a92d-b7c9faa8e7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:32.138271 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-12585c36-1b2e-49f2-a92d-b7c9faa8e7b3 None None] MFA Rules not processed for user `1f1716573912489a991f447b63700edc`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:30:32.140256 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-12585c36-1b2e-49f2-a92d-b7c9faa8e7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:32.295331 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 945/1913] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:30:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:30:32.300471 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a6e331-691d-4468-b68f-3ac57bc87956 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:32.470503 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a6e331-691d-4468-b68f-3ac57bc87956 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:32.481206 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b94e18f-d72a-46fb-9b2d-8191c100301c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:32.481966 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b94e18f-d72a-46fb-9b2d-8191c100301c admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:32.482389 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b94e18f-d72a-46fb-9b2d-8191c100301c admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:32.482815 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b94e18f-d72a-46fb-9b2d-8191c100301c admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:32.483759 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b94e18f-d72a-46fb-9b2d-8191c100301c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:32.485772 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b94e18f-d72a-46fb-9b2d-8191c100301c admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:32.558719 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 969/1914] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:30:32 2022] POST /identity/v3/projects => generated 387 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:30:32.563605 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12585c36-1b2e-49f2-a92d-b7c9faa8e7b3 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:32.603575 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12585c36-1b2e-49f2-a92d-b7c9faa8e7b3 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:32.703568 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:32.764055 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee203d3-9c9d-4777-ae16-04213fb9d4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:32.764952 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee203d3-9c9d-4777-ae16-04213fb9d4f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:32.765430 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee203d3-9c9d-4777-ae16-04213fb9d4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:32.765883 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee203d3-9c9d-4777-ae16-04213fb9d4f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:32.769319 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee203d3-9c9d-4777-ae16-04213fb9d4f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:32.773486 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee203d3-9c9d-4777-ae16-04213fb9d4f3 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:32.807590 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 946/1915] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:30:32 2022] POST /identity/v3/users => generated 300 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:30:32.809063 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b94e18f-d72a-46fb-9b2d-8191c100301c admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:32.822202 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b94e18f-d72a-46fb-9b2d-8191c100301c admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:32.829412 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20cddaf-f627-42ee-83e2-68877d1a8ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:32.830697 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20cddaf-f627-42ee-83e2-68877d1a8ee0 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:32.831056 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20cddaf-f627-42ee-83e2-68877d1a8ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:32.831435 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20cddaf-f627-42ee-83e2-68877d1a8ee0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:32.833280 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20cddaf-f627-42ee-83e2-68877d1a8ee0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:32.835625 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20cddaf-f627-42ee-83e2-68877d1a8ee0 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:32.843239 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:32.896345 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 970/1916] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:30:32 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:30:32.897546 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee203d3-9c9d-4777-ae16-04213fb9d4f3 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:32.918164 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee203d3-9c9d-4777-ae16-04213fb9d4f3 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:32.927311 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cab0d9-035f-4305-8741-471a734e2fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:32.929628 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cab0d9-035f-4305-8741-471a734e2fff admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:32.930075 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cab0d9-035f-4305-8741-471a734e2fff admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:32.930530 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cab0d9-035f-4305-8741-471a734e2fff admin admin] PATH_INFO: `/v3/projects/33b28b5ebeca42abab38233d58cc868d/users/34668c1bbb7c40fe84a07b47db2cccda/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:32.956371 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cab0d9-035f-4305-8741-471a734e2fff admin admin] RBAC: Authorizing `identity:create_grant(project_id=33b28b5ebeca42abab38233d58cc868d, user_id=34668c1bbb7c40fe84a07b47db2cccda, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:32.956684 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20cddaf-f627-42ee-83e2-68877d1a8ee0 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:32.958842 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-b20cddaf-f627-42ee-83e2-68877d1a8ee0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:32.959794 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cab0d9-035f-4305-8741-471a734e2fff admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:32.990321 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 947/1917] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:30:32 2022] PUT /identity/v3/projects/33b28b5ebeca42abab38233d58cc868d/users/34668c1bbb7c40fe84a07b47db2cccda/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:30:32.994197 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cab0d9-035f-4305-8741-471a734e2fff admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:32.994714 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20cddaf-f627-42ee-83e2-68877d1a8ee0 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:33.082000 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4430ea-86b4-4ad6-942d-729e27c1c1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:33.084127 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4430ea-86b4-4ad6-942d-729e27c1c1eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:33.084567 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4430ea-86b4-4ad6-942d-729e27c1c1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:33.085000 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4430ea-86b4-4ad6-942d-729e27c1c1eb admin admin] PATH_INFO: `/v3/users/4ba5735c0af04f2885152e154c470b32` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:33.101213 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4430ea-86b4-4ad6-942d-729e27c1c1eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ba5735c0af04f2885152e154c470b32)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:33.105794 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4430ea-86b4-4ad6-942d-729e27c1c1eb admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:33.106330 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cab0d9-035f-4305-8741-471a734e2fff admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:33.113237 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d9d81-aee0-4321-beda-59bd1d08a117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:33.113977 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d9d81-aee0-4321-beda-59bd1d08a117 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:33.114246 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d9d81-aee0-4321-beda-59bd1d08a117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:33.114528 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d9d81-aee0-4321-beda-59bd1d08a117 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:33.123923 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493d9d81-aee0-4321-beda-59bd1d08a117 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:33.128397 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493d9d81-aee0-4321-beda-59bd1d08a117 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:33.146556 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 948/1918] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:30:32 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:30:33.151386 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d9d81-aee0-4321-beda-59bd1d08a117 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:33.167143 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d9d81-aee0-4321-beda-59bd1d08a117 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:33.173280 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988d34d5-3640-4aba-9940-8baaf10a196f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:33.175987 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d34d5-3640-4aba-9940-8baaf10a196f admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:33.177759 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d34d5-3640-4aba-9940-8baaf10a196f admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:33.177900 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d34d5-3640-4aba-9940-8baaf10a196f admin admin] PATH_INFO: `/v3/projects/33b28b5ebeca42abab38233d58cc868d/users/34668c1bbb7c40fe84a07b47db2cccda/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:33.181396 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988d34d5-3640-4aba-9940-8baaf10a196f admin admin] RBAC: Authorizing `identity:create_grant(project_id=33b28b5ebeca42abab38233d58cc868d, user_id=34668c1bbb7c40fe84a07b47db2cccda, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:33.185362 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988d34d5-3640-4aba-9940-8baaf10a196f admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:33.187156 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-dc4430ea-86b4-4ad6-942d-729e27c1c1eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ba5735c0af04f2885152e154c470b32'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:33.188162 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-dc4430ea-86b4-4ad6-942d-729e27c1c1eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ba5735c0af04f2885152e154c470b32'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:33.200470 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-dc4430ea-86b4-4ad6-942d-729e27c1c1eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ba5735c0af04f2885152e154c470b32'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:33.201120 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-dc4430ea-86b4-4ad6-942d-729e27c1c1eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ba5735c0af04f2885152e154c470b32'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:33.207198 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 949/1919] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:30:33 2022] PUT /identity/v3/projects/33b28b5ebeca42abab38233d58cc868d/users/34668c1bbb7c40fe84a07b47db2cccda/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:30:33.219336 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2726f7b-68ea-4fa1-b920-846dcd2f2b11 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:33.219818 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2726f7b-68ea-4fa1-b920-846dcd2f2b11 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:33.220501 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2726f7b-68ea-4fa1-b920-846dcd2f2b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:33.222357 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-dc4430ea-86b4-4ad6-942d-729e27c1c1eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ba5735c0af04f2885152e154c470b32'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:33.242680 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 971/1920] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:30:32 2022] DELETE /identity/v3/users/4ba5735c0af04f2885152e154c470b32 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:30:33.248887 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061bce3b-677f-4912-994c-4c87ddae9747 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:33.249266 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061bce3b-677f-4912-994c-4c87ddae9747 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:33.249635 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061bce3b-677f-4912-994c-4c87ddae9747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:33.259367 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-f2726f7b-68ea-4fa1-b920-846dcd2f2b11 None None] MFA Rules not processed for user `34668c1bbb7c40fe84a07b47db2cccda`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:30:33.261219 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f2726f7b-68ea-4fa1-b920-846dcd2f2b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:33.269632 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-061bce3b-677f-4912-994c-4c87ddae9747 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:30:33.271177 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-061bce3b-677f-4912-994c-4c87ddae9747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:33.348920 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 950/1921] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:30:33 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:30:33.355846 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 972/1922] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:30:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:30:33.360233 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2726f7b-68ea-4fa1-b920-846dcd2f2b11 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:33.361606 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f2726f7b-68ea-4fa1-b920-846dcd2f2b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:33.367307 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:33.371324 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061bce3b-677f-4912-994c-4c87ddae9747 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:33.373041 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-061bce3b-677f-4912-994c-4c87ddae9747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:33.403331 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:33.469738 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061bce3b-677f-4912-994c-4c87ddae9747 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:33.477108 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2726f7b-68ea-4fa1-b920-846dcd2f2b11 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:33.478036 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d636f8df-c568-41e0-8bf0-0af7acd748e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:33.478704 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636f8df-c568-41e0-8bf0-0af7acd748e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:33.479077 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636f8df-c568-41e0-8bf0-0af7acd748e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:33.479461 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636f8df-c568-41e0-8bf0-0af7acd748e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:33.484458 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fd1e19-2890-4e2c-a02d-8dae6be8607d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:33.486427 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd1e19-2890-4e2c-a02d-8dae6be8607d service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:33.486818 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd1e19-2890-4e2c-a02d-8dae6be8607d service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:33.487322 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd1e19-2890-4e2c-a02d-8dae6be8607d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:33.490951 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d636f8df-c568-41e0-8bf0-0af7acd748e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:33.492431 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d636f8df-c568-41e0-8bf0-0af7acd748e2 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:33.503390 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 973/1923] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:30:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:30:33.516739 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fd1e19-2890-4e2c-a02d-8dae6be8607d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:33.519192 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fd1e19-2890-4e2c-a02d-8dae6be8607d service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:33.535588 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 951/1924] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:30:33 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:30:33.576448 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d636f8df-c568-41e0-8bf0-0af7acd748e2 service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:33.581647 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-d636f8df-c568-41e0-8bf0-0af7acd748e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:33.606399 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d636f8df-c568-41e0-8bf0-0af7acd748e2 service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:33.615477 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae4c277-6740-4904-baa3-6dcb17faab44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:33.617359 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae4c277-6740-4904-baa3-6dcb17faab44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:33.617729 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae4c277-6740-4904-baa3-6dcb17faab44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:33.618079 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae4c277-6740-4904-baa3-6dcb17faab44 admin admin] PATH_INFO: `/v3/users/1f1716573912489a991f447b63700edc` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:33.619633 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae4c277-6740-4904-baa3-6dcb17faab44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f1716573912489a991f447b63700edc)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:33.621788 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae4c277-6740-4904-baa3-6dcb17faab44 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:33.700242 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-cae4c277-6740-4904-baa3-6dcb17faab44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f1716573912489a991f447b63700edc'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:33.701725 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-cae4c277-6740-4904-baa3-6dcb17faab44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f1716573912489a991f447b63700edc'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:33.731624 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-cae4c277-6740-4904-baa3-6dcb17faab44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f1716573912489a991f447b63700edc'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:33.733737 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-cae4c277-6740-4904-baa3-6dcb17faab44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f1716573912489a991f447b63700edc'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:33.762841 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-cae4c277-6740-4904-baa3-6dcb17faab44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f1716573912489a991f447b63700edc'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:33.795065 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 974/1925] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:30:33 2022] DELETE /identity/v3/users/1f1716573912489a991f447b63700edc => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:30:33.800721 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2566c5ee-b145-4746-aa00-4cd5540f8c45 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:33.801299 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2566c5ee-b145-4746-aa00-4cd5540f8c45 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:33.801634 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2566c5ee-b145-4746-aa00-4cd5540f8c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:33.831411 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-2566c5ee-b145-4746-aa00-4cd5540f8c45 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:30:33.832652 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2566c5ee-b145-4746-aa00-4cd5540f8c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:33.911880 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 952/1926] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:30:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:30:33.924690 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae4c277-6740-4904-baa3-6dcb17faab44 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:33.926127 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-cae4c277-6740-4904-baa3-6dcb17faab44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:34.014286 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae4c277-6740-4904-baa3-6dcb17faab44 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:34.017970 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a29a65f-c924-46cf-b30c-e203a65d55d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:34.018649 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29a65f-c924-46cf-b30c-e203a65d55d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:34.018924 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29a65f-c924-46cf-b30c-e203a65d55d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:34.020172 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29a65f-c924-46cf-b30c-e203a65d55d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:34.041874 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a29a65f-c924-46cf-b30c-e203a65d55d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:34.043851 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a29a65f-c924-46cf-b30c-e203a65d55d2 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:34.055079 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 975/1927] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:30:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:30:34.067510 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2566c5ee-b145-4746-aa00-4cd5540f8c45 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:34.069742 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2566c5ee-b145-4746-aa00-4cd5540f8c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:34.088366 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2566c5ee-b145-4746-aa00-4cd5540f8c45 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:34.113242 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc832cb7-0b53-4e29-a8ae-5273873e6b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:34.116670 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc832cb7-0b53-4e29-a8ae-5273873e6b89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:34.118498 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc832cb7-0b53-4e29-a8ae-5273873e6b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:34.119039 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc832cb7-0b53-4e29-a8ae-5273873e6b89 admin admin] PATH_INFO: `/v3/projects/42dfdcfa91fe42478eee520dfe5ac57f` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:34.122341 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc832cb7-0b53-4e29-a8ae-5273873e6b89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42dfdcfa91fe42478eee520dfe5ac57f)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:34.125796 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc832cb7-0b53-4e29-a8ae-5273873e6b89 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:34.223227 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-bc832cb7-0b53-4e29-a8ae-5273873e6b89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42dfdcfa91fe42478eee520dfe5ac57f', 'request_id': 'req-bc832cb7-0b53-4e29-a8ae-5273873e6b89'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:34.233539 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-bc832cb7-0b53-4e29-a8ae-5273873e6b89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42dfdcfa91fe42478eee520dfe5ac57f', 'request_id': 'req-bc832cb7-0b53-4e29-a8ae-5273873e6b89'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:34.258469 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-bc832cb7-0b53-4e29-a8ae-5273873e6b89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42dfdcfa91fe42478eee520dfe5ac57f', 'request_id': 'req-bc832cb7-0b53-4e29-a8ae-5273873e6b89'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:34.287294 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-bc832cb7-0b53-4e29-a8ae-5273873e6b89 admin admin] The token cache is being invalidate because project 42dfdcfa91fe42478eee520dfe5ac57f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:30:34.288063 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-bc832cb7-0b53-4e29-a8ae-5273873e6b89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:34.289065 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-bc832cb7-0b53-4e29-a8ae-5273873e6b89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:34.297196 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a29a65f-c924-46cf-b30c-e203a65d55d2 service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:34.309375 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a29a65f-c924-46cf-b30c-e203a65d55d2 service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:34.314324 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 953/1928] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:30:34 2022] DELETE /identity/v3/projects/42dfdcfa91fe42478eee520dfe5ac57f => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:30:34.419455 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:34.474422 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d31bc0-d349-4c91-b726-29d7c4e24f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:34.475552 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d31bc0-d349-4c91-b726-29d7c4e24f33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:34.475828 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d31bc0-d349-4c91-b726-29d7c4e24f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:34.476099 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d31bc0-d349-4c91-b726-29d7c4e24f33 admin admin] PATH_INFO: `/v3/users/942ee89c665b4c72bd57c65577f5622b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:34.480553 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d31bc0-d349-4c91-b726-29d7c4e24f33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=942ee89c665b4c72bd57c65577f5622b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:34.482314 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d31bc0-d349-4c91-b726-29d7c4e24f33 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:34.563635 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-65d31bc0-d349-4c91-b726-29d7c4e24f33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '942ee89c665b4c72bd57c65577f5622b'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:34.564301 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-65d31bc0-d349-4c91-b726-29d7c4e24f33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '942ee89c665b4c72bd57c65577f5622b'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:34.577067 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-65d31bc0-d349-4c91-b726-29d7c4e24f33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '942ee89c665b4c72bd57c65577f5622b'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:34.578225 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-65d31bc0-d349-4c91-b726-29d7c4e24f33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '942ee89c665b4c72bd57c65577f5622b'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:34.601563 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-65d31bc0-d349-4c91-b726-29d7c4e24f33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '942ee89c665b4c72bd57c65577f5622b'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:34.606687 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc832cb7-0b53-4e29-a8ae-5273873e6b89 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:34.611615 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-bc832cb7-0b53-4e29-a8ae-5273873e6b89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:34.625801 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 976/1929] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:30:34 2022] DELETE /identity/v3/users/942ee89c665b4c72bd57c65577f5622b => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:30:34.640754 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc832cb7-0b53-4e29-a8ae-5273873e6b89 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:34.686857 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:34.748710 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b2eff4-756c-44ef-8eeb-dc1b667de0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:34.749654 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b2eff4-756c-44ef-8eeb-dc1b667de0d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:34.749961 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b2eff4-756c-44ef-8eeb-dc1b667de0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:34.750260 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b2eff4-756c-44ef-8eeb-dc1b667de0d2 admin admin] PATH_INFO: `/v3/projects/45cd037e91f44d02a9c03b9200280d97` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:34.751688 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b2eff4-756c-44ef-8eeb-dc1b667de0d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45cd037e91f44d02a9c03b9200280d97)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:34.754290 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b2eff4-756c-44ef-8eeb-dc1b667de0d2 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:34.837787 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-27b2eff4-756c-44ef-8eeb-dc1b667de0d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45cd037e91f44d02a9c03b9200280d97', 'request_id': 'req-27b2eff4-756c-44ef-8eeb-dc1b667de0d2'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:34.875979 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-27b2eff4-756c-44ef-8eeb-dc1b667de0d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45cd037e91f44d02a9c03b9200280d97', 'request_id': 'req-27b2eff4-756c-44ef-8eeb-dc1b667de0d2'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:34.895977 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-27b2eff4-756c-44ef-8eeb-dc1b667de0d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45cd037e91f44d02a9c03b9200280d97', 'request_id': 'req-27b2eff4-756c-44ef-8eeb-dc1b667de0d2'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:34.913598 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-27b2eff4-756c-44ef-8eeb-dc1b667de0d2 admin admin] The token cache is being invalidate because project 45cd037e91f44d02a9c03b9200280d97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:30:34.914102 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-27b2eff4-756c-44ef-8eeb-dc1b667de0d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:34.916815 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-27b2eff4-756c-44ef-8eeb-dc1b667de0d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:34.918867 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 954/1930] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:30:34 2022] DELETE /identity/v3/projects/45cd037e91f44d02a9c03b9200280d97 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:30:34.924411 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d31bc0-d349-4c91-b726-29d7c4e24f33 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:34.926187 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-65d31bc0-d349-4c91-b726-29d7c4e24f33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:34.952330 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d31bc0-d349-4c91-b726-29d7c4e24f33 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:35.041566 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f03ade6-f7b5-4ac6-83fe-52a9b39dc396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:35.042460 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03ade6-f7b5-4ac6-83fe-52a9b39dc396 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:35.042740 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03ade6-f7b5-4ac6-83fe-52a9b39dc396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:35.043008 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03ade6-f7b5-4ac6-83fe-52a9b39dc396 admin admin] PATH_INFO: `/v3/users/34668c1bbb7c40fe84a07b47db2cccda` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:35.044299 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f03ade6-f7b5-4ac6-83fe-52a9b39dc396 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34668c1bbb7c40fe84a07b47db2cccda)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:35.046411 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f03ade6-f7b5-4ac6-83fe-52a9b39dc396 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:35.156814 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-8f03ade6-f7b5-4ac6-83fe-52a9b39dc396 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34668c1bbb7c40fe84a07b47db2cccda'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:35.157654 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-8f03ade6-f7b5-4ac6-83fe-52a9b39dc396 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34668c1bbb7c40fe84a07b47db2cccda'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:35.190166 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-8f03ade6-f7b5-4ac6-83fe-52a9b39dc396 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34668c1bbb7c40fe84a07b47db2cccda'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:35.190516 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-8f03ade6-f7b5-4ac6-83fe-52a9b39dc396 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34668c1bbb7c40fe84a07b47db2cccda'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:35.202476 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b2eff4-756c-44ef-8eeb-dc1b667de0d2 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:35.204970 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-27b2eff4-756c-44ef-8eeb-dc1b667de0d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:35.208885 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:35.238962 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b2eff4-756c-44ef-8eeb-dc1b667de0d2 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:35.246445 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20e7c64-1a04-4652-bfa6-1d447f0e6fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:35.247559 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e7c64-1a04-4652-bfa6-1d447f0e6fc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:35.247814 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e7c64-1a04-4652-bfa6-1d447f0e6fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:35.248201 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e7c64-1a04-4652-bfa6-1d447f0e6fc2 admin admin] PATH_INFO: `/v3/projects/16402bfddaf74eb3af5cec83ba81252f` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:35.249567 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20e7c64-1a04-4652-bfa6-1d447f0e6fc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16402bfddaf74eb3af5cec83ba81252f)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:35.251977 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20e7c64-1a04-4652-bfa6-1d447f0e6fc2 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:35.257464 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-8f03ade6-f7b5-4ac6-83fe-52a9b39dc396 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34668c1bbb7c40fe84a07b47db2cccda'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:35.277040 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 977/1931] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:30:34 2022] DELETE /identity/v3/users/34668c1bbb7c40fe84a07b47db2cccda => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:30:35.318905 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f20e7c64-1a04-4652-bfa6-1d447f0e6fc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16402bfddaf74eb3af5cec83ba81252f', 'request_id': 'req-f20e7c64-1a04-4652-bfa6-1d447f0e6fc2'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:35.344638 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f20e7c64-1a04-4652-bfa6-1d447f0e6fc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16402bfddaf74eb3af5cec83ba81252f', 'request_id': 'req-f20e7c64-1a04-4652-bfa6-1d447f0e6fc2'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:35.377182 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f20e7c64-1a04-4652-bfa6-1d447f0e6fc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16402bfddaf74eb3af5cec83ba81252f', 'request_id': 'req-f20e7c64-1a04-4652-bfa6-1d447f0e6fc2'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:35.410638 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f20e7c64-1a04-4652-bfa6-1d447f0e6fc2 admin admin] The token cache is being invalidate because project 16402bfddaf74eb3af5cec83ba81252f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:30:35.411027 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f20e7c64-1a04-4652-bfa6-1d447f0e6fc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:35.411741 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f20e7c64-1a04-4652-bfa6-1d447f0e6fc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:35.413511 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 955/1932] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:30:35 2022] DELETE /identity/v3/projects/16402bfddaf74eb3af5cec83ba81252f => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:30:35.418831 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629805cd-09a0-4ad8-a868-37d0176670a2 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:35.419148 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629805cd-09a0-4ad8-a868-37d0176670a2 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:35.419526 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629805cd-09a0-4ad8-a868-37d0176670a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:35.443654 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-629805cd-09a0-4ad8-a868-37d0176670a2 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:30:35.445082 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-629805cd-09a0-4ad8-a868-37d0176670a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:35.525303 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 978/1933] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:30:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:30:35.533109 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac2e031-1422-4251-84f4-ea6463b37b2b None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:35.533881 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac2e031-1422-4251-84f4-ea6463b37b2b None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:35.534371 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac2e031-1422-4251-84f4-ea6463b37b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:35.557041 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-dac2e031-1422-4251-84f4-ea6463b37b2b None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:30:35.558618 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-dac2e031-1422-4251-84f4-ea6463b37b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:35.570121 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 956/1934] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:30:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:30:35.574266 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629805cd-09a0-4ad8-a868-37d0176670a2 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:35.587302 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629805cd-09a0-4ad8-a868-37d0176670a2 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:35.593593 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a4c272-9736-4126-a1e9-332e8ee8ce97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:35.599208 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4c272-9736-4126-a1e9-332e8ee8ce97 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:35.599208 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4c272-9736-4126-a1e9-332e8ee8ce97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:35.599208 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4c272-9736-4126-a1e9-332e8ee8ce97 admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:35.599208 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a4c272-9736-4126-a1e9-332e8ee8ce97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:30:35.599208 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a4c272-9736-4126-a1e9-332e8ee8ce97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:35.599208 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a4c272-9736-4126-a1e9-332e8ee8ce97 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:35.613243 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 979/1935] 10.222.0.60 () {58 vars in 1152 bytes} [Sat Jul 2 03:30:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:30:35.617742 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac2e031-1422-4251-84f4-ea6463b37b2b None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:35.637940 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac2e031-1422-4251-84f4-ea6463b37b2b None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:35.645558 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd144be1-863d-4a0d-9f65-7442826cc434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:35.646548 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd144be1-863d-4a0d-9f65-7442826cc434 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:35.646826 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd144be1-863d-4a0d-9f65-7442826cc434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:35.647095 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd144be1-863d-4a0d-9f65-7442826cc434 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:35.647834 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd144be1-863d-4a0d-9f65-7442826cc434 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:35.649749 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd144be1-863d-4a0d-9f65-7442826cc434 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:35.679791 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 957/1936] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:30:35 2022] POST /identity/v3/projects => generated 399 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:30:35.683780 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a4c272-9736-4126-a1e9-332e8ee8ce97 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:35.694741 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a4c272-9736-4126-a1e9-332e8ee8ce97 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:35.758712 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd144be1-863d-4a0d-9f65-7442826cc434 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:35.765648 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-cd144be1-863d-4a0d-9f65-7442826cc434 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:35.785228 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d5811a-4481-4690-ba68-97a8d3999fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:35.785490 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5811a-4481-4690-ba68-97a8d3999fa8 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:35.785865 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5811a-4481-4690-ba68-97a8d3999fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:35.786259 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5811a-4481-4690-ba68-97a8d3999fa8 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:35.786951 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d5811a-4481-4690-ba68-97a8d3999fa8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:35.798630 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:35.802725 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d5811a-4481-4690-ba68-97a8d3999fa8 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:35.834004 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 980/1937] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:30:35 2022] POST /identity/v3/users => generated 300 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 03:30:35.840397 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d5811a-4481-4690-ba68-97a8d3999fa8 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:35.851489 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d5811a-4481-4690-ba68-97a8d3999fa8 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:35.856692 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25535697-c6c5-4567-a834-9b43728bb548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:35.857602 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25535697-c6c5-4567-a834-9b43728bb548 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:35.858066 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25535697-c6c5-4567-a834-9b43728bb548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:35.858546 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25535697-c6c5-4567-a834-9b43728bb548 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:35.859489 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25535697-c6c5-4567-a834-9b43728bb548 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:35.863178 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25535697-c6c5-4567-a834-9b43728bb548 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:35.872615 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 981/1938] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:30:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:30:35.876433 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25535697-c6c5-4567-a834-9b43728bb548 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:35.887163 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25535697-c6c5-4567-a834-9b43728bb548 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:35.892459 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a53adc-7a52-4738-8f4c-b5ab8ed5055f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:35.893651 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a53adc-7a52-4738-8f4c-b5ab8ed5055f admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:35.894115 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a53adc-7a52-4738-8f4c-b5ab8ed5055f admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:35.894232 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a53adc-7a52-4738-8f4c-b5ab8ed5055f admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:35.894944 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a53adc-7a52-4738-8f4c-b5ab8ed5055f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:35.897046 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a53adc-7a52-4738-8f4c-b5ab8ed5055f admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:35.917237 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 982/1939] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:30:35 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 03:30:35.919433 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a53adc-7a52-4738-8f4c-b5ab8ed5055f admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:35.919882 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd144be1-863d-4a0d-9f65-7442826cc434 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:35.929308 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e536be92-ea9a-4527-b219-f8a1ac29b122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:35.930537 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e536be92-ea9a-4527-b219-f8a1ac29b122 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:35.930949 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e536be92-ea9a-4527-b219-f8a1ac29b122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:35.932011 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e536be92-ea9a-4527-b219-f8a1ac29b122 admin admin] PATH_INFO: `/v3/projects/33b28b5ebeca42abab38233d58cc868d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:35.932841 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e536be92-ea9a-4527-b219-f8a1ac29b122 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33b28b5ebeca42abab38233d58cc868d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:35.935556 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e536be92-ea9a-4527-b219-f8a1ac29b122 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:35.955511 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a53adc-7a52-4738-8f4c-b5ab8ed5055f admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:35.971850 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c0adb-bcee-47a5-9c0d-59941065a23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:35.972805 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c0adb-bcee-47a5-9c0d-59941065a23d admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:35.973118 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c0adb-bcee-47a5-9c0d-59941065a23d admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:35.975351 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c0adb-bcee-47a5-9c0d-59941065a23d admin admin] PATH_INFO: `/v3/projects/c3ae28a5168f4fcaa2e354d539386d03/users/3a8659b4e5e648cfa9baa17cc8dbb3a2/roles/c43aada0326446c4ade0ab1262918fa4` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:36.003659 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0c0adb-bcee-47a5-9c0d-59941065a23d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3ae28a5168f4fcaa2e354d539386d03, user_id=3a8659b4e5e648cfa9baa17cc8dbb3a2, role_id=c43aada0326446c4ade0ab1262918fa4)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:36.006932 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0c0adb-bcee-47a5-9c0d-59941065a23d admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:36.034731 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 983/1940] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:30:35 2022] PUT /identity/v3/projects/c3ae28a5168f4fcaa2e354d539386d03/users/3a8659b4e5e648cfa9baa17cc8dbb3a2/roles/c43aada0326446c4ade0ab1262918fa4 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:30:36.038657 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e536be92-ea9a-4527-b219-f8a1ac29b122 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33b28b5ebeca42abab38233d58cc868d', 'request_id': 'req-e536be92-ea9a-4527-b219-f8a1ac29b122'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:36.045155 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8ba7a-0072-4f30-abda-a8add90196cb None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:36.045651 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8ba7a-0072-4f30-abda-a8add90196cb None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:36.046106 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8ba7a-0072-4f30-abda-a8add90196cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:36.049671 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e536be92-ea9a-4527-b219-f8a1ac29b122 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33b28b5ebeca42abab38233d58cc868d', 'request_id': 'req-e536be92-ea9a-4527-b219-f8a1ac29b122'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:36.060259 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e536be92-ea9a-4527-b219-f8a1ac29b122 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33b28b5ebeca42abab38233d58cc868d', 'request_id': 'req-e536be92-ea9a-4527-b219-f8a1ac29b122'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:36.060467 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:36.078114 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e536be92-ea9a-4527-b219-f8a1ac29b122 admin admin] The token cache is being invalidate because project 33b28b5ebeca42abab38233d58cc868d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:30:36.078569 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e536be92-ea9a-4527-b219-f8a1ac29b122 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:36.079365 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e536be92-ea9a-4527-b219-f8a1ac29b122 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:36.081041 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 958/1941] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:30:35 2022] DELETE /identity/v3/projects/33b28b5ebeca42abab38233d58cc868d => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:30:36.081968 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-7bf8ba7a-0072-4f30-abda-a8add90196cb None None] MFA Rules not processed for user `3a8659b4e5e648cfa9baa17cc8dbb3a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:30:36.083597 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-7bf8ba7a-0072-4f30-abda-a8add90196cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:36.086334 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc2901-8b30-44da-a4c1-d6be8fca6d20 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:36.086743 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc2901-8b30-44da-a4c1-d6be8fca6d20 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:36.087162 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc2901-8b30-44da-a4c1-d6be8fca6d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:36.123226 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-5bbc2901-8b30-44da-a4c1-d6be8fca6d20 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:30:36.125236 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5bbc2901-8b30-44da-a4c1-d6be8fca6d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:36.216107 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 984/1942] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:30:36 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 03:30:36.220214 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf8ba7a-0072-4f30-abda-a8add90196cb None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:36.221921 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-7bf8ba7a-0072-4f30-abda-a8add90196cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:36.238736 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 959/1943] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:30:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:30:36.238982 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf8ba7a-0072-4f30-abda-a8add90196cb None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:36.242784 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc358943-de84-4682-9447-c0a0b2de41e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:36.244678 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694b060-a18d-4021-921c-d76f7a82bec7 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:36.244678 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694b060-a18d-4021-921c-d76f7a82bec7 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:36.244918 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc358943-de84-4682-9447-c0a0b2de41e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:36.244918 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc358943-de84-4682-9447-c0a0b2de41e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:36.244918 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc358943-de84-4682-9447-c0a0b2de41e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:36.245166 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694b060-a18d-4021-921c-d76f7a82bec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:36.245320 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc358943-de84-4682-9447-c0a0b2de41e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:36.247240 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc358943-de84-4682-9447-c0a0b2de41e8 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:36.276359 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-9694b060-a18d-4021-921c-d76f7a82bec7 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:30:36.278014 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9694b060-a18d-4021-921c-d76f7a82bec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:36.285253 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 985/1944] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:30:36 2022] POST /identity/v3/projects => generated 401 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:30:36.292240 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 960/1945] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:30:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:30:36.292926 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc358943-de84-4682-9447-c0a0b2de41e8 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:36.295249 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9694b060-a18d-4021-921c-d76f7a82bec7 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:36.310753 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9694b060-a18d-4021-921c-d76f7a82bec7 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:36.354546 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:36.400560 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc358943-de84-4682-9447-c0a0b2de41e8 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:36.409590 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcbc1e0-61b2-4ddc-a645-0366623af62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:36.411034 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcbc1e0-61b2-4ddc-a645-0366623af62f admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:36.411395 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcbc1e0-61b2-4ddc-a645-0366623af62f admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:36.411671 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcbc1e0-61b2-4ddc-a645-0366623af62f admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:36.412514 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcbc1e0-61b2-4ddc-a645-0366623af62f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:30:36.412822 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcbc1e0-61b2-4ddc-a645-0366623af62f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:36.413403 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b7bf7-c565-4d9d-95d2-d92fd261d02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:36.415174 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b7bf7-c565-4d9d-95d2-d92fd261d02e admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:36.415310 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcbc1e0-61b2-4ddc-a645-0366623af62f admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:36.415414 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b7bf7-c565-4d9d-95d2-d92fd261d02e admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:36.415414 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b7bf7-c565-4d9d-95d2-d92fd261d02e admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:36.418299 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4b7bf7-c565-4d9d-95d2-d92fd261d02e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:36.423256 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4b7bf7-c565-4d9d-95d2-d92fd261d02e admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:36.436261 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 961/1946] 10.222.0.60 () {58 vars in 1152 bytes} [Sat Jul 2 03:30:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:30:36.438726 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcbc1e0-61b2-4ddc-a645-0366623af62f admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:36.472109 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 986/1947] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:30:36 2022] POST /identity/v3/users => generated 307 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:30:36.473347 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b7bf7-c565-4d9d-95d2-d92fd261d02e admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:36.486526 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcbc1e0-61b2-4ddc-a645-0366623af62f admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:36.493347 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b7bf7-c565-4d9d-95d2-d92fd261d02e admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:36.499257 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531e74c7-5f4f-46f0-ba05-a80d8c475617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:36.500771 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e74c7-5f4f-46f0-ba05-a80d8c475617 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:36.501965 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e74c7-5f4f-46f0-ba05-a80d8c475617 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:36.503876 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e74c7-5f4f-46f0-ba05-a80d8c475617 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:36.507193 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531e74c7-5f4f-46f0-ba05-a80d8c475617 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:36.510002 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc9ae4-3afa-4008-97e8-ed1d37c48536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:36.510904 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc9ae4-3afa-4008-97e8-ed1d37c48536 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:36.511567 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc9ae4-3afa-4008-97e8-ed1d37c48536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:36.513178 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc9ae4-3afa-4008-97e8-ed1d37c48536 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:36.513719 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531e74c7-5f4f-46f0-ba05-a80d8c475617 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:36.514333 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dc9ae4-3afa-4008-97e8-ed1d37c48536 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:36.518242 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dc9ae4-3afa-4008-97e8-ed1d37c48536 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:36.544584 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 987/1948] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:30:36.547997 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc9ae4-3afa-4008-97e8-ed1d37c48536 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:36.566167 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc9ae4-3afa-4008-97e8-ed1d37c48536 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:36.572617 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 962/1949] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:30:36 2022] POST /identity/v3/projects => generated 377 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:30:36.579628 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978a78ce-e972-4d79-b1d4-3794f41357ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:36.580026 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531e74c7-5f4f-46f0-ba05-a80d8c475617 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:36.580752 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a78ce-e972-4d79-b1d4-3794f41357ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:36.581380 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a78ce-e972-4d79-b1d4-3794f41357ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:36.581878 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a78ce-e972-4d79-b1d4-3794f41357ab admin admin] PATH_INFO: `/v3/projects/7a07735a044940799c65e06ba804d660/users/6cd2782f05b74aa0be9128f7611d2b8f/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:36.606833 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978a78ce-e972-4d79-b1d4-3794f41357ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a07735a044940799c65e06ba804d660, user_id=6cd2782f05b74aa0be9128f7611d2b8f, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:36.610938 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978a78ce-e972-4d79-b1d4-3794f41357ab admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:36.635106 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 988/1950] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:30:36 2022] PUT /identity/v3/projects/7a07735a044940799c65e06ba804d660/users/6cd2782f05b74aa0be9128f7611d2b8f/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:30:36.639597 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978a78ce-e972-4d79-b1d4-3794f41357ab admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:36.705951 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:36.726841 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531e74c7-5f4f-46f0-ba05-a80d8c475617 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:36.755705 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978a78ce-e972-4d79-b1d4-3794f41357ab admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:36.764944 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df06dde0-cd25-4a3e-9cb6-83316d605db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:36.765706 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df06dde0-cd25-4a3e-9cb6-83316d605db1 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:36.766053 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df06dde0-cd25-4a3e-9cb6-83316d605db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:36.766294 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df06dde0-cd25-4a3e-9cb6-83316d605db1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:36.767038 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df06dde0-cd25-4a3e-9cb6-83316d605db1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:36.768677 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df06dde0-cd25-4a3e-9cb6-83316d605db1 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:36.797730 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 989/1951] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:30:36.803105 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df06dde0-cd25-4a3e-9cb6-83316d605db1 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:36.816541 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df06dde0-cd25-4a3e-9cb6-83316d605db1 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:36.823887 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62595f3-5260-4d1d-9196-16539ca13e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:36.825679 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62595f3-5260-4d1d-9196-16539ca13e34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:36.825679 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62595f3-5260-4d1d-9196-16539ca13e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:36.826463 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62595f3-5260-4d1d-9196-16539ca13e34 admin admin] PATH_INFO: `/v3/projects/7a07735a044940799c65e06ba804d660/users/6cd2782f05b74aa0be9128f7611d2b8f/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:36.828931 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62595f3-5260-4d1d-9196-16539ca13e34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a07735a044940799c65e06ba804d660, user_id=6cd2782f05b74aa0be9128f7611d2b8f, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:36.832483 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62595f3-5260-4d1d-9196-16539ca13e34 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:36.838835 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7546bfd-ca38-4d15-89be-5351269a60cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:36.839699 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7546bfd-ca38-4d15-89be-5351269a60cf admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:36.839959 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7546bfd-ca38-4d15-89be-5351269a60cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:36.841262 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7546bfd-ca38-4d15-89be-5351269a60cf admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:36.841262 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7546bfd-ca38-4d15-89be-5351269a60cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:36.844366 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7546bfd-ca38-4d15-89be-5351269a60cf admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:36.857376 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 990/1952] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:30:36 2022] PUT /identity/v3/projects/7a07735a044940799c65e06ba804d660/users/6cd2782f05b74aa0be9128f7611d2b8f/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 03:30:36.870012 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4509294b-7b1a-459c-acc9-a7262955747c None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:36.870012 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4509294b-7b1a-459c-acc9-a7262955747c None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:36.870289 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4509294b-7b1a-459c-acc9-a7262955747c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:36.882428 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 963/1953] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:30:36 2022] POST /identity/v3/users => generated 289 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:30:36.886726 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7546bfd-ca38-4d15-89be-5351269a60cf admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:36.901656 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7546bfd-ca38-4d15-89be-5351269a60cf admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:36.918663 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-4509294b-7b1a-459c-acc9-a7262955747c None None] MFA Rules not processed for user `6cd2782f05b74aa0be9128f7611d2b8f`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:30:36.923549 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-4509294b-7b1a-459c-acc9-a7262955747c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:36.976327 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:37.015641 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb9fcc0-366d-473b-9ecf-49e47848af18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:37.019224 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb9fcc0-366d-473b-9ecf-49e47848af18 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:37.019790 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb9fcc0-366d-473b-9ecf-49e47848af18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:37.020333 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb9fcc0-366d-473b-9ecf-49e47848af18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:37.021301 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb9fcc0-366d-473b-9ecf-49e47848af18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:37.028512 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb9fcc0-366d-473b-9ecf-49e47848af18 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:37.056451 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 964/1954] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:30:37.060812 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb9fcc0-366d-473b-9ecf-49e47848af18 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:37.084776 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb9fcc0-366d-473b-9ecf-49e47848af18 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:37.097167 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 991/1955] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:30:36 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 03:30:37.097969 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1ce12b-cb8e-4e17-af40-2aa1fe27af22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:37.098812 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ce12b-cb8e-4e17-af40-2aa1fe27af22 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:37.099212 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ce12b-cb8e-4e17-af40-2aa1fe27af22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:37.099824 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ce12b-cb8e-4e17-af40-2aa1fe27af22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:37.100801 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1ce12b-cb8e-4e17-af40-2aa1fe27af22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:37.103103 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1ce12b-cb8e-4e17-af40-2aa1fe27af22 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:37.110823 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4509294b-7b1a-459c-acc9-a7262955747c None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:37.112550 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-4509294b-7b1a-459c-acc9-a7262955747c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:37.135404 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 965/1956] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:30:37.139517 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1ce12b-cb8e-4e17-af40-2aa1fe27af22 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:37.167935 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1ce12b-cb8e-4e17-af40-2aa1fe27af22 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:37.178616 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a5ce7-a730-4f98-8c97-07c390e39e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:37.180953 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a5ce7-a730-4f98-8c97-07c390e39e79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:37.181344 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a5ce7-a730-4f98-8c97-07c390e39e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:37.181721 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a5ce7-a730-4f98-8c97-07c390e39e79 admin admin] PATH_INFO: `/v3/projects/404d9d5ab0c14f048be9156f16073623/users/32be5fba70d743be8fe85ad7df134bac/roles/c43aada0326446c4ade0ab1262918fa4` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:37.230378 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3a5ce7-a730-4f98-8c97-07c390e39e79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=404d9d5ab0c14f048be9156f16073623, user_id=32be5fba70d743be8fe85ad7df134bac, role_id=c43aada0326446c4ade0ab1262918fa4)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:37.234193 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3a5ce7-a730-4f98-8c97-07c390e39e79 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:37.261482 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4509294b-7b1a-459c-acc9-a7262955747c None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:37.268762 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 966/1957] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:30:37 2022] PUT /identity/v3/projects/404d9d5ab0c14f048be9156f16073623/users/32be5fba70d743be8fe85ad7df134bac/roles/c43aada0326446c4ade0ab1262918fa4 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:30:37.280475 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c22610-c6ba-4b07-b5aa-9d3ce4c2ee32 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:37.280769 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c22610-c6ba-4b07-b5aa-9d3ce4c2ee32 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:37.281092 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c22610-c6ba-4b07-b5aa-9d3ce4c2ee32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:37.344566 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-e6c22610-c6ba-4b07-b5aa-9d3ce4c2ee32 None None] MFA Rules not processed for user `32be5fba70d743be8fe85ad7df134bac`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:30:37.347077 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e6c22610-c6ba-4b07-b5aa-9d3ce4c2ee32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:37.383238 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f416860-3b62-4a8b-9b1c-58285340b592 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:37.383238 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f416860-3b62-4a8b-9b1c-58285340b592 service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:37.385525 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f416860-3b62-4a8b-9b1c-58285340b592 service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:37.385801 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f416860-3b62-4a8b-9b1c-58285340b592 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:37.395670 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:37.508941 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f416860-3b62-4a8b-9b1c-58285340b592 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:37.510531 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f416860-3b62-4a8b-9b1c-58285340b592 service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:37.523698 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 967/1958] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:30:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:30:37.523907 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 992/1959] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:30:37 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 03:30:37.525433 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c22610-c6ba-4b07-b5aa-9d3ce4c2ee32 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:37.616275 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f416860-3b62-4a8b-9b1c-58285340b592 service cinder] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:37.630262 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f416860-3b62-4a8b-9b1c-58285340b592 service cinder] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:37.636810 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c22610-c6ba-4b07-b5aa-9d3ce4c2ee32 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:37.638808 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1c8ee-d345-4e91-a9d0-17af138c36cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:37.639662 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1c8ee-d345-4e91-a9d0-17af138c36cd service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:37.639932 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1c8ee-d345-4e91-a9d0-17af138c36cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:37.640210 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1c8ee-d345-4e91-a9d0-17af138c36cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:37.651479 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7029c389-625d-4a23-a169-192b61f2a480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:37.654052 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029c389-625d-4a23-a169-192b61f2a480 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:37.654989 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029c389-625d-4a23-a169-192b61f2a480 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:37.655469 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029c389-625d-4a23-a169-192b61f2a480 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:37.657387 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7029c389-625d-4a23-a169-192b61f2a480 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:37.663826 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7029c389-625d-4a23-a169-192b61f2a480 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:37.755301 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 968/1960] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:30:37 2022] POST /identity/v3/projects => generated 379 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 03:30:37.763164 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7029c389-625d-4a23-a169-192b61f2a480 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:37.818830 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:37.828082 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf1c8ee-d345-4e91-a9d0-17af138c36cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:37.834195 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf1c8ee-d345-4e91-a9d0-17af138c36cd service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:37.851487 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 993/1961] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:30:37 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 03:30:37.900595 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7029c389-625d-4a23-a169-192b61f2a480 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:37.906420 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095bc718-5e13-476a-92f5-379b7e203796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:37.907819 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095bc718-5e13-476a-92f5-379b7e203796 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:37.908589 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095bc718-5e13-476a-92f5-379b7e203796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:37.909063 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095bc718-5e13-476a-92f5-379b7e203796 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:37.909952 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095bc718-5e13-476a-92f5-379b7e203796 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:37.913840 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095bc718-5e13-476a-92f5-379b7e203796 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:37.960717 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 969/1962] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:30:37 2022] POST /identity/v3/users => generated 296 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 03:30:37.964895 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1c8ee-d345-4e91-a9d0-17af138c36cd service cinder] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:37.981116 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1c8ee-d345-4e91-a9d0-17af138c36cd service cinder] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:37.993828 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4eacd4-f0d8-48d8-bf1f-6396cc05b22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:37.995061 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4eacd4-f0d8-48d8-bf1f-6396cc05b22f admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:37.995525 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4eacd4-f0d8-48d8-bf1f-6396cc05b22f admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:37.996098 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4eacd4-f0d8-48d8-bf1f-6396cc05b22f admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:37.997479 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4eacd4-f0d8-48d8-bf1f-6396cc05b22f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:38.000634 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4eacd4-f0d8-48d8-bf1f-6396cc05b22f admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:38.019061 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 994/1963] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:30:38.021417 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095bc718-5e13-476a-92f5-379b7e203796 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:38.038087 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095bc718-5e13-476a-92f5-379b7e203796 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:38.044963 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db6142e-d790-401a-9d24-a32d85c0ea17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:38.045755 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6142e-d790-401a-9d24-a32d85c0ea17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:38.046035 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6142e-d790-401a-9d24-a32d85c0ea17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:38.046297 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6142e-d790-401a-9d24-a32d85c0ea17 admin admin] PATH_INFO: `/v3/projects/86fa4b1ad0e44b6d824e922e58633193/users/3471320a6c7c4db4a7f651b5479ccad4/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:38.070818 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db6142e-d790-401a-9d24-a32d85c0ea17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86fa4b1ad0e44b6d824e922e58633193, user_id=3471320a6c7c4db4a7f651b5479ccad4, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:38.085491 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db6142e-d790-401a-9d24-a32d85c0ea17 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:38.135435 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 970/1964] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:30:38 2022] PUT /identity/v3/projects/86fa4b1ad0e44b6d824e922e58633193/users/3471320a6c7c4db4a7f651b5479ccad4/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:30:38.146203 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4eacd4-f0d8-48d8-bf1f-6396cc05b22f admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:38.168966 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4eacd4-f0d8-48d8-bf1f-6396cc05b22f admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:38.305363 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626f047f-039b-4e7b-a7ea-7afbe40e2fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:38.306128 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f047f-039b-4e7b-a7ea-7afbe40e2fdd admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:38.307049 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f047f-039b-4e7b-a7ea-7afbe40e2fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:38.307621 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f047f-039b-4e7b-a7ea-7afbe40e2fdd admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:38.309022 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626f047f-039b-4e7b-a7ea-7afbe40e2fdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:38.313885 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626f047f-039b-4e7b-a7ea-7afbe40e2fdd admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:38.346975 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 995/1965] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:30:38 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:30:38.350957 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db6142e-d790-401a-9d24-a32d85c0ea17 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:38.392874 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db6142e-d790-401a-9d24-a32d85c0ea17 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:38.408515 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e6aa1-8fe7-4679-90d6-8715617e6f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:38.411047 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e6aa1-8fe7-4679-90d6-8715617e6f49 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:38.411622 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e6aa1-8fe7-4679-90d6-8715617e6f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:38.411910 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e6aa1-8fe7-4679-90d6-8715617e6f49 admin admin] PATH_INFO: `/v3/projects/86fa4b1ad0e44b6d824e922e58633193/users/3471320a6c7c4db4a7f651b5479ccad4/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:38.416778 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2e6aa1-8fe7-4679-90d6-8715617e6f49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86fa4b1ad0e44b6d824e922e58633193, user_id=3471320a6c7c4db4a7f651b5479ccad4, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:38.423291 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2e6aa1-8fe7-4679-90d6-8715617e6f49 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:38.448872 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 971/1966] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:30:38 2022] PUT /identity/v3/projects/86fa4b1ad0e44b6d824e922e58633193/users/3471320a6c7c4db4a7f651b5479ccad4/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:30:38.459923 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473a344-3a71-4dd0-b7be-1780b3fa4c98 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:38.460208 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473a344-3a71-4dd0-b7be-1780b3fa4c98 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:38.460488 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473a344-3a71-4dd0-b7be-1780b3fa4c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:38.514803 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-a473a344-3a71-4dd0-b7be-1780b3fa4c98 None None] MFA Rules not processed for user `3471320a6c7c4db4a7f651b5479ccad4`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:30:38.517109 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-a473a344-3a71-4dd0-b7be-1780b3fa4c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:38.531375 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:38.642960 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 996/1967] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:30:38 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:30:38.655592 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e6aa1-8fe7-4679-90d6-8715617e6f49 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:38.804766 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e6aa1-8fe7-4679-90d6-8715617e6f49 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:38.809123 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c6a9e5-6b28-4f94-b8ee-f66aa8c8439d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:38.809786 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c6a9e5-6b28-4f94-b8ee-f66aa8c8439d service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:38.810356 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c6a9e5-6b28-4f94-b8ee-f66aa8c8439d service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:38.810356 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c6a9e5-6b28-4f94-b8ee-f66aa8c8439d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:38.821574 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c6a9e5-6b28-4f94-b8ee-f66aa8c8439d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:38.823074 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c6a9e5-6b28-4f94-b8ee-f66aa8c8439d service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:38.834631 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 972/1968] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:30:38 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:30:39.300092 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a473a344-3a71-4dd0-b7be-1780b3fa4c98 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:39.309990 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a473a344-3a71-4dd0-b7be-1780b3fa4c98 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:39.320634 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c487b-8bf3-4e8d-b1e3-4b18b6567e5e tempest-VolumeQuotaClassesTest-497693883 tempest-VolumeQuotaClassesTest-497693883-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3471320a6c7c4db4a7f651b5479ccad4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fa4b1ad0e44b6d824e922e58633193', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:39.320781 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c487b-8bf3-4e8d-b1e3-4b18b6567e5e tempest-VolumeQuotaClassesTest-497693883 tempest-VolumeQuotaClassesTest-497693883-project-admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:39.320974 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c487b-8bf3-4e8d-b1e3-4b18b6567e5e tempest-VolumeQuotaClassesTest-497693883 tempest-VolumeQuotaClassesTest-497693883-project-admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:39.321262 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c487b-8bf3-4e8d-b1e3-4b18b6567e5e tempest-VolumeQuotaClassesTest-497693883 tempest-VolumeQuotaClassesTest-497693883-project-admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:39.322354 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53c487b-8bf3-4e8d-b1e3-4b18b6567e5e tempest-VolumeQuotaClassesTest-497693883 tempest-VolumeQuotaClassesTest-497693883-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:30:39.323973 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53c487b-8bf3-4e8d-b1e3-4b18b6567e5e tempest-VolumeQuotaClassesTest-497693883 tempest-VolumeQuotaClassesTest-497693883-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:39.327889 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53c487b-8bf3-4e8d-b1e3-4b18b6567e5e tempest-VolumeQuotaClassesTest-497693883 tempest-VolumeQuotaClassesTest-497693883-project-admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:39.379488 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 997/1969] 10.222.0.60 () {58 vars in 1152 bytes} [Sat Jul 2 03:30:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:30:39.384049 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c6a9e5-6b28-4f94-b8ee-f66aa8c8439d service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:39.398999 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c6a9e5-6b28-4f94-b8ee-f66aa8c8439d service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:39.406154 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca05a7c-03a7-4410-bb38-9c2111cf3066 tempest-VolumeQuotaClassesTest-497693883 tempest-VolumeQuotaClassesTest-497693883-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3471320a6c7c4db4a7f651b5479ccad4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fa4b1ad0e44b6d824e922e58633193', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:39.406877 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca05a7c-03a7-4410-bb38-9c2111cf3066 tempest-VolumeQuotaClassesTest-497693883 tempest-VolumeQuotaClassesTest-497693883-project-admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:39.407212 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca05a7c-03a7-4410-bb38-9c2111cf3066 tempest-VolumeQuotaClassesTest-497693883 tempest-VolumeQuotaClassesTest-497693883-project-admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:39.407860 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca05a7c-03a7-4410-bb38-9c2111cf3066 tempest-VolumeQuotaClassesTest-497693883 tempest-VolumeQuotaClassesTest-497693883-project-admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:39.408251 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca05a7c-03a7-4410-bb38-9c2111cf3066 tempest-VolumeQuotaClassesTest-497693883 tempest-VolumeQuotaClassesTest-497693883-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:39.413218 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca05a7c-03a7-4410-bb38-9c2111cf3066 tempest-VolumeQuotaClassesTest-497693883 tempest-VolumeQuotaClassesTest-497693883-project-admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:39.462002 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 973/1970] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:30:39 2022] POST /identity/v3/projects => generated 354 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:30:39.463168 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c487b-8bf3-4e8d-b1e3-4b18b6567e5e tempest-VolumeQuotaClassesTest-497693883 tempest-VolumeQuotaClassesTest-497693883-project-admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:39.473786 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c487b-8bf3-4e8d-b1e3-4b18b6567e5e tempest-VolumeQuotaClassesTest-497693883 tempest-VolumeQuotaClassesTest-497693883-project-admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:39.583507 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632bdd44-0ac0-48b8-8b0d-5c06652a1979 tempest-VolumeQuotaClassesTest-497693883 tempest-VolumeQuotaClassesTest-497693883-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3471320a6c7c4db4a7f651b5479ccad4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fa4b1ad0e44b6d824e922e58633193', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:39.584231 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632bdd44-0ac0-48b8-8b0d-5c06652a1979 tempest-VolumeQuotaClassesTest-497693883 tempest-VolumeQuotaClassesTest-497693883-project-admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:39.585283 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632bdd44-0ac0-48b8-8b0d-5c06652a1979 tempest-VolumeQuotaClassesTest-497693883 tempest-VolumeQuotaClassesTest-497693883-project-admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:39.585283 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632bdd44-0ac0-48b8-8b0d-5c06652a1979 tempest-VolumeQuotaClassesTest-497693883 tempest-VolumeQuotaClassesTest-497693883-project-admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:39.585965 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632bdd44-0ac0-48b8-8b0d-5c06652a1979 tempest-VolumeQuotaClassesTest-497693883 tempest-VolumeQuotaClassesTest-497693883-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:30:39.586280 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632bdd44-0ac0-48b8-8b0d-5c06652a1979 tempest-VolumeQuotaClassesTest-497693883 tempest-VolumeQuotaClassesTest-497693883-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:39.587991 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632bdd44-0ac0-48b8-8b0d-5c06652a1979 tempest-VolumeQuotaClassesTest-497693883 tempest-VolumeQuotaClassesTest-497693883-project-admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:39.602110 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 998/1971] 10.222.0.60 () {58 vars in 1152 bytes} [Sat Jul 2 03:30:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:30:39.671628 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca05a7c-03a7-4410-bb38-9c2111cf3066 tempest-VolumeQuotaClassesTest-497693883 tempest-VolumeQuotaClassesTest-497693883-project-admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:39.692699 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca05a7c-03a7-4410-bb38-9c2111cf3066 tempest-VolumeQuotaClassesTest-497693883 tempest-VolumeQuotaClassesTest-497693883-project-admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:39.701261 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eb2cef-cc3a-4758-af11-1f1fb6c2a97f tempest-VolumeQuotaClassesTest-497693883 tempest-VolumeQuotaClassesTest-497693883-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3471320a6c7c4db4a7f651b5479ccad4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86fa4b1ad0e44b6d824e922e58633193', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:39.703014 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb2cef-cc3a-4758-af11-1f1fb6c2a97f tempest-VolumeQuotaClassesTest-497693883 tempest-VolumeQuotaClassesTest-497693883-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:39.703629 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb2cef-cc3a-4758-af11-1f1fb6c2a97f tempest-VolumeQuotaClassesTest-497693883 tempest-VolumeQuotaClassesTest-497693883-project-admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:39.704269 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb2cef-cc3a-4758-af11-1f1fb6c2a97f tempest-VolumeQuotaClassesTest-497693883 tempest-VolumeQuotaClassesTest-497693883-project-admin] PATH_INFO: `/v3/projects/ac3a4c820895485e8bb1aae6cea70c7a` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:39.706070 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eb2cef-cc3a-4758-af11-1f1fb6c2a97f tempest-VolumeQuotaClassesTest-497693883 tempest-VolumeQuotaClassesTest-497693883-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ac3a4c820895485e8bb1aae6cea70c7a)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:39.709798 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eb2cef-cc3a-4758-af11-1f1fb6c2a97f tempest-VolumeQuotaClassesTest-497693883 tempest-VolumeQuotaClassesTest-497693883-project-admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:39.829731 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-95eb2cef-cc3a-4758-af11-1f1fb6c2a97f tempest-VolumeQuotaClassesTest-497693883 tempest-VolumeQuotaClassesTest-497693883-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac3a4c820895485e8bb1aae6cea70c7a', 'request_id': 'req-95eb2cef-cc3a-4758-af11-1f1fb6c2a97f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:39.831511 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=90,keystone:INSERT=6,keystone:DELETE=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:39.836934 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-95eb2cef-cc3a-4758-af11-1f1fb6c2a97f tempest-VolumeQuotaClassesTest-497693883 tempest-VolumeQuotaClassesTest-497693883-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac3a4c820895485e8bb1aae6cea70c7a', 'request_id': 'req-95eb2cef-cc3a-4758-af11-1f1fb6c2a97f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:39.850674 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-95eb2cef-cc3a-4758-af11-1f1fb6c2a97f tempest-VolumeQuotaClassesTest-497693883 tempest-VolumeQuotaClassesTest-497693883-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac3a4c820895485e8bb1aae6cea70c7a', 'request_id': 'req-95eb2cef-cc3a-4758-af11-1f1fb6c2a97f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:39.870233 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-95eb2cef-cc3a-4758-af11-1f1fb6c2a97f tempest-VolumeQuotaClassesTest-497693883 tempest-VolumeQuotaClassesTest-497693883-project-admin] The token cache is being invalidate because project ac3a4c820895485e8bb1aae6cea70c7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:30:39.870932 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-95eb2cef-cc3a-4758-af11-1f1fb6c2a97f tempest-VolumeQuotaClassesTest-497693883 tempest-VolumeQuotaClassesTest-497693883-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:39.872470 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-95eb2cef-cc3a-4758-af11-1f1fb6c2a97f tempest-VolumeQuotaClassesTest-497693883 tempest-VolumeQuotaClassesTest-497693883-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:39.875262 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 974/1972] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:30:39 2022] DELETE /identity/v3/projects/ac3a4c820895485e8bb1aae6cea70c7a => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:30:40.218828 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632bdd44-0ac0-48b8-8b0d-5c06652a1979 tempest-VolumeQuotaClassesTest-497693883 tempest-VolumeQuotaClassesTest-497693883-project-admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:40.224676 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-632bdd44-0ac0-48b8-8b0d-5c06652a1979 tempest-VolumeQuotaClassesTest-497693883 tempest-VolumeQuotaClassesTest-497693883-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:40.389695 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632bdd44-0ac0-48b8-8b0d-5c06652a1979 tempest-VolumeQuotaClassesTest-497693883 tempest-VolumeQuotaClassesTest-497693883-project-admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:40.469838 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:40.490070 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e9e3a-6081-4a47-bef8-a9eeb7fb48e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:40.490953 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e9e3a-6081-4a47-bef8-a9eeb7fb48e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:40.491263 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e9e3a-6081-4a47-bef8-a9eeb7fb48e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:40.491535 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e9e3a-6081-4a47-bef8-a9eeb7fb48e3 admin admin] PATH_INFO: `/v3/users/32be5fba70d743be8fe85ad7df134bac` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:40.492704 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3e9e3a-6081-4a47-bef8-a9eeb7fb48e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32be5fba70d743be8fe85ad7df134bac)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:40.494616 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3e9e3a-6081-4a47-bef8-a9eeb7fb48e3 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:40.545296 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-ff3e9e3a-6081-4a47-bef8-a9eeb7fb48e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32be5fba70d743be8fe85ad7df134bac'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:40.546217 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-ff3e9e3a-6081-4a47-bef8-a9eeb7fb48e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32be5fba70d743be8fe85ad7df134bac'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:40.555317 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-ff3e9e3a-6081-4a47-bef8-a9eeb7fb48e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32be5fba70d743be8fe85ad7df134bac'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:40.556074 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-ff3e9e3a-6081-4a47-bef8-a9eeb7fb48e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32be5fba70d743be8fe85ad7df134bac'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:40.569700 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-ff3e9e3a-6081-4a47-bef8-a9eeb7fb48e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32be5fba70d743be8fe85ad7df134bac'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:40.582265 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 999/1973] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:30:40 2022] DELETE /identity/v3/users/32be5fba70d743be8fe85ad7df134bac => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:30:40.586785 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c713f4-de75-4606-b213-25c40f1f7e9c None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:40.587306 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c713f4-de75-4606-b213-25c40f1f7e9c None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:40.587397 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c713f4-de75-4606-b213-25c40f1f7e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:40.606343 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-31c713f4-de75-4606-b213-25c40f1f7e9c None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:30:40.607732 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-31c713f4-de75-4606-b213-25c40f1f7e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:40.677503 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 975/1974] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:30:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 03:30:40.687263 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e9e3a-6081-4a47-bef8-a9eeb7fb48e3 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:40.689212 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-ff3e9e3a-6081-4a47-bef8-a9eeb7fb48e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:40.758538 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e9e3a-6081-4a47-bef8-a9eeb7fb48e3 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:40.762863 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a46c1ef-e801-4e21-a02a-9f45cc26cb0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:40.763720 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a46c1ef-e801-4e21-a02a-9f45cc26cb0a service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:40.764195 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a46c1ef-e801-4e21-a02a-9f45cc26cb0a service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:40.764572 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a46c1ef-e801-4e21-a02a-9f45cc26cb0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:40.791497 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a46c1ef-e801-4e21-a02a-9f45cc26cb0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:40.794513 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a46c1ef-e801-4e21-a02a-9f45cc26cb0a service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:40.849657 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1000/1975] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:30:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 03:30:41.410252 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c713f4-de75-4606-b213-25c40f1f7e9c None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:41.413506 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-31c713f4-de75-4606-b213-25c40f1f7e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:41.428368 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c713f4-de75-4606-b213-25c40f1f7e9c None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:41.433548 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd37ee-2eb5-46fb-a155-d62d6bbfde32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:41.434524 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd37ee-2eb5-46fb-a155-d62d6bbfde32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:41.434904 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd37ee-2eb5-46fb-a155-d62d6bbfde32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:41.435315 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd37ee-2eb5-46fb-a155-d62d6bbfde32 admin admin] PATH_INFO: `/v3/projects/404d9d5ab0c14f048be9156f16073623` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:41.436664 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cd37ee-2eb5-46fb-a155-d62d6bbfde32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=404d9d5ab0c14f048be9156f16073623)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:41.438798 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cd37ee-2eb5-46fb-a155-d62d6bbfde32 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:41.490495 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f2cd37ee-2eb5-46fb-a155-d62d6bbfde32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '404d9d5ab0c14f048be9156f16073623', 'request_id': 'req-f2cd37ee-2eb5-46fb-a155-d62d6bbfde32'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:41.498344 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f2cd37ee-2eb5-46fb-a155-d62d6bbfde32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '404d9d5ab0c14f048be9156f16073623', 'request_id': 'req-f2cd37ee-2eb5-46fb-a155-d62d6bbfde32'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:41.509661 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f2cd37ee-2eb5-46fb-a155-d62d6bbfde32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '404d9d5ab0c14f048be9156f16073623', 'request_id': 'req-f2cd37ee-2eb5-46fb-a155-d62d6bbfde32'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:41.523291 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f2cd37ee-2eb5-46fb-a155-d62d6bbfde32 admin admin] The token cache is being invalidate because project 404d9d5ab0c14f048be9156f16073623 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:30:41.523677 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f2cd37ee-2eb5-46fb-a155-d62d6bbfde32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:41.524538 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f2cd37ee-2eb5-46fb-a155-d62d6bbfde32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:41.526221 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 976/1976] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:30:41 2022] DELETE /identity/v3/projects/404d9d5ab0c14f048be9156f16073623 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:30:41.530264 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a46c1ef-e801-4e21-a02a-9f45cc26cb0a service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:41.540278 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a46c1ef-e801-4e21-a02a-9f45cc26cb0a service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:41.622955 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4905a9b-6655-42c5-937f-f0a0ba3ae96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:41.623968 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4905a9b-6655-42c5-937f-f0a0ba3ae96c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:41.624254 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4905a9b-6655-42c5-937f-f0a0ba3ae96c admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:41.624531 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4905a9b-6655-42c5-937f-f0a0ba3ae96c admin admin] PATH_INFO: `/v3/users/3471320a6c7c4db4a7f651b5479ccad4` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:41.625759 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4905a9b-6655-42c5-937f-f0a0ba3ae96c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3471320a6c7c4db4a7f651b5479ccad4)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:41.628233 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4905a9b-6655-42c5-937f-f0a0ba3ae96c admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:41.633616 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:41.702288 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d4905a9b-6655-42c5-937f-f0a0ba3ae96c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3471320a6c7c4db4a7f651b5479ccad4'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:41.702966 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d4905a9b-6655-42c5-937f-f0a0ba3ae96c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3471320a6c7c4db4a7f651b5479ccad4'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:41.712303 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d4905a9b-6655-42c5-937f-f0a0ba3ae96c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3471320a6c7c4db4a7f651b5479ccad4'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:41.712995 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d4905a9b-6655-42c5-937f-f0a0ba3ae96c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3471320a6c7c4db4a7f651b5479ccad4'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:41.726872 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d4905a9b-6655-42c5-937f-f0a0ba3ae96c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3471320a6c7c4db4a7f651b5479ccad4'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:41.739756 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1001/1977] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:30:41 2022] DELETE /identity/v3/users/3471320a6c7c4db4a7f651b5479ccad4 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 03:30:42.015328 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd37ee-2eb5-46fb-a155-d62d6bbfde32 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:42.016830 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f2cd37ee-2eb5-46fb-a155-d62d6bbfde32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:42.033398 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd37ee-2eb5-46fb-a155-d62d6bbfde32 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:42.095783 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cbca16-f086-48ff-80a2-59de0f2e2d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:42.096730 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cbca16-f086-48ff-80a2-59de0f2e2d93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:42.097013 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cbca16-f086-48ff-80a2-59de0f2e2d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:42.097289 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cbca16-f086-48ff-80a2-59de0f2e2d93 admin admin] PATH_INFO: `/v3/projects/86fa4b1ad0e44b6d824e922e58633193` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:42.098683 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cbca16-f086-48ff-80a2-59de0f2e2d93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86fa4b1ad0e44b6d824e922e58633193)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:42.100655 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cbca16-f086-48ff-80a2-59de0f2e2d93 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:42.103244 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:42.201016 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-b4cbca16-f086-48ff-80a2-59de0f2e2d93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86fa4b1ad0e44b6d824e922e58633193', 'request_id': 'req-b4cbca16-f086-48ff-80a2-59de0f2e2d93'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:42.216936 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-b4cbca16-f086-48ff-80a2-59de0f2e2d93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86fa4b1ad0e44b6d824e922e58633193', 'request_id': 'req-b4cbca16-f086-48ff-80a2-59de0f2e2d93'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:42.231566 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-b4cbca16-f086-48ff-80a2-59de0f2e2d93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86fa4b1ad0e44b6d824e922e58633193', 'request_id': 'req-b4cbca16-f086-48ff-80a2-59de0f2e2d93'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:42.252386 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-b4cbca16-f086-48ff-80a2-59de0f2e2d93 admin admin] The token cache is being invalidate because project 86fa4b1ad0e44b6d824e922e58633193 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:30:42.252678 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-b4cbca16-f086-48ff-80a2-59de0f2e2d93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:42.253502 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-b4cbca16-f086-48ff-80a2-59de0f2e2d93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:42.259409 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 977/1978] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:30:42 2022] DELETE /identity/v3/projects/86fa4b1ad0e44b6d824e922e58633193 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:30:42.264069 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbfbd21-5cc2-4326-b8d1-be3c5d851060 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:42.264360 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbfbd21-5cc2-4326-b8d1-be3c5d851060 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:42.265154 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbfbd21-5cc2-4326-b8d1-be3c5d851060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:42.292296 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-6bbfbd21-5cc2-4326-b8d1-be3c5d851060 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:30:42.293535 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-6bbfbd21-5cc2-4326-b8d1-be3c5d851060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:42.374827 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1002/1979] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:30:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:30:42.376959 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce48d672-c446-4443-8a16-6e4264d7ea35 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:42.376959 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce48d672-c446-4443-8a16-6e4264d7ea35 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:42.377141 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce48d672-c446-4443-8a16-6e4264d7ea35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:42.403618 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-ce48d672-c446-4443-8a16-6e4264d7ea35 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:30:42.404817 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ce48d672-c446-4443-8a16-6e4264d7ea35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:42.413576 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 978/1980] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:30:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:30:42.418209 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbfbd21-5cc2-4326-b8d1-be3c5d851060 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:42.430486 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbfbd21-5cc2-4326-b8d1-be3c5d851060 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:42.444872 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c789a6-ae75-4626-a6f4-3d75f24bada6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:42.445671 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c789a6-ae75-4626-a6f4-3d75f24bada6 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:42.446018 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c789a6-ae75-4626-a6f4-3d75f24bada6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:42.446393 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c789a6-ae75-4626-a6f4-3d75f24bada6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:42.448338 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c789a6-ae75-4626-a6f4-3d75f24bada6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:30:42.449370 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c789a6-ae75-4626-a6f4-3d75f24bada6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:42.451241 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c789a6-ae75-4626-a6f4-3d75f24bada6 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:42.478926 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce48d672-c446-4443-8a16-6e4264d7ea35 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:42.483914 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1003/1981] 10.222.0.60 () {58 vars in 1152 bytes} [Sat Jul 2 03:30:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:30:42.491840 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce48d672-c446-4443-8a16-6e4264d7ea35 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:42.503990 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a9b69-d0e6-42fa-8662-a47ba088251e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:42.504505 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a9b69-d0e6-42fa-8662-a47ba088251e admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:42.505001 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a9b69-d0e6-42fa-8662-a47ba088251e admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:42.505458 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a9b69-d0e6-42fa-8662-a47ba088251e admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:42.506212 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66a9b69-d0e6-42fa-8662-a47ba088251e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:42.508215 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66a9b69-d0e6-42fa-8662-a47ba088251e admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:42.543889 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 979/1982] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:30:42 2022] POST /identity/v3/projects => generated 409 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:30:42.549516 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c789a6-ae75-4626-a6f4-3d75f24bada6 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:42.564493 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c789a6-ae75-4626-a6f4-3d75f24bada6 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:42.636972 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3af153-81b6-4900-abb9-f89e1fc699dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:42.637656 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3af153-81b6-4900-abb9-f89e1fc699dd admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:42.637942 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3af153-81b6-4900-abb9-f89e1fc699dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:42.638218 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3af153-81b6-4900-abb9-f89e1fc699dd admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:42.638966 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3af153-81b6-4900-abb9-f89e1fc699dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:42.640881 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3af153-81b6-4900-abb9-f89e1fc699dd admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:42.656299 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:42.656915 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a9b69-d0e6-42fa-8662-a47ba088251e admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:42.658587 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b66a9b69-d0e6-42fa-8662-a47ba088251e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:42.666611 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1004/1983] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:30:42 2022] POST /identity/v3/users => generated 305 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:30:42.667490 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3af153-81b6-4900-abb9-f89e1fc699dd admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:42.672102 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a9b69-d0e6-42fa-8662-a47ba088251e admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:42.677102 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3af153-81b6-4900-abb9-f89e1fc699dd admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:42.678075 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f490db6-7424-46f9-9651-a362d4f14485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:42.679022 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f490db6-7424-46f9-9651-a362d4f14485 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:42.679410 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f490db6-7424-46f9-9651-a362d4f14485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:42.679686 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f490db6-7424-46f9-9651-a362d4f14485 admin admin] PATH_INFO: `/v3/users/3a8659b4e5e648cfa9baa17cc8dbb3a2` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:42.680954 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f490db6-7424-46f9-9651-a362d4f14485 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a8659b4e5e648cfa9baa17cc8dbb3a2)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:42.682904 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f490db6-7424-46f9-9651-a362d4f14485 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:42.687581 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c2b94a-854b-408b-81e7-5c581d8cc4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:42.688330 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c2b94a-854b-408b-81e7-5c581d8cc4fd admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:42.688704 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c2b94a-854b-408b-81e7-5c581d8cc4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:42.688988 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c2b94a-854b-408b-81e7-5c581d8cc4fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:42.689722 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c2b94a-854b-408b-81e7-5c581d8cc4fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:42.691397 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c2b94a-854b-408b-81e7-5c581d8cc4fd admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:42.704236 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1005/1984] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:30:42.709131 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c2b94a-854b-408b-81e7-5c581d8cc4fd admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:42.720282 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c2b94a-854b-408b-81e7-5c581d8cc4fd admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:42.725181 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4037b15e-542c-46a1-8fa5-e01ff8e3d63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:42.725834 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4037b15e-542c-46a1-8fa5-e01ff8e3d63f admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:42.726125 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4037b15e-542c-46a1-8fa5-e01ff8e3d63f admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:42.726390 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4037b15e-542c-46a1-8fa5-e01ff8e3d63f admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:42.727157 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4037b15e-542c-46a1-8fa5-e01ff8e3d63f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:42.728798 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4037b15e-542c-46a1-8fa5-e01ff8e3d63f admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:42.740242 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1006/1985] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 03:30:42.744399 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4037b15e-542c-46a1-8fa5-e01ff8e3d63f admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:42.744548 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9f490db6-7424-46f9-9651-a362d4f14485 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a8659b4e5e648cfa9baa17cc8dbb3a2'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:42.745203 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9f490db6-7424-46f9-9651-a362d4f14485 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a8659b4e5e648cfa9baa17cc8dbb3a2'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:42.745983 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9f490db6-7424-46f9-9651-a362d4f14485 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a8659b4e5e648cfa9baa17cc8dbb3a2'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:42.754414 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4037b15e-542c-46a1-8fa5-e01ff8e3d63f admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:42.760021 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a43533-825c-4477-8a50-414336465c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:42.760902 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a43533-825c-4477-8a50-414336465c8c admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:42.761182 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a43533-825c-4477-8a50-414336465c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:42.761454 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a43533-825c-4477-8a50-414336465c8c admin admin] PATH_INFO: `/v3/projects/3fa19439bc9347ffb66f082d4f858a3c/users/5a72408cdd92443582101ced0d908a12/roles/c43aada0326446c4ade0ab1262918fa4` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:42.762160 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9f490db6-7424-46f9-9651-a362d4f14485 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a8659b4e5e648cfa9baa17cc8dbb3a2'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:42.769652 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-9f490db6-7424-46f9-9651-a362d4f14485 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a8659b4e5e648cfa9baa17cc8dbb3a2'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:42.777363 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a43533-825c-4477-8a50-414336465c8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fa19439bc9347ffb66f082d4f858a3c, user_id=5a72408cdd92443582101ced0d908a12, role_id=c43aada0326446c4ade0ab1262918fa4)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:42.780214 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a43533-825c-4477-8a50-414336465c8c admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:42.788859 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 980/1986] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:30:42 2022] DELETE /identity/v3/users/3a8659b4e5e648cfa9baa17cc8dbb3a2 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 03:30:42.793469 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd3a7c-5621-44eb-96ec-855c6cd38e9f None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:42.793763 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd3a7c-5621-44eb-96ec-855c6cd38e9f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:42.794033 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd3a7c-5621-44eb-96ec-855c6cd38e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:42.823193 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1007/1987] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:30:42 2022] PUT /identity/v3/projects/3fa19439bc9347ffb66f082d4f858a3c/users/5a72408cdd92443582101ced0d908a12/roles/c43aada0326446c4ade0ab1262918fa4 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:30:42.823436 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-b1fd3a7c-5621-44eb-96ec-855c6cd38e9f None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:30:42.823436 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b1fd3a7c-5621-44eb-96ec-855c6cd38e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:42.827047 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88985d9-a882-4a0a-8701-8ae4354b713d None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:42.827363 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88985d9-a882-4a0a-8701-8ae4354b713d None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:42.827640 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88985d9-a882-4a0a-8701-8ae4354b713d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:42.895616 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:42.906296 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-b88985d9-a882-4a0a-8701-8ae4354b713d None None] MFA Rules not processed for user `5a72408cdd92443582101ced0d908a12`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:30:42.907804 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-b88985d9-a882-4a0a-8701-8ae4354b713d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:42.966591 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 981/1988] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:30:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:30:42.977005 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fd3a7c-5621-44eb-96ec-855c6cd38e9f None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:42.978907 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b1fd3a7c-5621-44eb-96ec-855c6cd38e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:43.008387 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1008/1989] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:30:42 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 03:30:43.009928 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88985d9-a882-4a0a-8701-8ae4354b713d None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:43.011794 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-b88985d9-a882-4a0a-8701-8ae4354b713d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:43.027502 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88985d9-a882-4a0a-8701-8ae4354b713d None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:43.032870 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8c3c01-53b8-4ebc-87f3-0e48bbe3336c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:43.033616 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c3c01-53b8-4ebc-87f3-0e48bbe3336c admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:43.033894 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c3c01-53b8-4ebc-87f3-0e48bbe3336c admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:43.034164 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c3c01-53b8-4ebc-87f3-0e48bbe3336c admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:43.034917 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8c3c01-53b8-4ebc-87f3-0e48bbe3336c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:43.038165 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8c3c01-53b8-4ebc-87f3-0e48bbe3336c admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:43.056760 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fd3a7c-5621-44eb-96ec-855c6cd38e9f None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:43.065894 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6822da10-d497-4e6a-924a-99733cea8b32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:43.066274 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6822da10-d497-4e6a-924a-99733cea8b32 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:43.066897 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6822da10-d497-4e6a-924a-99733cea8b32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:43.067006 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6822da10-d497-4e6a-924a-99733cea8b32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:43.091703 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6822da10-d497-4e6a-924a-99733cea8b32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:43.093184 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6822da10-d497-4e6a-924a-99733cea8b32 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:43.100333 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1009/1990] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:30:43 2022] POST /identity/v3/projects => generated 407 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:30:43.103935 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8c3c01-53b8-4ebc-87f3-0e48bbe3336c admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:43.109443 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 982/1991] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:30:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 03:30:43.234848 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8c3c01-53b8-4ebc-87f3-0e48bbe3336c admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:43.244695 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759a5bd9-6b2b-4678-9515-5e1ca6a24dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:43.245143 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a5bd9-6b2b-4678-9515-5e1ca6a24dff admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:43.245493 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a5bd9-6b2b-4678-9515-5e1ca6a24dff admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:43.245834 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a5bd9-6b2b-4678-9515-5e1ca6a24dff admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:43.246470 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759a5bd9-6b2b-4678-9515-5e1ca6a24dff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:43.249687 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759a5bd9-6b2b-4678-9515-5e1ca6a24dff admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:43.279894 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1010/1992] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:30:43 2022] POST /identity/v3/users => generated 310 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 03:30:43.283860 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6822da10-d497-4e6a-924a-99733cea8b32 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:43.299574 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6822da10-d497-4e6a-924a-99733cea8b32 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:43.306667 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70391db5-27ee-4ebe-974b-c8a1f2bab629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:43.307713 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70391db5-27ee-4ebe-974b-c8a1f2bab629 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:43.308194 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70391db5-27ee-4ebe-974b-c8a1f2bab629 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:43.308529 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70391db5-27ee-4ebe-974b-c8a1f2bab629 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:43.309609 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70391db5-27ee-4ebe-974b-c8a1f2bab629 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:43.311408 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70391db5-27ee-4ebe-974b-c8a1f2bab629 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:43.326418 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 983/1993] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:30:43 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:30:43.330120 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759a5bd9-6b2b-4678-9515-5e1ca6a24dff admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:43.350194 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759a5bd9-6b2b-4678-9515-5e1ca6a24dff admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:43.360118 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7618b862-337d-4fff-8aae-cea584f7fc9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:43.361063 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7618b862-337d-4fff-8aae-cea584f7fc9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:43.361391 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7618b862-337d-4fff-8aae-cea584f7fc9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:43.361671 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7618b862-337d-4fff-8aae-cea584f7fc9c admin admin] PATH_INFO: `/v3/projects/5e5cdb3bd1fe4256aa03329c17765390/users/b3a8bc4cff2b4acab6bb0ffebd92c12f/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:43.366492 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:43.392874 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7618b862-337d-4fff-8aae-cea584f7fc9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e5cdb3bd1fe4256aa03329c17765390, user_id=b3a8bc4cff2b4acab6bb0ffebd92c12f, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:43.395938 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7618b862-337d-4fff-8aae-cea584f7fc9c admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:43.412699 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1011/1994] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:30:43 2022] PUT /identity/v3/projects/5e5cdb3bd1fe4256aa03329c17765390/users/b3a8bc4cff2b4acab6bb0ffebd92c12f/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 03:30:43.417098 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70391db5-27ee-4ebe-974b-c8a1f2bab629 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:43.427547 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70391db5-27ee-4ebe-974b-c8a1f2bab629 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:43.468274 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7618b862-337d-4fff-8aae-cea584f7fc9c admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:43.470317 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-7618b862-337d-4fff-8aae-cea584f7fc9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:43.509124 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698cf99c-5641-41f8-85af-3035e2e3e0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:43.509900 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698cf99c-5641-41f8-85af-3035e2e3e0eb admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:43.510677 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698cf99c-5641-41f8-85af-3035e2e3e0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:43.511068 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698cf99c-5641-41f8-85af-3035e2e3e0eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:43.514038 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698cf99c-5641-41f8-85af-3035e2e3e0eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:43.516217 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698cf99c-5641-41f8-85af-3035e2e3e0eb admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:43.531801 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 984/1995] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:30:43 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:30:43.535643 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698cf99c-5641-41f8-85af-3035e2e3e0eb admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:43.547501 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698cf99c-5641-41f8-85af-3035e2e3e0eb admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:43.553435 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8bc3f8-a416-4872-ab3d-d0b1278d0807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:43.554317 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8bc3f8-a416-4872-ab3d-d0b1278d0807 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:43.554663 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8bc3f8-a416-4872-ab3d-d0b1278d0807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:43.555005 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8bc3f8-a416-4872-ab3d-d0b1278d0807 admin admin] PATH_INFO: `/v3/projects/5e5cdb3bd1fe4256aa03329c17765390/users/b3a8bc4cff2b4acab6bb0ffebd92c12f/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:43.557578 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8bc3f8-a416-4872-ab3d-d0b1278d0807 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e5cdb3bd1fe4256aa03329c17765390, user_id=b3a8bc4cff2b4acab6bb0ffebd92c12f, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:43.567512 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8bc3f8-a416-4872-ab3d-d0b1278d0807 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:43.578501 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7618b862-337d-4fff-8aae-cea584f7fc9c admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:43.584999 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 985/1996] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:30:43 2022] PUT /identity/v3/projects/5e5cdb3bd1fe4256aa03329c17765390/users/b3a8bc4cff2b4acab6bb0ffebd92c12f/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 03:30:43.596066 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeef95a-7772-4902-b7f2-091b4e00058e None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:43.596969 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeef95a-7772-4902-b7f2-091b4e00058e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:43.597399 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeef95a-7772-4902-b7f2-091b4e00058e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:43.644407 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-ffeef95a-7772-4902-b7f2-091b4e00058e None None] MFA Rules not processed for user `b3a8bc4cff2b4acab6bb0ffebd92c12f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:30:43.646409 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ffeef95a-7772-4902-b7f2-091b4e00058e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:43.674557 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e133d4c9-de85-42a1-9c4e-f239f3f79a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:43.675691 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133d4c9-de85-42a1-9c4e-f239f3f79a96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:43.676961 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133d4c9-de85-42a1-9c4e-f239f3f79a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:43.677317 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133d4c9-de85-42a1-9c4e-f239f3f79a96 admin admin] PATH_INFO: `/v3/projects/c3ae28a5168f4fcaa2e354d539386d03` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:43.679396 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e133d4c9-de85-42a1-9c4e-f239f3f79a96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3ae28a5168f4fcaa2e354d539386d03)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:43.684439 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e133d4c9-de85-42a1-9c4e-f239f3f79a96 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:43.725206 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:43.764822 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e133d4c9-de85-42a1-9c4e-f239f3f79a96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3ae28a5168f4fcaa2e354d539386d03', 'request_id': 'req-e133d4c9-de85-42a1-9c4e-f239f3f79a96'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:43.771459 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e133d4c9-de85-42a1-9c4e-f239f3f79a96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3ae28a5168f4fcaa2e354d539386d03', 'request_id': 'req-e133d4c9-de85-42a1-9c4e-f239f3f79a96'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:43.776944 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 986/1997] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:30:43 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:30:43.783791 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e133d4c9-de85-42a1-9c4e-f239f3f79a96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3ae28a5168f4fcaa2e354d539386d03', 'request_id': 'req-e133d4c9-de85-42a1-9c4e-f239f3f79a96'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:43.788164 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeef95a-7772-4902-b7f2-091b4e00058e None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:43.791356 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ffeef95a-7772-4902-b7f2-091b4e00058e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:43.803062 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e133d4c9-de85-42a1-9c4e-f239f3f79a96 admin admin] The token cache is being invalidate because project c3ae28a5168f4fcaa2e354d539386d03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:30:43.803467 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e133d4c9-de85-42a1-9c4e-f239f3f79a96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:43.804880 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e133d4c9-de85-42a1-9c4e-f239f3f79a96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:43.807003 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1012/1998] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:30:43 2022] DELETE /identity/v3/projects/c3ae28a5168f4fcaa2e354d539386d03 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 03:30:43.811255 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e133d4c9-de85-42a1-9c4e-f239f3f79a96 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:43.816033 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-e133d4c9-de85-42a1-9c4e-f239f3f79a96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:43.870888 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:43.893600 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeef95a-7772-4902-b7f2-091b4e00058e None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:43.940617 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e133d4c9-de85-42a1-9c4e-f239f3f79a96 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:43.945546 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4259c62-ee2d-45bc-800f-26ebee3dcab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:43.946434 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4259c62-ee2d-45bc-800f-26ebee3dcab6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:43.946716 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4259c62-ee2d-45bc-800f-26ebee3dcab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:43.946990 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4259c62-ee2d-45bc-800f-26ebee3dcab6 admin admin] PATH_INFO: `/v3/users/6cd2782f05b74aa0be9128f7611d2b8f` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:43.947224 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a51fe46-ac83-4528-9434-2e41484145f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:43.947870 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a51fe46-ac83-4528-9434-2e41484145f2 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:43.948148 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a51fe46-ac83-4528-9434-2e41484145f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:43.948243 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4259c62-ee2d-45bc-800f-26ebee3dcab6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cd2782f05b74aa0be9128f7611d2b8f)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:43.948416 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a51fe46-ac83-4528-9434-2e41484145f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:43.950133 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4259c62-ee2d-45bc-800f-26ebee3dcab6 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:43.950242 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3a51fe46-ac83-4528-9434-2e41484145f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:43.998703 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d4259c62-ee2d-45bc-800f-26ebee3dcab6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cd2782f05b74aa0be9128f7611d2b8f'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:43.999405 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d4259c62-ee2d-45bc-800f-26ebee3dcab6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cd2782f05b74aa0be9128f7611d2b8f'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:44.009028 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d4259c62-ee2d-45bc-800f-26ebee3dcab6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cd2782f05b74aa0be9128f7611d2b8f'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:44.009658 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d4259c62-ee2d-45bc-800f-26ebee3dcab6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cd2782f05b74aa0be9128f7611d2b8f'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:44.018417 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a51fe46-ac83-4528-9434-2e41484145f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:44.020060 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a51fe46-ac83-4528-9434-2e41484145f2 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:44.022825 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d4259c62-ee2d-45bc-800f-26ebee3dcab6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cd2782f05b74aa0be9128f7611d2b8f'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:44.031837 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 987/1999] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:30:43 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:30:44.036303 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1013/2000] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:30:43 2022] DELETE /identity/v3/users/6cd2782f05b74aa0be9128f7611d2b8f => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:30:44.198485 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a51fe46-ac83-4528-9434-2e41484145f2 service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:44.200140 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3a51fe46-ac83-4528-9434-2e41484145f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:44.212058 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a51fe46-ac83-4528-9434-2e41484145f2 service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:44.267193 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:44.302505 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b67d2bf-4145-4f3e-ab67-883a98f7da5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:44.303493 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67d2bf-4145-4f3e-ab67-883a98f7da5e service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:44.303851 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67d2bf-4145-4f3e-ab67-883a98f7da5e service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:44.304191 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67d2bf-4145-4f3e-ab67-883a98f7da5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:44.306583 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1b67d2bf-4145-4f3e-ab67-883a98f7da5e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:44.401582 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b67d2bf-4145-4f3e-ab67-883a98f7da5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:44.403055 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b67d2bf-4145-4f3e-ab67-883a98f7da5e service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:44.415398 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 988/2001] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:30:44 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:30:44.441111 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4259c62-ee2d-45bc-800f-26ebee3dcab6 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:44.442601 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-d4259c62-ee2d-45bc-800f-26ebee3dcab6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:44.518747 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4259c62-ee2d-45bc-800f-26ebee3dcab6 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:44.524518 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87892053-34ac-42d9-a968-4177824f6fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:44.525397 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87892053-34ac-42d9-a968-4177824f6fef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:44.525682 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87892053-34ac-42d9-a968-4177824f6fef admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:44.526072 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87892053-34ac-42d9-a968-4177824f6fef admin admin] PATH_INFO: `/v3/projects/7a07735a044940799c65e06ba804d660` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:44.527314 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87892053-34ac-42d9-a968-4177824f6fef admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a07735a044940799c65e06ba804d660)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:44.529268 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87892053-34ac-42d9-a968-4177824f6fef admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:44.575778 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:44.580002 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-87892053-34ac-42d9-a968-4177824f6fef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a07735a044940799c65e06ba804d660', 'request_id': 'req-87892053-34ac-42d9-a968-4177824f6fef'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:44.586995 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-87892053-34ac-42d9-a968-4177824f6fef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a07735a044940799c65e06ba804d660', 'request_id': 'req-87892053-34ac-42d9-a968-4177824f6fef'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:44.595347 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-87892053-34ac-42d9-a968-4177824f6fef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a07735a044940799c65e06ba804d660', 'request_id': 'req-87892053-34ac-42d9-a968-4177824f6fef'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:44.610247 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-87892053-34ac-42d9-a968-4177824f6fef admin admin] The token cache is being invalidate because project 7a07735a044940799c65e06ba804d660 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:30:44.610536 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-87892053-34ac-42d9-a968-4177824f6fef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:44.611227 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-87892053-34ac-42d9-a968-4177824f6fef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:44.613034 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1014/2002] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:30:44 2022] DELETE /identity/v3/projects/7a07735a044940799c65e06ba804d660 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:30:44.617869 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0656793-2b4f-43c1-ab41-45265724b2c6 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:44.618335 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0656793-2b4f-43c1-ab41-45265724b2c6 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:44.618674 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0656793-2b4f-43c1-ab41-45265724b2c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:44.637479 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-b0656793-2b4f-43c1-ab41-45265724b2c6 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:30:44.638706 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b0656793-2b4f-43c1-ab41-45265724b2c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:44.712249 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 989/2003] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:30:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 03:30:44.720049 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c37af59-2c26-4c25-864c-df551c6658f7 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:44.720340 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c37af59-2c26-4c25-864c-df551c6658f7 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:44.720620 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c37af59-2c26-4c25-864c-df551c6658f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:44.746369 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-1c37af59-2c26-4c25-864c-df551c6658f7 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:30:44.747614 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-1c37af59-2c26-4c25-864c-df551c6658f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:44.762633 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1015/2004] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:30:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:30:44.767050 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0656793-2b4f-43c1-ab41-45265724b2c6 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:44.778900 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0656793-2b4f-43c1-ab41-45265724b2c6 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:44.784158 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e3fc4c-a390-46fc-b720-d90d2d865361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:44.784830 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3fc4c-a390-46fc-b720-d90d2d865361 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:44.785111 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3fc4c-a390-46fc-b720-d90d2d865361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:44.785524 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3fc4c-a390-46fc-b720-d90d2d865361 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:44.786461 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e3fc4c-a390-46fc-b720-d90d2d865361 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:30:44.786770 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e3fc4c-a390-46fc-b720-d90d2d865361 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:44.788539 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e3fc4c-a390-46fc-b720-d90d2d865361 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:44.802261 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 990/2005] 10.222.0.60 () {58 vars in 1152 bytes} [Sat Jul 2 03:30:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:30:44.806748 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c37af59-2c26-4c25-864c-df551c6658f7 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:44.816136 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c37af59-2c26-4c25-864c-df551c6658f7 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:44.820843 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b3411-7ec4-4df9-9378-542a26664bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:44.821552 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b3411-7ec4-4df9-9378-542a26664bb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:44.821879 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b3411-7ec4-4df9-9378-542a26664bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:44.822090 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b3411-7ec4-4df9-9378-542a26664bb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:44.822901 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9b3411-7ec4-4df9-9378-542a26664bb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:44.825100 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9b3411-7ec4-4df9-9378-542a26664bb5 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:44.860129 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1016/2006] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:30:44 2022] POST /identity/v3/projects => generated 381 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 03:30:44.868394 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e3fc4c-a390-46fc-b720-d90d2d865361 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:44.875806 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e3fc4c-a390-46fc-b720-d90d2d865361 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:44.958970 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e045a2e-7e0a-43ef-8b99-9133dc1fe2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:44.959792 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e045a2e-7e0a-43ef-8b99-9133dc1fe2f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:44.960142 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e045a2e-7e0a-43ef-8b99-9133dc1fe2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:44.960487 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e045a2e-7e0a-43ef-8b99-9133dc1fe2f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:44.961295 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e045a2e-7e0a-43ef-8b99-9133dc1fe2f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:44.963349 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e045a2e-7e0a-43ef-8b99-9133dc1fe2f3 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:44.988774 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 991/2007] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:30:44 2022] POST /identity/v3/users => generated 291 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 03:30:44.994601 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b3411-7ec4-4df9-9378-542a26664bb5 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:45.006377 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b3411-7ec4-4df9-9378-542a26664bb5 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:45.012630 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188f0f41-0889-459d-93be-4bbc648d3345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:45.013308 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f0f41-0889-459d-93be-4bbc648d3345 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:45.013727 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f0f41-0889-459d-93be-4bbc648d3345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:45.014003 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f0f41-0889-459d-93be-4bbc648d3345 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:45.014738 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188f0f41-0889-459d-93be-4bbc648d3345 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:45.016981 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188f0f41-0889-459d-93be-4bbc648d3345 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:45.028715 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1017/2008] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:30:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:30:45.032837 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e045a2e-7e0a-43ef-8b99-9133dc1fe2f3 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:45.045284 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e045a2e-7e0a-43ef-8b99-9133dc1fe2f3 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:45.050672 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71def9e-762d-4461-8ace-3b6a2a84db06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:45.051493 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71def9e-762d-4461-8ace-3b6a2a84db06 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:45.051775 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71def9e-762d-4461-8ace-3b6a2a84db06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:45.052048 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71def9e-762d-4461-8ace-3b6a2a84db06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:45.052816 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71def9e-762d-4461-8ace-3b6a2a84db06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:45.054399 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71def9e-762d-4461-8ace-3b6a2a84db06 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:45.069930 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 992/2009] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 03:30:45.070993 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188f0f41-0889-459d-93be-4bbc648d3345 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:45.081967 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188f0f41-0889-459d-93be-4bbc648d3345 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:45.095555 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad1aca-d08d-4537-86ef-76f1f9c5b6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:45.096566 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad1aca-d08d-4537-86ef-76f1f9c5b6ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:45.096955 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad1aca-d08d-4537-86ef-76f1f9c5b6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:45.098592 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad1aca-d08d-4537-86ef-76f1f9c5b6ec admin admin] PATH_INFO: `/v3/projects/66b88c1c63054c148b568e1bb0715510/users/d69d92afd0f3489b85c8510f0d3c8d88/roles/c43aada0326446c4ade0ab1262918fa4` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:45.118786 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bad1aca-d08d-4537-86ef-76f1f9c5b6ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=66b88c1c63054c148b568e1bb0715510, user_id=d69d92afd0f3489b85c8510f0d3c8d88, role_id=c43aada0326446c4ade0ab1262918fa4)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:45.122081 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bad1aca-d08d-4537-86ef-76f1f9c5b6ec admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:45.140543 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1018/2010] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:30:45 2022] PUT /identity/v3/projects/66b88c1c63054c148b568e1bb0715510/users/d69d92afd0f3489b85c8510f0d3c8d88/roles/c43aada0326446c4ade0ab1262918fa4 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:30:45.152811 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef55e3-2047-4a06-bf79-76cb61571e47 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:45.153350 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef55e3-2047-4a06-bf79-76cb61571e47 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:45.153874 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef55e3-2047-4a06-bf79-76cb61571e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:45.189224 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:45.252070 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-7fef55e3-2047-4a06-bf79-76cb61571e47 None None] MFA Rules not processed for user `d69d92afd0f3489b85c8510f0d3c8d88`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:30:45.255994 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7fef55e3-2047-4a06-bf79-76cb61571e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:45.365267 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 993/2011] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:30:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:30:45.370095 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad1aca-d08d-4537-86ef-76f1f9c5b6ec admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:45.457393 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad1aca-d08d-4537-86ef-76f1f9c5b6ec admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:45.463780 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825f7142-0d52-4e1a-a906-9d214bb7cf5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:45.464794 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f7142-0d52-4e1a-a906-9d214bb7cf5b admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:45.465271 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f7142-0d52-4e1a-a906-9d214bb7cf5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:45.465844 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f7142-0d52-4e1a-a906-9d214bb7cf5b admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:45.466886 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825f7142-0d52-4e1a-a906-9d214bb7cf5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:45.468999 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825f7142-0d52-4e1a-a906-9d214bb7cf5b admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:45.521000 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1019/2012] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:30:45 2022] POST /identity/v3/projects => generated 379 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:30:45.524846 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fef55e3-2047-4a06-bf79-76cb61571e47 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:45.535817 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fef55e3-2047-4a06-bf79-76cb61571e47 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:45.595642 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e5a169-1993-4860-beb1-bbdff8a4c40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:45.596317 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5a169-1993-4860-beb1-bbdff8a4c40f admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:45.596595 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5a169-1993-4860-beb1-bbdff8a4c40f admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:45.596862 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5a169-1993-4860-beb1-bbdff8a4c40f admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:45.597566 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e5a169-1993-4860-beb1-bbdff8a4c40f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:45.599536 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e5a169-1993-4860-beb1-bbdff8a4c40f admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:45.620329 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 994/2013] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:30:45 2022] POST /identity/v3/users => generated 296 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:30:45.624125 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825f7142-0d52-4e1a-a906-9d214bb7cf5b admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:45.638437 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825f7142-0d52-4e1a-a906-9d214bb7cf5b admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:45.645375 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa2cdd-862b-4ace-b2e2-228fa244659e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:45.646613 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa2cdd-862b-4ace-b2e2-228fa244659e admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:45.648055 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa2cdd-862b-4ace-b2e2-228fa244659e admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:45.648055 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa2cdd-862b-4ace-b2e2-228fa244659e admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:45.649590 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fa2cdd-862b-4ace-b2e2-228fa244659e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:45.653559 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fa2cdd-862b-4ace-b2e2-228fa244659e admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:45.669222 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1020/2014] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:30:45.670462 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e5a169-1993-4860-beb1-bbdff8a4c40f admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:45.681747 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e5a169-1993-4860-beb1-bbdff8a4c40f admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:45.687238 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7007b1e-ef40-4ce1-aa32-dacdec888b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:45.688200 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7007b1e-ef40-4ce1-aa32-dacdec888b8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:45.688565 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7007b1e-ef40-4ce1-aa32-dacdec888b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:45.688902 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7007b1e-ef40-4ce1-aa32-dacdec888b8a admin admin] PATH_INFO: `/v3/projects/c3fe049021084c428e619587c7d8df4c/users/b48348e320384244956fc8932695ed66/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:45.704908 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7007b1e-ef40-4ce1-aa32-dacdec888b8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3fe049021084c428e619587c7d8df4c, user_id=b48348e320384244956fc8932695ed66, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:45.707848 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7007b1e-ef40-4ce1-aa32-dacdec888b8a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:45.721217 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 995/2015] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:30:45 2022] PUT /identity/v3/projects/c3fe049021084c428e619587c7d8df4c/users/b48348e320384244956fc8932695ed66/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:30:45.725925 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa2cdd-862b-4ace-b2e2-228fa244659e admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:45.735584 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa2cdd-862b-4ace-b2e2-228fa244659e admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:45.777367 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:45.796622 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcb9743-a603-41d8-81b5-ae787297716e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:45.797415 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb9743-a603-41d8-81b5-ae787297716e admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:45.797711 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb9743-a603-41d8-81b5-ae787297716e admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:45.798030 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb9743-a603-41d8-81b5-ae787297716e admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:45.799046 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcb9743-a603-41d8-81b5-ae787297716e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:45.809211 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcb9743-a603-41d8-81b5-ae787297716e admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:45.814619 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1021/2016] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:30:45.815446 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7007b1e-ef40-4ce1-aa32-dacdec888b8a admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:45.828578 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7007b1e-ef40-4ce1-aa32-dacdec888b8a admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:45.833776 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04634630-3ddf-4355-93ca-6d8faf92dba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:45.835541 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04634630-3ddf-4355-93ca-6d8faf92dba2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:45.835836 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04634630-3ddf-4355-93ca-6d8faf92dba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:45.836170 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04634630-3ddf-4355-93ca-6d8faf92dba2 admin admin] PATH_INFO: `/v3/projects/c3fe049021084c428e619587c7d8df4c/users/b48348e320384244956fc8932695ed66/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:45.839000 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04634630-3ddf-4355-93ca-6d8faf92dba2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3fe049021084c428e619587c7d8df4c, user_id=b48348e320384244956fc8932695ed66, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:45.841966 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04634630-3ddf-4355-93ca-6d8faf92dba2 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:45.861337 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 996/2017] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:30:45 2022] PUT /identity/v3/projects/c3fe049021084c428e619587c7d8df4c/users/b48348e320384244956fc8932695ed66/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:30:45.865946 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70906621-b9b2-455f-9108-d873482ce885 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:45.866240 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70906621-b9b2-455f-9108-d873482ce885 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:45.866523 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70906621-b9b2-455f-9108-d873482ce885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:45.897240 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-70906621-b9b2-455f-9108-d873482ce885 None None] MFA Rules not processed for user `b48348e320384244956fc8932695ed66`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:30:45.898804 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-70906621-b9b2-455f-9108-d873482ce885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:46.001393 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1022/2018] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:30:45 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:30:46.013784 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04634630-3ddf-4355-93ca-6d8faf92dba2 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:46.015504 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-04634630-3ddf-4355-93ca-6d8faf92dba2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:46.065930 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:46.079541 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04634630-3ddf-4355-93ca-6d8faf92dba2 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:46.083676 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f003e0e2-9101-4324-814b-08a3e1be4c39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:46.084326 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003e0e2-9101-4324-814b-08a3e1be4c39 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:46.084606 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003e0e2-9101-4324-814b-08a3e1be4c39 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:46.084903 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003e0e2-9101-4324-814b-08a3e1be4c39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:46.095489 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f003e0e2-9101-4324-814b-08a3e1be4c39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:46.096952 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f003e0e2-9101-4324-814b-08a3e1be4c39 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:46.106961 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 997/2019] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:30:46 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 03:30:46.596119 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70906621-b9b2-455f-9108-d873482ce885 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:46.666859 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70906621-b9b2-455f-9108-d873482ce885 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:46.671373 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca950ca-0a59-4fcd-bc4b-8ec2a74a62cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:46.672271 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca950ca-0a59-4fcd-bc4b-8ec2a74a62cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:46.672546 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca950ca-0a59-4fcd-bc4b-8ec2a74a62cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:46.672812 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca950ca-0a59-4fcd-bc4b-8ec2a74a62cd admin admin] PATH_INFO: `/v3/users/d69d92afd0f3489b85c8510f0d3c8d88` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:46.674033 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca950ca-0a59-4fcd-bc4b-8ec2a74a62cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d69d92afd0f3489b85c8510f0d3c8d88)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:46.676223 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca950ca-0a59-4fcd-bc4b-8ec2a74a62cd admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:46.751258 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6ca950ca-0a59-4fcd-bc4b-8ec2a74a62cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd69d92afd0f3489b85c8510f0d3c8d88'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:46.751905 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6ca950ca-0a59-4fcd-bc4b-8ec2a74a62cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd69d92afd0f3489b85c8510f0d3c8d88'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:46.760902 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6ca950ca-0a59-4fcd-bc4b-8ec2a74a62cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd69d92afd0f3489b85c8510f0d3c8d88'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:46.761575 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6ca950ca-0a59-4fcd-bc4b-8ec2a74a62cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd69d92afd0f3489b85c8510f0d3c8d88'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:46.772888 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:46.778085 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6ca950ca-0a59-4fcd-bc4b-8ec2a74a62cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd69d92afd0f3489b85c8510f0d3c8d88'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:46.793460 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1023/2020] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:30:46 2022] DELETE /identity/v3/users/d69d92afd0f3489b85c8510f0d3c8d88 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:30:46.799056 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66a5c4-8b55-4d88-9e2c-e30d42bd022f None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:46.799588 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66a5c4-8b55-4d88-9e2c-e30d42bd022f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:46.799679 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66a5c4-8b55-4d88-9e2c-e30d42bd022f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:46.817330 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-df66a5c4-8b55-4d88-9e2c-e30d42bd022f None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:30:46.818526 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-df66a5c4-8b55-4d88-9e2c-e30d42bd022f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:46.883625 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 998/2021] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:30:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:30:46.893031 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca950ca-0a59-4fcd-bc4b-8ec2a74a62cd admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:46.894631 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-6ca950ca-0a59-4fcd-bc4b-8ec2a74a62cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:46.972023 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca950ca-0a59-4fcd-bc4b-8ec2a74a62cd admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:46.976388 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad7d13-3bc5-4fe2-9311-1bc443780384 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:46.977048 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad7d13-3bc5-4fe2-9311-1bc443780384 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:46.977328 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad7d13-3bc5-4fe2-9311-1bc443780384 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:46.977599 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad7d13-3bc5-4fe2-9311-1bc443780384 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:46.994204 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bad7d13-3bc5-4fe2-9311-1bc443780384 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:46.995964 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bad7d13-3bc5-4fe2-9311-1bc443780384 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:47.006442 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1024/2022] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:30:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:30:47.404307 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df66a5c4-8b55-4d88-9e2c-e30d42bd022f None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:47.406292 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-df66a5c4-8b55-4d88-9e2c-e30d42bd022f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:47.428653 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df66a5c4-8b55-4d88-9e2c-e30d42bd022f None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:47.445461 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0cce57-b14f-4787-8b6e-580911177d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:47.446355 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0cce57-b14f-4787-8b6e-580911177d3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:47.446633 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0cce57-b14f-4787-8b6e-580911177d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:47.446903 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0cce57-b14f-4787-8b6e-580911177d3f admin admin] PATH_INFO: `/v3/projects/66b88c1c63054c148b568e1bb0715510` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:47.448338 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0cce57-b14f-4787-8b6e-580911177d3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=66b88c1c63054c148b568e1bb0715510)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:47.450420 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0cce57-b14f-4787-8b6e-580911177d3f admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:47.509418 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-da0cce57-b14f-4787-8b6e-580911177d3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66b88c1c63054c148b568e1bb0715510', 'request_id': 'req-da0cce57-b14f-4787-8b6e-580911177d3f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:47.515239 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-da0cce57-b14f-4787-8b6e-580911177d3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66b88c1c63054c148b568e1bb0715510', 'request_id': 'req-da0cce57-b14f-4787-8b6e-580911177d3f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:47.524537 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-da0cce57-b14f-4787-8b6e-580911177d3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66b88c1c63054c148b568e1bb0715510', 'request_id': 'req-da0cce57-b14f-4787-8b6e-580911177d3f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:47.543497 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-da0cce57-b14f-4787-8b6e-580911177d3f admin admin] The token cache is being invalidate because project 66b88c1c63054c148b568e1bb0715510 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:30:47.544723 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-da0cce57-b14f-4787-8b6e-580911177d3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:47.545583 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-da0cce57-b14f-4787-8b6e-580911177d3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:47.556078 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 999/2023] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:30:47 2022] DELETE /identity/v3/projects/66b88c1c63054c148b568e1bb0715510 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:30:47.560065 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad7d13-3bc5-4fe2-9311-1bc443780384 service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:47.571838 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad7d13-3bc5-4fe2-9311-1bc443780384 service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:47.661784 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f65b3-6f31-4a00-b380-16c7b437c877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:47.663051 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f65b3-6f31-4a00-b380-16c7b437c877 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:47.663537 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f65b3-6f31-4a00-b380-16c7b437c877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:47.663986 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f65b3-6f31-4a00-b380-16c7b437c877 admin admin] PATH_INFO: `/v3/users/b48348e320384244956fc8932695ed66` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:47.665626 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3f65b3-6f31-4a00-b380-16c7b437c877 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b48348e320384244956fc8932695ed66)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:47.668261 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3f65b3-6f31-4a00-b380-16c7b437c877 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:47.750450 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-4e3f65b3-6f31-4a00-b380-16c7b437c877 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b48348e320384244956fc8932695ed66'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:47.751147 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-4e3f65b3-6f31-4a00-b380-16c7b437c877 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b48348e320384244956fc8932695ed66'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:47.760378 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-4e3f65b3-6f31-4a00-b380-16c7b437c877 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b48348e320384244956fc8932695ed66'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:47.761436 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-4e3f65b3-6f31-4a00-b380-16c7b437c877 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b48348e320384244956fc8932695ed66'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:47.779627 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-4e3f65b3-6f31-4a00-b380-16c7b437c877 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b48348e320384244956fc8932695ed66'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:47.805101 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1025/2024] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:30:47 2022] DELETE /identity/v3/users/b48348e320384244956fc8932695ed66 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:30:48.538671 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0cce57-b14f-4787-8b6e-580911177d3f admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:48.541177 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-da0cce57-b14f-4787-8b6e-580911177d3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:48.580323 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0cce57-b14f-4787-8b6e-580911177d3f admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:48.666634 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb3b467-274f-4fe2-b062-d3da08fc4df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:48.667733 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3b467-274f-4fe2-b062-d3da08fc4df4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:48.668104 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3b467-274f-4fe2-b062-d3da08fc4df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:48.668501 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3b467-274f-4fe2-b062-d3da08fc4df4 admin admin] PATH_INFO: `/v3/projects/c3fe049021084c428e619587c7d8df4c` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:48.670502 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb3b467-274f-4fe2-b062-d3da08fc4df4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3fe049021084c428e619587c7d8df4c)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:48.685043 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb3b467-274f-4fe2-b062-d3da08fc4df4 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:48.700208 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:48.772947 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-cfb3b467-274f-4fe2-b062-d3da08fc4df4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3fe049021084c428e619587c7d8df4c', 'request_id': 'req-cfb3b467-274f-4fe2-b062-d3da08fc4df4'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:48.790489 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-cfb3b467-274f-4fe2-b062-d3da08fc4df4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3fe049021084c428e619587c7d8df4c', 'request_id': 'req-cfb3b467-274f-4fe2-b062-d3da08fc4df4'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:48.804127 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-cfb3b467-274f-4fe2-b062-d3da08fc4df4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3fe049021084c428e619587c7d8df4c', 'request_id': 'req-cfb3b467-274f-4fe2-b062-d3da08fc4df4'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:48.825841 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-cfb3b467-274f-4fe2-b062-d3da08fc4df4 admin admin] The token cache is being invalidate because project c3fe049021084c428e619587c7d8df4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:30:48.826210 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-cfb3b467-274f-4fe2-b062-d3da08fc4df4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:48.827884 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-cfb3b467-274f-4fe2-b062-d3da08fc4df4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:48.833357 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1000/2025] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:30:48 2022] DELETE /identity/v3/projects/c3fe049021084c428e619587c7d8df4c => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:30:48.835018 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8fcb2c-7f49-4aba-b745-abf5d1d24b50 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:48.835613 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8fcb2c-7f49-4aba-b745-abf5d1d24b50 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:48.835927 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8fcb2c-7f49-4aba-b745-abf5d1d24b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:48.844945 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:48.869218 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-5f8fcb2c-7f49-4aba-b745-abf5d1d24b50 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:30:48.871306 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-5f8fcb2c-7f49-4aba-b745-abf5d1d24b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:48.948712 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1026/2026] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:30:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:30:48.956840 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab30b3e-894e-44c2-8b29-0f09ff054c79 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:48.957552 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab30b3e-894e-44c2-8b29-0f09ff054c79 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:48.957844 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab30b3e-894e-44c2-8b29-0f09ff054c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:48.978625 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-2ab30b3e-894e-44c2-8b29-0f09ff054c79 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:30:48.979680 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2ab30b3e-894e-44c2-8b29-0f09ff054c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:48.989630 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1001/2027] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:30:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 03:30:48.993679 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8fcb2c-7f49-4aba-b745-abf5d1d24b50 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:49.003861 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8fcb2c-7f49-4aba-b745-abf5d1d24b50 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:49.009242 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe92b5-255e-413e-8912-dc8a44aa67a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:49.010053 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe92b5-255e-413e-8912-dc8a44aa67a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:49.010415 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe92b5-255e-413e-8912-dc8a44aa67a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:49.010770 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe92b5-255e-413e-8912-dc8a44aa67a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:49.011596 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfe92b5-255e-413e-8912-dc8a44aa67a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:30:49.012034 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfe92b5-255e-413e-8912-dc8a44aa67a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:49.013752 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfe92b5-255e-413e-8912-dc8a44aa67a7 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:49.027169 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1027/2028] 10.222.0.60 () {58 vars in 1152 bytes} [Sat Jul 2 03:30:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:30:49.032100 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab30b3e-894e-44c2-8b29-0f09ff054c79 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:49.043338 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab30b3e-894e-44c2-8b29-0f09ff054c79 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:49.049706 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a53e348-c152-4a8a-98e9-6dd459bad984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:49.050386 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53e348-c152-4a8a-98e9-6dd459bad984 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:49.050674 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53e348-c152-4a8a-98e9-6dd459bad984 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:49.051008 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53e348-c152-4a8a-98e9-6dd459bad984 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:49.052523 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a53e348-c152-4a8a-98e9-6dd459bad984 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:49.054504 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a53e348-c152-4a8a-98e9-6dd459bad984 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:49.094643 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1002/2029] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:30:49 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:30:49.114816 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe92b5-255e-413e-8912-dc8a44aa67a7 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:49.131622 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe92b5-255e-413e-8912-dc8a44aa67a7 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:49.208941 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7c17e5-04e6-44bc-b70a-8b5e2e91a76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:49.209815 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c17e5-04e6-44bc-b70a-8b5e2e91a76a admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:49.210161 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c17e5-04e6-44bc-b70a-8b5e2e91a76a admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:49.210516 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c17e5-04e6-44bc-b70a-8b5e2e91a76a admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:49.212148 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7c17e5-04e6-44bc-b70a-8b5e2e91a76a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:49.215714 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7c17e5-04e6-44bc-b70a-8b5e2e91a76a admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:49.255905 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1028/2030] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:30:49 2022] POST /identity/v3/users => generated 289 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:30:49.257309 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a53e348-c152-4a8a-98e9-6dd459bad984 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:49.270866 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a53e348-c152-4a8a-98e9-6dd459bad984 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:49.280552 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feb6bc8-bc6d-4ccd-9b84-4fc457a1a479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:49.281327 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feb6bc8-bc6d-4ccd-9b84-4fc457a1a479 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:49.281671 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feb6bc8-bc6d-4ccd-9b84-4fc457a1a479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:49.281965 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feb6bc8-bc6d-4ccd-9b84-4fc457a1a479 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:49.282727 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feb6bc8-bc6d-4ccd-9b84-4fc457a1a479 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:49.284929 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feb6bc8-bc6d-4ccd-9b84-4fc457a1a479 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:49.302963 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1003/2031] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:30:49.304274 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7c17e5-04e6-44bc-b70a-8b5e2e91a76a admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:49.315599 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7c17e5-04e6-44bc-b70a-8b5e2e91a76a admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:49.320989 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2147d39-19b7-414b-9dbd-851ca02b9ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:49.321733 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2147d39-19b7-414b-9dbd-851ca02b9ba0 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:49.322071 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2147d39-19b7-414b-9dbd-851ca02b9ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:49.322380 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2147d39-19b7-414b-9dbd-851ca02b9ba0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:49.323203 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2147d39-19b7-414b-9dbd-851ca02b9ba0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:49.324858 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2147d39-19b7-414b-9dbd-851ca02b9ba0 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:49.336611 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1029/2032] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:30:49.340863 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feb6bc8-bc6d-4ccd-9b84-4fc457a1a479 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:49.353263 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feb6bc8-bc6d-4ccd-9b84-4fc457a1a479 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:49.359665 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c84832-4373-445a-88d4-6a9735b25f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:49.364132 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c84832-4373-445a-88d4-6a9735b25f59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:49.364597 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c84832-4373-445a-88d4-6a9735b25f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:49.365035 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c84832-4373-445a-88d4-6a9735b25f59 admin admin] PATH_INFO: `/v3/projects/89665522f57242dca2be4f84bf51538a/users/f8792d18a330488d98b401ca11456447/roles/c43aada0326446c4ade0ab1262918fa4` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:49.388798 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c84832-4373-445a-88d4-6a9735b25f59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89665522f57242dca2be4f84bf51538a, user_id=f8792d18a330488d98b401ca11456447, role_id=c43aada0326446c4ade0ab1262918fa4)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:49.392021 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c84832-4373-445a-88d4-6a9735b25f59 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:49.413971 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1004/2033] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:30:49 2022] PUT /identity/v3/projects/89665522f57242dca2be4f84bf51538a/users/f8792d18a330488d98b401ca11456447/roles/c43aada0326446c4ade0ab1262918fa4 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 03:30:49.425534 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aef082a-1fca-4b29-9462-ef62337e4873 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:49.425961 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aef082a-1fca-4b29-9462-ef62337e4873 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:49.426465 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aef082a-1fca-4b29-9462-ef62337e4873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:49.459910 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-4aef082a-1fca-4b29-9462-ef62337e4873 None None] MFA Rules not processed for user `f8792d18a330488d98b401ca11456447`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:30:49.461124 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-4aef082a-1fca-4b29-9462-ef62337e4873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:49.528841 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:49.537560 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1030/2034] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:30:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:30:49.546699 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c84832-4373-445a-88d4-6a9735b25f59 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:49.556919 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c8c84832-4373-445a-88d4-6a9735b25f59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:49.624749 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c84832-4373-445a-88d4-6a9735b25f59 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:49.629564 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5aeab6-1a27-4384-ba34-f51781f09c7e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6470ccbf858f47bf9bb884476bf4235e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:49.630386 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5aeab6-1a27-4384-ba34-f51781f09c7e service glance] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:49.630772 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5aeab6-1a27-4384-ba34-f51781f09c7e service glance] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:49.631166 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5aeab6-1a27-4384-ba34-f51781f09c7e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:49.642027 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5aeab6-1a27-4384-ba34-f51781f09c7e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:49.643416 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5aeab6-1a27-4384-ba34-f51781f09c7e service glance] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:49.654569 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1005/2035] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:30:49 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:30:50.053986 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aef082a-1fca-4b29-9462-ef62337e4873 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:50.056291 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-4aef082a-1fca-4b29-9462-ef62337e4873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:50.198084 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aef082a-1fca-4b29-9462-ef62337e4873 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:50.216510 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4804a8de-5a3f-4617-8302-65be58533f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:50.217520 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4804a8de-5a3f-4617-8302-65be58533f36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:50.217907 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4804a8de-5a3f-4617-8302-65be58533f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:50.218276 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4804a8de-5a3f-4617-8302-65be58533f36 admin admin] PATH_INFO: `/v3/users/5a72408cdd92443582101ced0d908a12` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:50.220630 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4804a8de-5a3f-4617-8302-65be58533f36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a72408cdd92443582101ced0d908a12)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:50.222753 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4804a8de-5a3f-4617-8302-65be58533f36 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:50.332377 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-4804a8de-5a3f-4617-8302-65be58533f36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a72408cdd92443582101ced0d908a12'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:50.333256 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-4804a8de-5a3f-4617-8302-65be58533f36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a72408cdd92443582101ced0d908a12'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:50.349958 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-4804a8de-5a3f-4617-8302-65be58533f36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a72408cdd92443582101ced0d908a12'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:50.350723 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-4804a8de-5a3f-4617-8302-65be58533f36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a72408cdd92443582101ced0d908a12'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:50.386889 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-4804a8de-5a3f-4617-8302-65be58533f36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a72408cdd92443582101ced0d908a12'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:50.405400 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1031/2036] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:30:50 2022] DELETE /identity/v3/users/5a72408cdd92443582101ced0d908a12 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 03:30:50.410832 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7dc63-c9ef-45e3-830e-6d27134615b1 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:50.411297 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7dc63-c9ef-45e3-830e-6d27134615b1 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:50.411610 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7dc63-c9ef-45e3-830e-6d27134615b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:50.448433 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-ccb7dc63-c9ef-45e3-830e-6d27134615b1 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:30:50.454032 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ccb7dc63-c9ef-45e3-830e-6d27134615b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:50.522782 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:50.571362 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1006/2037] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:30:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:30:50.595151 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4804a8de-5a3f-4617-8302-65be58533f36 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:50.597124 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-4804a8de-5a3f-4617-8302-65be58533f36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:50.693389 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4804a8de-5a3f-4617-8302-65be58533f36 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:50.698024 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fcd6e1-2c18-4d02-8fd0-5b597d5e6d84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:50.698919 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fcd6e1-2c18-4d02-8fd0-5b597d5e6d84 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:50.699524 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fcd6e1-2c18-4d02-8fd0-5b597d5e6d84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:50.699960 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fcd6e1-2c18-4d02-8fd0-5b597d5e6d84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:50.712703 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fcd6e1-2c18-4d02-8fd0-5b597d5e6d84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:50.715000 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fcd6e1-2c18-4d02-8fd0-5b597d5e6d84 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:50.735348 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1032/2038] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:30:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:30:51.193232 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7dc63-c9ef-45e3-830e-6d27134615b1 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:51.195181 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ccb7dc63-c9ef-45e3-830e-6d27134615b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:51.208482 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7dc63-c9ef-45e3-830e-6d27134615b1 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:51.213615 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b8089a-0008-483a-9438-a71ef51375e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:51.214493 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8089a-0008-483a-9438-a71ef51375e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:51.214771 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8089a-0008-483a-9438-a71ef51375e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:51.215044 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8089a-0008-483a-9438-a71ef51375e3 admin admin] PATH_INFO: `/v3/projects/3fa19439bc9347ffb66f082d4f858a3c` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:51.216328 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b8089a-0008-483a-9438-a71ef51375e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fa19439bc9347ffb66f082d4f858a3c)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:51.218255 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b8089a-0008-483a-9438-a71ef51375e3 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:51.276962 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a2b8089a-0008-483a-9438-a71ef51375e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fa19439bc9347ffb66f082d4f858a3c', 'request_id': 'req-a2b8089a-0008-483a-9438-a71ef51375e3'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:51.284285 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a2b8089a-0008-483a-9438-a71ef51375e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fa19439bc9347ffb66f082d4f858a3c', 'request_id': 'req-a2b8089a-0008-483a-9438-a71ef51375e3'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:51.292373 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a2b8089a-0008-483a-9438-a71ef51375e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fa19439bc9347ffb66f082d4f858a3c', 'request_id': 'req-a2b8089a-0008-483a-9438-a71ef51375e3'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:51.303991 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a2b8089a-0008-483a-9438-a71ef51375e3 admin admin] The token cache is being invalidate because project 3fa19439bc9347ffb66f082d4f858a3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:30:51.304391 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a2b8089a-0008-483a-9438-a71ef51375e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:51.305068 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a2b8089a-0008-483a-9438-a71ef51375e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:51.306801 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1007/2039] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:30:51 2022] DELETE /identity/v3/projects/3fa19439bc9347ffb66f082d4f858a3c => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:30:51.310927 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fcd6e1-2c18-4d02-8fd0-5b597d5e6d84 service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:51.322107 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fcd6e1-2c18-4d02-8fd0-5b597d5e6d84 service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:51.341781 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:51.388074 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3768a82-7bd1-4e6c-b3e0-ec7148887889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:51.388743 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3768a82-7bd1-4e6c-b3e0-ec7148887889 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:51.389090 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3768a82-7bd1-4e6c-b3e0-ec7148887889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:51.389439 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3768a82-7bd1-4e6c-b3e0-ec7148887889 admin admin] PATH_INFO: `/v3/users/b3a8bc4cff2b4acab6bb0ffebd92c12f` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:51.390758 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3768a82-7bd1-4e6c-b3e0-ec7148887889 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3a8bc4cff2b4acab6bb0ffebd92c12f)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:51.392799 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3768a82-7bd1-4e6c-b3e0-ec7148887889 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:51.454136 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-a3768a82-7bd1-4e6c-b3e0-ec7148887889 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3a8bc4cff2b4acab6bb0ffebd92c12f'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:51.454789 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-a3768a82-7bd1-4e6c-b3e0-ec7148887889 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3a8bc4cff2b4acab6bb0ffebd92c12f'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:51.463380 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-a3768a82-7bd1-4e6c-b3e0-ec7148887889 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3a8bc4cff2b4acab6bb0ffebd92c12f'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:51.464036 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-a3768a82-7bd1-4e6c-b3e0-ec7148887889 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3a8bc4cff2b4acab6bb0ffebd92c12f'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:51.475947 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-a3768a82-7bd1-4e6c-b3e0-ec7148887889 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3a8bc4cff2b4acab6bb0ffebd92c12f'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:51.491082 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1033/2040] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:30:51 2022] DELETE /identity/v3/users/b3a8bc4cff2b4acab6bb0ffebd92c12f => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 03:30:51.841837 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b8089a-0008-483a-9438-a71ef51375e3 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:51.843921 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a2b8089a-0008-483a-9438-a71ef51375e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:51.857669 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b8089a-0008-483a-9438-a71ef51375e3 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:51.925753 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c08e35-64bd-4d6a-afd1-1fbc2aa43919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:51.926972 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c08e35-64bd-4d6a-afd1-1fbc2aa43919 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:51.927291 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c08e35-64bd-4d6a-afd1-1fbc2aa43919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:51.927571 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c08e35-64bd-4d6a-afd1-1fbc2aa43919 admin admin] PATH_INFO: `/v3/projects/5e5cdb3bd1fe4256aa03329c17765390` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:51.928851 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c08e35-64bd-4d6a-afd1-1fbc2aa43919 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e5cdb3bd1fe4256aa03329c17765390)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:51.930960 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c08e35-64bd-4d6a-afd1-1fbc2aa43919 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:51.992417 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-11c08e35-64bd-4d6a-afd1-1fbc2aa43919 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e5cdb3bd1fe4256aa03329c17765390', 'request_id': 'req-11c08e35-64bd-4d6a-afd1-1fbc2aa43919'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:51.998067 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-11c08e35-64bd-4d6a-afd1-1fbc2aa43919 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e5cdb3bd1fe4256aa03329c17765390', 'request_id': 'req-11c08e35-64bd-4d6a-afd1-1fbc2aa43919'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:52.007598 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-11c08e35-64bd-4d6a-afd1-1fbc2aa43919 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e5cdb3bd1fe4256aa03329c17765390', 'request_id': 'req-11c08e35-64bd-4d6a-afd1-1fbc2aa43919'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:52.009037 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:52.026205 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-11c08e35-64bd-4d6a-afd1-1fbc2aa43919 admin admin] The token cache is being invalidate because project 5e5cdb3bd1fe4256aa03329c17765390 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:30:52.026821 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-11c08e35-64bd-4d6a-afd1-1fbc2aa43919 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:52.027511 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-11c08e35-64bd-4d6a-afd1-1fbc2aa43919 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:52.029183 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1008/2041] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:30:51 2022] DELETE /identity/v3/projects/5e5cdb3bd1fe4256aa03329c17765390 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:30:52.034484 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800def5e-6b1d-44e4-aa60-ac1e58cd813a None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:52.034766 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800def5e-6b1d-44e4-aa60-ac1e58cd813a None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:52.035064 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800def5e-6b1d-44e4-aa60-ac1e58cd813a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:52.059511 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-800def5e-6b1d-44e4-aa60-ac1e58cd813a None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:30:52.061240 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-800def5e-6b1d-44e4-aa60-ac1e58cd813a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:52.142896 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1034/2042] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:30:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:30:52.150437 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123126da-7529-4eda-927c-f8ccd08ff9c1 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:52.150791 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123126da-7529-4eda-927c-f8ccd08ff9c1 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:52.151310 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123126da-7529-4eda-927c-f8ccd08ff9c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:52.172706 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-123126da-7529-4eda-927c-f8ccd08ff9c1 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:30:52.174001 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-123126da-7529-4eda-927c-f8ccd08ff9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:52.186098 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1009/2043] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:30:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:30:52.190688 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800def5e-6b1d-44e4-aa60-ac1e58cd813a None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:52.200696 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800def5e-6b1d-44e4-aa60-ac1e58cd813a None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:52.206380 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1e46b-d8fe-4427-bbdb-e7ee5d590020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:52.207313 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1e46b-d8fe-4427-bbdb-e7ee5d590020 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:52.207920 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1e46b-d8fe-4427-bbdb-e7ee5d590020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:52.208229 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1e46b-d8fe-4427-bbdb-e7ee5d590020 admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:52.209061 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb1e46b-d8fe-4427-bbdb-e7ee5d590020 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:30:52.209384 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb1e46b-d8fe-4427-bbdb-e7ee5d590020 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:52.212535 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb1e46b-d8fe-4427-bbdb-e7ee5d590020 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:52.239778 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1035/2044] 10.222.0.60 () {58 vars in 1152 bytes} [Sat Jul 2 03:30:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:30:52.244457 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123126da-7529-4eda-927c-f8ccd08ff9c1 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:52.255802 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123126da-7529-4eda-927c-f8ccd08ff9c1 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:52.269192 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee3071-732d-4454-92fa-4a1aaf01d31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:52.270078 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee3071-732d-4454-92fa-4a1aaf01d31c admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:52.270391 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee3071-732d-4454-92fa-4a1aaf01d31c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:52.270675 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee3071-732d-4454-92fa-4a1aaf01d31c admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:52.271471 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ee3071-732d-4454-92fa-4a1aaf01d31c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:52.273455 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ee3071-732d-4454-92fa-4a1aaf01d31c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:52.302478 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1010/2045] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:30:52 2022] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:30:52.306807 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1e46b-d8fe-4427-bbdb-e7ee5d590020 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:52.319247 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1e46b-d8fe-4427-bbdb-e7ee5d590020 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:52.346381 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:52.379715 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf3473-ed81-4946-891b-4f4b038d7223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:52.380390 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf3473-ed81-4946-891b-4f4b038d7223 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:52.380702 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf3473-ed81-4946-891b-4f4b038d7223 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:52.382701 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf3473-ed81-4946-891b-4f4b038d7223 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:52.382701 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaf3473-ed81-4946-891b-4f4b038d7223 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:52.383836 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaf3473-ed81-4946-891b-4f4b038d7223 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:52.411083 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1036/2046] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:30:52 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:30:52.412867 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee3071-732d-4454-92fa-4a1aaf01d31c admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:52.425973 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee3071-732d-4454-92fa-4a1aaf01d31c admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:52.432233 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb68084-7d46-41dd-91f2-fdffa8d968ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:52.433104 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb68084-7d46-41dd-91f2-fdffa8d968ee admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:52.433383 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb68084-7d46-41dd-91f2-fdffa8d968ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:52.433675 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb68084-7d46-41dd-91f2-fdffa8d968ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:52.434412 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb68084-7d46-41dd-91f2-fdffa8d968ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:52.436048 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb68084-7d46-41dd-91f2-fdffa8d968ee admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:52.447192 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1011/2047] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:30:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:30:52.451796 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf3473-ed81-4946-891b-4f4b038d7223 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:52.464515 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf3473-ed81-4946-891b-4f4b038d7223 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:52.469531 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aad47c-b37d-4803-812b-63add86b12a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:52.470194 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aad47c-b37d-4803-812b-63add86b12a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:52.470499 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aad47c-b37d-4803-812b-63add86b12a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:52.470781 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aad47c-b37d-4803-812b-63add86b12a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:52.471539 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aad47c-b37d-4803-812b-63add86b12a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:52.473422 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aad47c-b37d-4803-812b-63add86b12a9 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:52.485023 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1037/2048] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:30:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:30:52.489259 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb68084-7d46-41dd-91f2-fdffa8d968ee admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:52.499564 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb68084-7d46-41dd-91f2-fdffa8d968ee admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:52.504490 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b16e24-0a99-4e9b-89e1-104c3959c0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:52.505374 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b16e24-0a99-4e9b-89e1-104c3959c0a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:52.505652 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b16e24-0a99-4e9b-89e1-104c3959c0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:52.505921 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b16e24-0a99-4e9b-89e1-104c3959c0a3 admin admin] PATH_INFO: `/v3/projects/0194c0addc3e403d9a538513db4a9cc0/users/f7f2b1b4766e4bf8be5178fc6f286edf/roles/c43aada0326446c4ade0ab1262918fa4` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:52.521698 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b16e24-0a99-4e9b-89e1-104c3959c0a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0194c0addc3e403d9a538513db4a9cc0, user_id=f7f2b1b4766e4bf8be5178fc6f286edf, role_id=c43aada0326446c4ade0ab1262918fa4)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:52.525499 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b16e24-0a99-4e9b-89e1-104c3959c0a3 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:52.544857 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1012/2049] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:30:52 2022] PUT /identity/v3/projects/0194c0addc3e403d9a538513db4a9cc0/users/f7f2b1b4766e4bf8be5178fc6f286edf/roles/c43aada0326446c4ade0ab1262918fa4 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:30:52.557829 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cdb58f-af59-4a20-a743-7912f6abf307 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:52.558120 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cdb58f-af59-4a20-a743-7912f6abf307 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:52.558399 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cdb58f-af59-4a20-a743-7912f6abf307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:52.588439 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-92cdb58f-af59-4a20-a743-7912f6abf307 None None] MFA Rules not processed for user `f7f2b1b4766e4bf8be5178fc6f286edf`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:30:52.589681 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-92cdb58f-af59-4a20-a743-7912f6abf307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:52.660969 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1038/2050] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:30:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:30:52.666314 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b16e24-0a99-4e9b-89e1-104c3959c0a3 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:52.755420 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b16e24-0a99-4e9b-89e1-104c3959c0a3 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:52.760585 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8f86ff-95fd-4806-af72-84d12f42b72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:52.761461 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f86ff-95fd-4806-af72-84d12f42b72c admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:52.761756 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f86ff-95fd-4806-af72-84d12f42b72c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:52.762060 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f86ff-95fd-4806-af72-84d12f42b72c admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:52.762771 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8f86ff-95fd-4806-af72-84d12f42b72c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:52.764873 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8f86ff-95fd-4806-af72-84d12f42b72c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:52.801325 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1013/2051] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:30:52 2022] POST /identity/v3/projects => generated 385 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 03:30:52.805617 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cdb58f-af59-4a20-a743-7912f6abf307 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:52.820200 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cdb58f-af59-4a20-a743-7912f6abf307 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:52.883857 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb467f-4b4b-41f2-9b55-b2b4b7cb2810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:52.884533 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb467f-4b4b-41f2-9b55-b2b4b7cb2810 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:52.884793 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb467f-4b4b-41f2-9b55-b2b4b7cb2810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:52.885075 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb467f-4b4b-41f2-9b55-b2b4b7cb2810 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:52.885778 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeb467f-4b4b-41f2-9b55-b2b4b7cb2810 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:52.887749 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeb467f-4b4b-41f2-9b55-b2b4b7cb2810 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:52.910079 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1039/2052] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:30:52 2022] POST /identity/v3/users => generated 299 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 03:30:52.914469 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8f86ff-95fd-4806-af72-84d12f42b72c admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:52.935946 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8f86ff-95fd-4806-af72-84d12f42b72c admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:52.942958 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d3cabe-f171-4e1e-9c45-a645362b7dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:52.943674 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3cabe-f171-4e1e-9c45-a645362b7dca admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:52.943950 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3cabe-f171-4e1e-9c45-a645362b7dca admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:52.944217 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3cabe-f171-4e1e-9c45-a645362b7dca admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:52.944956 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d3cabe-f171-4e1e-9c45-a645362b7dca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:52.946588 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d3cabe-f171-4e1e-9c45-a645362b7dca admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:52.958987 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1014/2053] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:30:52 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 03:30:52.963454 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb467f-4b4b-41f2-9b55-b2b4b7cb2810 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:52.973873 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb467f-4b4b-41f2-9b55-b2b4b7cb2810 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:52.978936 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6fbe5c-45fd-4c6a-9521-c68c260e79bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:52.979876 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6fbe5c-45fd-4c6a-9521-c68c260e79bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:52.980118 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6fbe5c-45fd-4c6a-9521-c68c260e79bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:52.980514 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6fbe5c-45fd-4c6a-9521-c68c260e79bd admin admin] PATH_INFO: `/v3/projects/95938516458746c6bc6fe6e248bb119d/users/6464304c12544700b43d9b919fb10048/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:52.997347 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6fbe5c-45fd-4c6a-9521-c68c260e79bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=95938516458746c6bc6fe6e248bb119d, user_id=6464304c12544700b43d9b919fb10048, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:53.000079 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6fbe5c-45fd-4c6a-9521-c68c260e79bd admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:53.016864 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1040/2054] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:30:52 2022] PUT /identity/v3/projects/95938516458746c6bc6fe6e248bb119d/users/6464304c12544700b43d9b919fb10048/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 03:30:53.020855 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d3cabe-f171-4e1e-9c45-a645362b7dca admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:53.031091 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d3cabe-f171-4e1e-9c45-a645362b7dca admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:53.110749 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bdad3e-492f-4bc2-a34f-d08b5cd089fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:53.111476 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bdad3e-492f-4bc2-a34f-d08b5cd089fb admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:53.111759 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bdad3e-492f-4bc2-a34f-d08b5cd089fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:53.112035 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bdad3e-492f-4bc2-a34f-d08b5cd089fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:53.112773 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bdad3e-492f-4bc2-a34f-d08b5cd089fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:53.115477 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bdad3e-492f-4bc2-a34f-d08b5cd089fb admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:53.129515 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:53.135979 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1015/2055] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:30:53 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:30:53.140300 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6fbe5c-45fd-4c6a-9521-c68c260e79bd admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:53.146054 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:53.152757 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6fbe5c-45fd-4c6a-9521-c68c260e79bd admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:53.158012 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c5c130-7aee-4b51-b272-4968fa350832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:53.158992 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5c130-7aee-4b51-b272-4968fa350832 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:53.159363 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5c130-7aee-4b51-b272-4968fa350832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:53.159703 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5c130-7aee-4b51-b272-4968fa350832 admin admin] PATH_INFO: `/v3/projects/95938516458746c6bc6fe6e248bb119d/users/6464304c12544700b43d9b919fb10048/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:53.161781 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c5c130-7aee-4b51-b272-4968fa350832 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95938516458746c6bc6fe6e248bb119d, user_id=6464304c12544700b43d9b919fb10048, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:53.164619 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c5c130-7aee-4b51-b272-4968fa350832 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:53.176231 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1041/2056] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:30:53 2022] PUT /identity/v3/projects/95938516458746c6bc6fe6e248bb119d/users/6464304c12544700b43d9b919fb10048/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:30:53.187011 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b51929-cf41-4dfd-8f66-2f0638e39cdd None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:53.187380 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b51929-cf41-4dfd-8f66-2f0638e39cdd None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:53.187664 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b51929-cf41-4dfd-8f66-2f0638e39cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:53.221240 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-e8b51929-cf41-4dfd-8f66-2f0638e39cdd None None] MFA Rules not processed for user `6464304c12544700b43d9b919fb10048`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:30:53.222454 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e8b51929-cf41-4dfd-8f66-2f0638e39cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:53.307009 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1016/2057] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:30:53 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:30:53.318388 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c5c130-7aee-4b51-b272-4968fa350832 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:53.320103 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-16c5c130-7aee-4b51-b272-4968fa350832 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:53.398322 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c5c130-7aee-4b51-b272-4968fa350832 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:53.398322 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a29f63-c33d-41c5-8c01-378e6c46b714 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:53.398322 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a29f63-c33d-41c5-8c01-378e6c46b714 service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:53.398322 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a29f63-c33d-41c5-8c01-378e6c46b714 service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:53.398699 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a29f63-c33d-41c5-8c01-378e6c46b714 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:53.407921 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a29f63-c33d-41c5-8c01-378e6c46b714 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:53.409507 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a29f63-c33d-41c5-8c01-378e6c46b714 service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:53.419851 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1042/2058] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:30:53 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:30:54.246519 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b51929-cf41-4dfd-8f66-2f0638e39cdd None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:54.339274 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b51929-cf41-4dfd-8f66-2f0638e39cdd None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:54.344046 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e01250-1cda-4cb0-912f-eeb716d30ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:54.345021 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e01250-1cda-4cb0-912f-eeb716d30ad2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:54.345372 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e01250-1cda-4cb0-912f-eeb716d30ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:54.345691 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e01250-1cda-4cb0-912f-eeb716d30ad2 admin admin] PATH_INFO: `/v3/users/f7f2b1b4766e4bf8be5178fc6f286edf` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:54.346998 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e01250-1cda-4cb0-912f-eeb716d30ad2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7f2b1b4766e4bf8be5178fc6f286edf)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:54.349215 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e01250-1cda-4cb0-912f-eeb716d30ad2 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:54.417806 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-53e01250-1cda-4cb0-912f-eeb716d30ad2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7f2b1b4766e4bf8be5178fc6f286edf'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:54.419256 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-53e01250-1cda-4cb0-912f-eeb716d30ad2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7f2b1b4766e4bf8be5178fc6f286edf'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:54.420450 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-53e01250-1cda-4cb0-912f-eeb716d30ad2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7f2b1b4766e4bf8be5178fc6f286edf'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:54.439016 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-53e01250-1cda-4cb0-912f-eeb716d30ad2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7f2b1b4766e4bf8be5178fc6f286edf'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:54.449155 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-53e01250-1cda-4cb0-912f-eeb716d30ad2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7f2b1b4766e4bf8be5178fc6f286edf'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:54.465934 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1017/2059] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:30:54 2022] DELETE /identity/v3/users/f7f2b1b4766e4bf8be5178fc6f286edf => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:30:54.470069 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4343823-58bf-461c-a7e6-341abac67f14 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:54.470606 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4343823-58bf-461c-a7e6-341abac67f14 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:54.470851 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4343823-58bf-461c-a7e6-341abac67f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:54.488576 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-c4343823-58bf-461c-a7e6-341abac67f14 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:30:54.489788 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-c4343823-58bf-461c-a7e6-341abac67f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:54.578927 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1043/2060] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:30:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:30:54.588794 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e01250-1cda-4cb0-912f-eeb716d30ad2 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:54.590303 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-53e01250-1cda-4cb0-912f-eeb716d30ad2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:54.597408 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:54.660587 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e01250-1cda-4cb0-912f-eeb716d30ad2 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:54.664450 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b77c9c-57ec-47b8-8d48-2e4b9723869b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:54.665106 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b77c9c-57ec-47b8-8d48-2e4b9723869b service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:54.665386 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b77c9c-57ec-47b8-8d48-2e4b9723869b service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:54.665693 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b77c9c-57ec-47b8-8d48-2e4b9723869b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:54.675946 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b77c9c-57ec-47b8-8d48-2e4b9723869b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:54.677540 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b77c9c-57ec-47b8-8d48-2e4b9723869b service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:54.687523 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1018/2061] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:30:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:30:54.976879 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4343823-58bf-461c-a7e6-341abac67f14 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:54.978462 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-c4343823-58bf-461c-a7e6-341abac67f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:55.019810 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4343823-58bf-461c-a7e6-341abac67f14 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:55.033183 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b597a2c9-23d5-45de-b2bd-04fc439dc4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:55.034260 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597a2c9-23d5-45de-b2bd-04fc439dc4f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:55.035782 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597a2c9-23d5-45de-b2bd-04fc439dc4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:55.038967 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597a2c9-23d5-45de-b2bd-04fc439dc4f6 admin admin] PATH_INFO: `/v3/projects/0194c0addc3e403d9a538513db4a9cc0` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:55.041365 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b597a2c9-23d5-45de-b2bd-04fc439dc4f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0194c0addc3e403d9a538513db4a9cc0)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:55.045753 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b597a2c9-23d5-45de-b2bd-04fc439dc4f6 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:55.132453 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-b597a2c9-23d5-45de-b2bd-04fc439dc4f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0194c0addc3e403d9a538513db4a9cc0', 'request_id': 'req-b597a2c9-23d5-45de-b2bd-04fc439dc4f6'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:55.139833 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-b597a2c9-23d5-45de-b2bd-04fc439dc4f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0194c0addc3e403d9a538513db4a9cc0', 'request_id': 'req-b597a2c9-23d5-45de-b2bd-04fc439dc4f6'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:55.148008 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-b597a2c9-23d5-45de-b2bd-04fc439dc4f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0194c0addc3e403d9a538513db4a9cc0', 'request_id': 'req-b597a2c9-23d5-45de-b2bd-04fc439dc4f6'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:55.170193 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-b597a2c9-23d5-45de-b2bd-04fc439dc4f6 admin admin] The token cache is being invalidate because project 0194c0addc3e403d9a538513db4a9cc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:30:55.170596 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-b597a2c9-23d5-45de-b2bd-04fc439dc4f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:55.171374 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-b597a2c9-23d5-45de-b2bd-04fc439dc4f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:55.173002 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1044/2062] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:30:54 2022] DELETE /identity/v3/projects/0194c0addc3e403d9a538513db4a9cc0 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:30:55.177368 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b77c9c-57ec-47b8-8d48-2e4b9723869b service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:55.193702 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b77c9c-57ec-47b8-8d48-2e4b9723869b service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:55.298146 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e20ec8f-9166-4749-858c-4aa1f2a4486b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:55.299719 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20ec8f-9166-4749-858c-4aa1f2a4486b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:55.300172 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20ec8f-9166-4749-858c-4aa1f2a4486b admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:55.300996 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20ec8f-9166-4749-858c-4aa1f2a4486b admin admin] PATH_INFO: `/v3/users/6464304c12544700b43d9b919fb10048` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:55.303186 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e20ec8f-9166-4749-858c-4aa1f2a4486b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6464304c12544700b43d9b919fb10048)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:55.305953 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e20ec8f-9166-4749-858c-4aa1f2a4486b admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:55.394766 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4e20ec8f-9166-4749-858c-4aa1f2a4486b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6464304c12544700b43d9b919fb10048'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:55.395820 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4e20ec8f-9166-4749-858c-4aa1f2a4486b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6464304c12544700b43d9b919fb10048'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:55.396615 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4e20ec8f-9166-4749-858c-4aa1f2a4486b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6464304c12544700b43d9b919fb10048'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:55.419530 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4e20ec8f-9166-4749-858c-4aa1f2a4486b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6464304c12544700b43d9b919fb10048'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:55.430065 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4e20ec8f-9166-4749-858c-4aa1f2a4486b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6464304c12544700b43d9b919fb10048'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:55.449923 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1019/2063] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:30:55 2022] DELETE /identity/v3/users/6464304c12544700b43d9b919fb10048 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:30:55.910425 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b597a2c9-23d5-45de-b2bd-04fc439dc4f6 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:55.912172 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-b597a2c9-23d5-45de-b2bd-04fc439dc4f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:55.929625 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b597a2c9-23d5-45de-b2bd-04fc439dc4f6 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:55.942789 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:55.991376 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809cb6df-364d-482e-8a0d-ba156e039bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:55.992244 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809cb6df-364d-482e-8a0d-ba156e039bc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:55.992525 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809cb6df-364d-482e-8a0d-ba156e039bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:55.992795 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809cb6df-364d-482e-8a0d-ba156e039bc5 admin admin] PATH_INFO: `/v3/projects/95938516458746c6bc6fe6e248bb119d` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:55.993977 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809cb6df-364d-482e-8a0d-ba156e039bc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95938516458746c6bc6fe6e248bb119d)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:55.995935 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809cb6df-364d-482e-8a0d-ba156e039bc5 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:56.047745 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-809cb6df-364d-482e-8a0d-ba156e039bc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95938516458746c6bc6fe6e248bb119d', 'request_id': 'req-809cb6df-364d-482e-8a0d-ba156e039bc5'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:56.055143 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-809cb6df-364d-482e-8a0d-ba156e039bc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95938516458746c6bc6fe6e248bb119d', 'request_id': 'req-809cb6df-364d-482e-8a0d-ba156e039bc5'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:56.064974 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-809cb6df-364d-482e-8a0d-ba156e039bc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95938516458746c6bc6fe6e248bb119d', 'request_id': 'req-809cb6df-364d-482e-8a0d-ba156e039bc5'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:56.081374 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-809cb6df-364d-482e-8a0d-ba156e039bc5 admin admin] The token cache is being invalidate because project 95938516458746c6bc6fe6e248bb119d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:30:56.081704 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-809cb6df-364d-482e-8a0d-ba156e039bc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:56.082421 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-809cb6df-364d-482e-8a0d-ba156e039bc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:30:56.084071 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1045/2064] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:30:55 2022] DELETE /identity/v3/projects/95938516458746c6bc6fe6e248bb119d => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:30:56.089167 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674bab5-4dc2-49f5-bc78-98599e6ef6fb None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:56.089548 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674bab5-4dc2-49f5-bc78-98599e6ef6fb None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:56.089838 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674bab5-4dc2-49f5-bc78-98599e6ef6fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:56.108375 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-f674bab5-4dc2-49f5-bc78-98599e6ef6fb None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:30:56.109965 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f674bab5-4dc2-49f5-bc78-98599e6ef6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:56.145142 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:56.187941 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1020/2065] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:30:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:30:56.196213 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db695e88-a068-4c7a-a19e-0589a6885e48 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:56.196568 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db695e88-a068-4c7a-a19e-0589a6885e48 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:56.196912 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db695e88-a068-4c7a-a19e-0589a6885e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:56.215529 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-db695e88-a068-4c7a-a19e-0589a6885e48 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:30:56.216745 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-db695e88-a068-4c7a-a19e-0589a6885e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:56.225389 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1046/2066] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:30:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 03:30:56.229584 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f674bab5-4dc2-49f5-bc78-98599e6ef6fb None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:56.239812 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f674bab5-4dc2-49f5-bc78-98599e6ef6fb None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:56.244730 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf94d21d-c3a7-41df-80fe-e2d85fcaff7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:56.245398 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf94d21d-c3a7-41df-80fe-e2d85fcaff7b admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:56.245675 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf94d21d-c3a7-41df-80fe-e2d85fcaff7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:56.245948 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf94d21d-c3a7-41df-80fe-e2d85fcaff7b admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:56.246679 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf94d21d-c3a7-41df-80fe-e2d85fcaff7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:30:56.246981 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf94d21d-c3a7-41df-80fe-e2d85fcaff7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:56.248660 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf94d21d-c3a7-41df-80fe-e2d85fcaff7b admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:56.260356 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1021/2067] 10.222.0.60 () {58 vars in 1152 bytes} [Sat Jul 2 03:30:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:30:56.264478 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db695e88-a068-4c7a-a19e-0589a6885e48 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:56.274586 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db695e88-a068-4c7a-a19e-0589a6885e48 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:56.280257 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125df96b-3ce5-4109-8a3a-9dd0afed063a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:56.280936 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125df96b-3ce5-4109-8a3a-9dd0afed063a admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:56.281200 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125df96b-3ce5-4109-8a3a-9dd0afed063a admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:56.281471 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125df96b-3ce5-4109-8a3a-9dd0afed063a admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:56.282200 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125df96b-3ce5-4109-8a3a-9dd0afed063a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:56.284210 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125df96b-3ce5-4109-8a3a-9dd0afed063a admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:56.313126 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1047/2068] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:30:56 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:30:56.317727 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf94d21d-c3a7-41df-80fe-e2d85fcaff7b admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:56.328765 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf94d21d-c3a7-41df-80fe-e2d85fcaff7b admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:56.389665 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc67c7a-2feb-4c66-a65e-65a8e2e14eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:56.390398 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc67c7a-2feb-4c66-a65e-65a8e2e14eab admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:56.390679 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc67c7a-2feb-4c66-a65e-65a8e2e14eab admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:56.390954 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc67c7a-2feb-4c66-a65e-65a8e2e14eab admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:56.391713 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc67c7a-2feb-4c66-a65e-65a8e2e14eab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:56.393646 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc67c7a-2feb-4c66-a65e-65a8e2e14eab admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:56.417902 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1022/2069] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:30:56 2022] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:30:56.419348 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125df96b-3ce5-4109-8a3a-9dd0afed063a admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:56.430273 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125df96b-3ce5-4109-8a3a-9dd0afed063a admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:56.435230 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd5ac0-3c2a-4cd5-95da-11e63706ca13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:56.435888 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd5ac0-3c2a-4cd5-95da-11e63706ca13 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:56.436165 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd5ac0-3c2a-4cd5-95da-11e63706ca13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:56.436431 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd5ac0-3c2a-4cd5-95da-11e63706ca13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:56.437154 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bd5ac0-3c2a-4cd5-95da-11e63706ca13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:56.438749 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bd5ac0-3c2a-4cd5-95da-11e63706ca13 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:56.449649 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1048/2070] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:30:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:30:56.453749 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc67c7a-2feb-4c66-a65e-65a8e2e14eab admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:56.465179 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc67c7a-2feb-4c66-a65e-65a8e2e14eab admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:56.472237 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dcda38-a0ab-4e86-a924-7b06628b4ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:56.472958 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dcda38-a0ab-4e86-a924-7b06628b4ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:56.473239 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dcda38-a0ab-4e86-a924-7b06628b4ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:56.473493 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dcda38-a0ab-4e86-a924-7b06628b4ae4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:56.474258 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dcda38-a0ab-4e86-a924-7b06628b4ae4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:56.475977 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dcda38-a0ab-4e86-a924-7b06628b4ae4 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:56.487102 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1023/2071] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:30:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:30:56.491670 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd5ac0-3c2a-4cd5-95da-11e63706ca13 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:56.502083 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd5ac0-3c2a-4cd5-95da-11e63706ca13 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:56.507504 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371ae38-6769-4c5c-bfae-4dd48ae24eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:56.508407 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371ae38-6769-4c5c-bfae-4dd48ae24eb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:56.508683 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371ae38-6769-4c5c-bfae-4dd48ae24eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:56.508957 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371ae38-6769-4c5c-bfae-4dd48ae24eb5 admin admin] PATH_INFO: `/v3/projects/7d1d4a2ee0c74db9b6d02520da2ae917/users/806d54f336ea437ea6fd78172085ee5a/roles/c43aada0326446c4ade0ab1262918fa4` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:56.524838 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9371ae38-6769-4c5c-bfae-4dd48ae24eb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d1d4a2ee0c74db9b6d02520da2ae917, user_id=806d54f336ea437ea6fd78172085ee5a, role_id=c43aada0326446c4ade0ab1262918fa4)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:56.527532 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9371ae38-6769-4c5c-bfae-4dd48ae24eb5 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:56.542985 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1049/2072] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:30:56 2022] PUT /identity/v3/projects/7d1d4a2ee0c74db9b6d02520da2ae917/users/806d54f336ea437ea6fd78172085ee5a/roles/c43aada0326446c4ade0ab1262918fa4 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:30:56.613845 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3b1a04-5f16-4448-a1a5-f65b0f8ecc9b None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:56.614113 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3b1a04-5f16-4448-a1a5-f65b0f8ecc9b None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:56.614399 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3b1a04-5f16-4448-a1a5-f65b0f8ecc9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:56.643806 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-0a3b1a04-5f16-4448-a1a5-f65b0f8ecc9b None None] MFA Rules not processed for user `806d54f336ea437ea6fd78172085ee5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:30:56.645024 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0a3b1a04-5f16-4448-a1a5-f65b0f8ecc9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:56.710974 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1024/2073] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:30:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:30:56.724297 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371ae38-6769-4c5c-bfae-4dd48ae24eb5 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:30:56.726198 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-9371ae38-6769-4c5c-bfae-4dd48ae24eb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:30:56.772699 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:30:56.793523 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371ae38-6769-4c5c-bfae-4dd48ae24eb5 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:30:56.800760 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85e483f-855c-479e-8905-7481582e42ee service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6470ccbf858f47bf9bb884476bf4235e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:30:56.801446 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e483f-855c-479e-8905-7481582e42ee service glance] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:30:56.801730 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e483f-855c-479e-8905-7481582e42ee service glance] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:30:56.802004 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e483f-855c-479e-8905-7481582e42ee service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:30:56.811586 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85e483f-855c-479e-8905-7481582e42ee service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:30:56.812998 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85e483f-855c-479e-8905-7481582e42ee service glance] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:30:56.822408 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1050/2074] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:30:56 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 03:31:02.507342 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3b1a04-5f16-4448-a1a5-f65b0f8ecc9b None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:02.509803 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0a3b1a04-5f16-4448-a1a5-f65b0f8ecc9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:31:02.544765 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:31:02.592127 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3b1a04-5f16-4448-a1a5-f65b0f8ecc9b None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:02.596926 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b122c4b-e2ad-4270-9a64-2ae3f8788492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:02.597969 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b122c4b-e2ad-4270-9a64-2ae3f8788492 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:02.598247 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b122c4b-e2ad-4270-9a64-2ae3f8788492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:02.598520 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b122c4b-e2ad-4270-9a64-2ae3f8788492 admin admin] PATH_INFO: `/v3/users/a65a291b3a854e3e99d894f5d9407201` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:02.599754 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b122c4b-e2ad-4270-9a64-2ae3f8788492 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a65a291b3a854e3e99d894f5d9407201)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:02.601708 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b122c4b-e2ad-4270-9a64-2ae3f8788492 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:02.654313 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4b122c4b-e2ad-4270-9a64-2ae3f8788492 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a65a291b3a854e3e99d894f5d9407201'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:02.654896 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4b122c4b-e2ad-4270-9a64-2ae3f8788492 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a65a291b3a854e3e99d894f5d9407201'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:02.655563 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4b122c4b-e2ad-4270-9a64-2ae3f8788492 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a65a291b3a854e3e99d894f5d9407201'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:02.668280 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4b122c4b-e2ad-4270-9a64-2ae3f8788492 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a65a291b3a854e3e99d894f5d9407201'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:02.676880 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4b122c4b-e2ad-4270-9a64-2ae3f8788492 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a65a291b3a854e3e99d894f5d9407201'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:02.701504 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1025/2075] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:31:02 2022] DELETE /identity/v3/users/a65a291b3a854e3e99d894f5d9407201 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:31:02.706064 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c3fba-f5f4-4ead-b7e0-a1b2fa3f490b None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:02.706580 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c3fba-f5f4-4ead-b7e0-a1b2fa3f490b None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:02.706660 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c3fba-f5f4-4ead-b7e0-a1b2fa3f490b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:02.724548 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-2c3c3fba-f5f4-4ead-b7e0-a1b2fa3f490b None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:31:02.725815 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-2c3c3fba-f5f4-4ead-b7e0-a1b2fa3f490b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:31:02.794267 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1051/2076] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:31:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:31:02.804504 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b122c4b-e2ad-4270-9a64-2ae3f8788492 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:02.806262 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4b122c4b-e2ad-4270-9a64-2ae3f8788492 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:31:02.865536 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b122c4b-e2ad-4270-9a64-2ae3f8788492 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:02.870662 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb57be-87de-4d68-bc84-b1db4cd1b6b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:02.871773 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb57be-87de-4d68-bc84-b1db4cd1b6b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:02.871773 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb57be-87de-4d68-bc84-b1db4cd1b6b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:02.872168 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb57be-87de-4d68-bc84-b1db4cd1b6b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:02.883386 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdb57be-87de-4d68-bc84-b1db4cd1b6b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:02.884869 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdb57be-87de-4d68-bc84-b1db4cd1b6b9 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:02.895438 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1026/2077] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:31:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 03:31:03.232451 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3c3fba-f5f4-4ead-b7e0-a1b2fa3f490b None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:03.234314 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-2c3c3fba-f5f4-4ead-b7e0-a1b2fa3f490b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:31:03.252323 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3c3fba-f5f4-4ead-b7e0-a1b2fa3f490b None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:03.262424 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4bcce-74f9-4442-a2be-bf2af3c0b554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:03.263383 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4bcce-74f9-4442-a2be-bf2af3c0b554 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:03.263663 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4bcce-74f9-4442-a2be-bf2af3c0b554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:03.263937 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4bcce-74f9-4442-a2be-bf2af3c0b554 admin admin] PATH_INFO: `/v3/projects/73389b1df990428cb9ee438e4883341c` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:03.265410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a4bcce-74f9-4442-a2be-bf2af3c0b554 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73389b1df990428cb9ee438e4883341c)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:03.267467 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a4bcce-74f9-4442-a2be-bf2af3c0b554 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:03.341176 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-54a4bcce-74f9-4442-a2be-bf2af3c0b554 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73389b1df990428cb9ee438e4883341c', 'request_id': 'req-54a4bcce-74f9-4442-a2be-bf2af3c0b554'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:03.349342 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-54a4bcce-74f9-4442-a2be-bf2af3c0b554 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73389b1df990428cb9ee438e4883341c', 'request_id': 'req-54a4bcce-74f9-4442-a2be-bf2af3c0b554'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:03.360287 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-54a4bcce-74f9-4442-a2be-bf2af3c0b554 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73389b1df990428cb9ee438e4883341c', 'request_id': 'req-54a4bcce-74f9-4442-a2be-bf2af3c0b554'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:03.383587 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-54a4bcce-74f9-4442-a2be-bf2af3c0b554 admin admin] The token cache is being invalidate because project 73389b1df990428cb9ee438e4883341c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:31:03.384185 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-54a4bcce-74f9-4442-a2be-bf2af3c0b554 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:03.385159 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-54a4bcce-74f9-4442-a2be-bf2af3c0b554 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:03.387552 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1052/2078] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:31:03 2022] DELETE /identity/v3/projects/73389b1df990428cb9ee438e4883341c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 03:31:03.393401 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c90f801-1dba-46e8-8a46-46e3041148a1 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:03.394059 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c90f801-1dba-46e8-8a46-46e3041148a1 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:03.394720 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c90f801-1dba-46e8-8a46-46e3041148a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:03.416656 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-2c90f801-1dba-46e8-8a46-46e3041148a1 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:31:03.417827 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2c90f801-1dba-46e8-8a46-46e3041148a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:31:03.483022 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:31:03.521213 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1027/2079] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:31:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:31:03.530177 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8d861-4ee2-4825-823b-7e69da59cfb5 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:03.530538 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8d861-4ee2-4825-823b-7e69da59cfb5 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:03.530818 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8d861-4ee2-4825-823b-7e69da59cfb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:03.556069 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-57f8d861-4ee2-4825-823b-7e69da59cfb5 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:31:03.557700 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-57f8d861-4ee2-4825-823b-7e69da59cfb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:31:03.575158 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1053/2080] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:31:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 03:31:03.580429 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c90f801-1dba-46e8-8a46-46e3041148a1 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:03.591506 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c90f801-1dba-46e8-8a46-46e3041148a1 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:03.596705 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e46c237-f30c-4346-8081-7d3f20943bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:03.597842 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46c237-f30c-4346-8081-7d3f20943bf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:03.598294 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46c237-f30c-4346-8081-7d3f20943bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:03.598623 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46c237-f30c-4346-8081-7d3f20943bf9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:03.603172 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e46c237-f30c-4346-8081-7d3f20943bf9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:31:03.603514 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e46c237-f30c-4346-8081-7d3f20943bf9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:03.605349 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e46c237-f30c-4346-8081-7d3f20943bf9 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:03.627427 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1028/2081] 10.222.0.60 () {58 vars in 1152 bytes} [Sat Jul 2 03:31:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:31:03.637420 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f8d861-4ee2-4825-823b-7e69da59cfb5 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:03.645058 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f8d861-4ee2-4825-823b-7e69da59cfb5 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:03.664633 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bffd34-2ea5-457f-98ce-2c0cec47fcdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:03.665318 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bffd34-2ea5-457f-98ce-2c0cec47fcdf admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:03.665597 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bffd34-2ea5-457f-98ce-2c0cec47fcdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:03.666229 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bffd34-2ea5-457f-98ce-2c0cec47fcdf admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:03.667677 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bffd34-2ea5-457f-98ce-2c0cec47fcdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:03.669106 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bffd34-2ea5-457f-98ce-2c0cec47fcdf admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:03.707894 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1054/2082] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:31:03 2022] POST /identity/v3/projects => generated 373 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 03:31:03.712577 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e46c237-f30c-4346-8081-7d3f20943bf9 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:03.723755 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e46c237-f30c-4346-8081-7d3f20943bf9 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:03.786039 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a2d36-82f1-4d2a-9c23-c13762f6b05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:03.786725 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a2d36-82f1-4d2a-9c23-c13762f6b05a admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:03.787009 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a2d36-82f1-4d2a-9c23-c13762f6b05a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:03.787313 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a2d36-82f1-4d2a-9c23-c13762f6b05a admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:03.788012 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4a2d36-82f1-4d2a-9c23-c13762f6b05a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:03.790027 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4a2d36-82f1-4d2a-9c23-c13762f6b05a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:03.818319 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1029/2083] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:31:03 2022] POST /identity/v3/users => generated 287 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:31:03.820505 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bffd34-2ea5-457f-98ce-2c0cec47fcdf admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:03.836162 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bffd34-2ea5-457f-98ce-2c0cec47fcdf admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:03.841321 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65efb67a-8d62-40a3-a424-1f3892c8d603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:03.842153 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65efb67a-8d62-40a3-a424-1f3892c8d603 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:03.842406 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65efb67a-8d62-40a3-a424-1f3892c8d603 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:03.842759 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65efb67a-8d62-40a3-a424-1f3892c8d603 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:03.843634 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65efb67a-8d62-40a3-a424-1f3892c8d603 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:03.847099 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65efb67a-8d62-40a3-a424-1f3892c8d603 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:03.858634 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1055/2084] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:31:03 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:31:03.862686 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a2d36-82f1-4d2a-9c23-c13762f6b05a admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:03.873569 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a2d36-82f1-4d2a-9c23-c13762f6b05a admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:03.879671 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1519f46c-d53a-43f1-835d-a93ebefc92e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:03.880387 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1519f46c-d53a-43f1-835d-a93ebefc92e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:03.880660 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1519f46c-d53a-43f1-835d-a93ebefc92e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:03.880934 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1519f46c-d53a-43f1-835d-a93ebefc92e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:03.881695 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1519f46c-d53a-43f1-835d-a93ebefc92e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:03.883438 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1519f46c-d53a-43f1-835d-a93ebefc92e0 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:03.894323 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1030/2085] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:31:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:31:03.898701 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65efb67a-8d62-40a3-a424-1f3892c8d603 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:03.909215 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65efb67a-8d62-40a3-a424-1f3892c8d603 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:03.914220 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c4c580-8830-48e9-98f6-7bfc0be0907e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:03.915250 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c4c580-8830-48e9-98f6-7bfc0be0907e admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:03.915532 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c4c580-8830-48e9-98f6-7bfc0be0907e admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:03.916150 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c4c580-8830-48e9-98f6-7bfc0be0907e admin admin] PATH_INFO: `/v3/projects/0ce02c424395486abd544101c88b3b4f/users/8a474d7a1e8c4dd280cc5529d3cb15ff/roles/c43aada0326446c4ade0ab1262918fa4` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:03.934512 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c4c580-8830-48e9-98f6-7bfc0be0907e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ce02c424395486abd544101c88b3b4f, user_id=8a474d7a1e8c4dd280cc5529d3cb15ff, role_id=c43aada0326446c4ade0ab1262918fa4)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:03.937271 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c4c580-8830-48e9-98f6-7bfc0be0907e admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:03.959236 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1056/2086] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:31:03 2022] PUT /identity/v3/projects/0ce02c424395486abd544101c88b3b4f/users/8a474d7a1e8c4dd280cc5529d3cb15ff/roles/c43aada0326446c4ade0ab1262918fa4 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 03:31:03.966899 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f6e95-4885-4b26-9363-68935e21d779 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:03.967241 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f6e95-4885-4b26-9363-68935e21d779 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:03.967494 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f6e95-4885-4b26-9363-68935e21d779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:03.998603 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-b44f6e95-4885-4b26-9363-68935e21d779 None None] MFA Rules not processed for user `8a474d7a1e8c4dd280cc5529d3cb15ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:31:03.999869 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b44f6e95-4885-4b26-9363-68935e21d779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:31:04.072701 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1031/2087] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:31:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:31:04.084169 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c4c580-8830-48e9-98f6-7bfc0be0907e admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:04.085913 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-a7c4c580-8830-48e9-98f6-7bfc0be0907e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:31:04.096562 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:31:04.149789 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c4c580-8830-48e9-98f6-7bfc0be0907e admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:04.154021 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6b87a-5f3d-47ed-8b04-d6cf739466d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:04.154773 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6b87a-5f3d-47ed-8b04-d6cf739466d0 service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:04.155149 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6b87a-5f3d-47ed-8b04-d6cf739466d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:04.155536 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6b87a-5f3d-47ed-8b04-d6cf739466d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:04.166259 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a6b87a-5f3d-47ed-8b04-d6cf739466d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:04.167768 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a6b87a-5f3d-47ed-8b04-d6cf739466d0 service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:04.199513 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1057/2088] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:31:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 03:31:06.538876 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f6e95-4885-4b26-9363-68935e21d779 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:06.541664 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b44f6e95-4885-4b26-9363-68935e21d779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:31:06.592506 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:31:06.615155 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f6e95-4885-4b26-9363-68935e21d779 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:06.620165 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347b021f-fa4e-4657-94fc-b269e49eed35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:06.621043 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b021f-fa4e-4657-94fc-b269e49eed35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:06.621321 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b021f-fa4e-4657-94fc-b269e49eed35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:06.621596 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b021f-fa4e-4657-94fc-b269e49eed35 admin admin] PATH_INFO: `/v3/users/d2581f217a574b13b0fe042d38a94740` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:06.622830 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347b021f-fa4e-4657-94fc-b269e49eed35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2581f217a574b13b0fe042d38a94740)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:06.624835 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347b021f-fa4e-4657-94fc-b269e49eed35 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:06.681114 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-347b021f-fa4e-4657-94fc-b269e49eed35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2581f217a574b13b0fe042d38a94740'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:06.681891 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-347b021f-fa4e-4657-94fc-b269e49eed35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2581f217a574b13b0fe042d38a94740'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:06.682539 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-347b021f-fa4e-4657-94fc-b269e49eed35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2581f217a574b13b0fe042d38a94740'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:06.698124 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-347b021f-fa4e-4657-94fc-b269e49eed35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2581f217a574b13b0fe042d38a94740'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:06.707090 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-347b021f-fa4e-4657-94fc-b269e49eed35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2581f217a574b13b0fe042d38a94740'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:06.725235 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1032/2089] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:31:06 2022] DELETE /identity/v3/users/d2581f217a574b13b0fe042d38a94740 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:31:06.910920 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6b87a-5f3d-47ed-8b04-d6cf739466d0 service cinder] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:06.923084 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6b87a-5f3d-47ed-8b04-d6cf739466d0 service cinder] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:06.993111 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9377fef1-86b6-43ce-937f-577e546c35c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:06.994102 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377fef1-86b6-43ce-937f-577e546c35c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:06.994453 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377fef1-86b6-43ce-937f-577e546c35c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:06.994729 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377fef1-86b6-43ce-937f-577e546c35c8 admin admin] PATH_INFO: `/v3/projects/c341097b55354c959d45768712b4748e` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:06.996124 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9377fef1-86b6-43ce-937f-577e546c35c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c341097b55354c959d45768712b4748e)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:06.998261 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9377fef1-86b6-43ce-937f-577e546c35c8 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:07.071777 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-9377fef1-86b6-43ce-937f-577e546c35c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c341097b55354c959d45768712b4748e', 'request_id': 'req-9377fef1-86b6-43ce-937f-577e546c35c8'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:07.078599 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-9377fef1-86b6-43ce-937f-577e546c35c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c341097b55354c959d45768712b4748e', 'request_id': 'req-9377fef1-86b6-43ce-937f-577e546c35c8'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:07.090473 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-9377fef1-86b6-43ce-937f-577e546c35c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c341097b55354c959d45768712b4748e', 'request_id': 'req-9377fef1-86b6-43ce-937f-577e546c35c8'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:07.104240 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-9377fef1-86b6-43ce-937f-577e546c35c8 admin admin] The token cache is being invalidate because project c341097b55354c959d45768712b4748e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:31:07.104525 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-9377fef1-86b6-43ce-937f-577e546c35c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:07.105175 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-9377fef1-86b6-43ce-937f-577e546c35c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:07.106760 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1058/2090] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:31:06 2022] DELETE /identity/v3/projects/c341097b55354c959d45768712b4748e => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:31:07.112008 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd35e8-4f45-4d4e-a4a7-e0ca011bd922 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:07.112289 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd35e8-4f45-4d4e-a4a7-e0ca011bd922 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:07.112615 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd35e8-4f45-4d4e-a4a7-e0ca011bd922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:07.138011 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-51fd35e8-4f45-4d4e-a4a7-e0ca011bd922 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:31:07.139273 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-51fd35e8-4f45-4d4e-a4a7-e0ca011bd922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:31:07.205218 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1033/2091] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:31:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 03:31:07.214282 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3ecb7-d98b-4cb2-96d7-95e751b66574 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:07.214572 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3ecb7-d98b-4cb2-96d7-95e751b66574 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:07.214851 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3ecb7-d98b-4cb2-96d7-95e751b66574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:07.233533 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-eee3ecb7-d98b-4cb2-96d7-95e751b66574 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:31:07.234747 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-eee3ecb7-d98b-4cb2-96d7-95e751b66574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:31:07.243194 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1059/2092] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:31:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:31:07.248486 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fd35e8-4f45-4d4e-a4a7-e0ca011bd922 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:07.260037 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fd35e8-4f45-4d4e-a4a7-e0ca011bd922 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:07.267439 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1fad6f-7d91-4c51-862f-e396cd65e51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:07.268449 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1fad6f-7d91-4c51-862f-e396cd65e51a admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:07.268730 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1fad6f-7d91-4c51-862f-e396cd65e51a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:07.270563 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1fad6f-7d91-4c51-862f-e396cd65e51a admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:07.271488 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1fad6f-7d91-4c51-862f-e396cd65e51a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:31:07.271801 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1fad6f-7d91-4c51-862f-e396cd65e51a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:07.273690 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1fad6f-7d91-4c51-862f-e396cd65e51a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:07.286944 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1034/2093] 10.222.0.60 () {58 vars in 1152 bytes} [Sat Jul 2 03:31:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:31:07.292158 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3ecb7-d98b-4cb2-96d7-95e751b66574 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:07.308155 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3ecb7-d98b-4cb2-96d7-95e751b66574 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:07.313013 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cd11c3-6b2f-4e4d-bb2d-1990db166f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:07.313585 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd11c3-6b2f-4e4d-bb2d-1990db166f4a admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:07.313858 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd11c3-6b2f-4e4d-bb2d-1990db166f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:07.314128 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd11c3-6b2f-4e4d-bb2d-1990db166f4a admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:07.314867 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cd11c3-6b2f-4e4d-bb2d-1990db166f4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:07.316903 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cd11c3-6b2f-4e4d-bb2d-1990db166f4a admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:07.347218 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1060/2094] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:31:07 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 03:31:07.351463 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1fad6f-7d91-4c51-862f-e396cd65e51a admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:07.361634 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1fad6f-7d91-4c51-862f-e396cd65e51a admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:07.414489 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:31:07.429870 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca67ae-56d4-4483-a47f-d6ed51fe24b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:07.430607 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca67ae-56d4-4483-a47f-d6ed51fe24b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:07.430885 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca67ae-56d4-4483-a47f-d6ed51fe24b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:07.431182 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca67ae-56d4-4483-a47f-d6ed51fe24b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:07.431903 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccca67ae-56d4-4483-a47f-d6ed51fe24b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:07.433835 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccca67ae-56d4-4483-a47f-d6ed51fe24b7 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:07.455591 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1035/2095] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:31:07 2022] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 03:31:07.459916 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cd11c3-6b2f-4e4d-bb2d-1990db166f4a admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:07.473401 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cd11c3-6b2f-4e4d-bb2d-1990db166f4a admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:07.478627 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514555a1-1964-4576-bedd-0cc0ab8d72fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:07.479414 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514555a1-1964-4576-bedd-0cc0ab8d72fc admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:07.479692 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514555a1-1964-4576-bedd-0cc0ab8d72fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:07.479968 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514555a1-1964-4576-bedd-0cc0ab8d72fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:07.480703 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514555a1-1964-4576-bedd-0cc0ab8d72fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:07.482331 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514555a1-1964-4576-bedd-0cc0ab8d72fc admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:07.484572 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:31:07.494518 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1061/2096] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:31:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:31:07.498864 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca67ae-56d4-4483-a47f-d6ed51fe24b7 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:07.511250 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca67ae-56d4-4483-a47f-d6ed51fe24b7 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:07.517074 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360d42be-f5f3-4624-b72d-059db269cd06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:07.517777 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d42be-f5f3-4624-b72d-059db269cd06 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:07.518082 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d42be-f5f3-4624-b72d-059db269cd06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:07.518358 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d42be-f5f3-4624-b72d-059db269cd06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:07.519169 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360d42be-f5f3-4624-b72d-059db269cd06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:07.521052 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360d42be-f5f3-4624-b72d-059db269cd06 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:07.536740 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1036/2097] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:31:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:31:07.536856 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514555a1-1964-4576-bedd-0cc0ab8d72fc admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:07.549282 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514555a1-1964-4576-bedd-0cc0ab8d72fc admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:07.554465 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a0849-4087-4c9b-86ee-9b64319be1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:07.555585 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a0849-4087-4c9b-86ee-9b64319be1e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:07.555847 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a0849-4087-4c9b-86ee-9b64319be1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:07.556117 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a0849-4087-4c9b-86ee-9b64319be1e5 admin admin] PATH_INFO: `/v3/projects/5c0462adc09d489ca2b9e816d1ce3c54/users/c42a4b22cda34bb68980388f63e822cb/roles/c43aada0326446c4ade0ab1262918fa4` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:07.580703 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01a0849-4087-4c9b-86ee-9b64319be1e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c0462adc09d489ca2b9e816d1ce3c54, user_id=c42a4b22cda34bb68980388f63e822cb, role_id=c43aada0326446c4ade0ab1262918fa4)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:07.586572 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01a0849-4087-4c9b-86ee-9b64319be1e5 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:07.615067 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1062/2098] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:31:07 2022] PUT /identity/v3/projects/5c0462adc09d489ca2b9e816d1ce3c54/users/c42a4b22cda34bb68980388f63e822cb/roles/c43aada0326446c4ade0ab1262918fa4 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 03:31:07.622060 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da9411-3a13-4ab2-9f70-02faf62554cd None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:07.622615 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da9411-3a13-4ab2-9f70-02faf62554cd None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:07.622715 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da9411-3a13-4ab2-9f70-02faf62554cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:07.645044 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-c7da9411-3a13-4ab2-9f70-02faf62554cd None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:31:07.646280 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c7da9411-3a13-4ab2-9f70-02faf62554cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:31:07.713716 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1037/2099] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:31:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:31:07.723504 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a0849-4087-4c9b-86ee-9b64319be1e5 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:07.725290 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-c01a0849-4087-4c9b-86ee-9b64319be1e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:31:07.785539 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a0849-4087-4c9b-86ee-9b64319be1e5 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:07.789269 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270d028-25f3-43b7-b970-dd484637f855 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:07.790023 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270d028-25f3-43b7-b970-dd484637f855 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:07.790298 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270d028-25f3-43b7-b970-dd484637f855 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:07.790569 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270d028-25f3-43b7-b970-dd484637f855 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:07.800738 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f270d028-25f3-43b7-b970-dd484637f855 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:07.802169 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f270d028-25f3-43b7-b970-dd484637f855 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:07.811896 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1063/2100] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:31:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:31:09.631384 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7da9411-3a13-4ab2-9f70-02faf62554cd None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:09.633488 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c7da9411-3a13-4ab2-9f70-02faf62554cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:31:09.748544 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7da9411-3a13-4ab2-9f70-02faf62554cd None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:09.752466 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac9d15-0a19-434f-badd-9d2582bac00a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:09.755181 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac9d15-0a19-434f-badd-9d2582bac00a service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:09.759240 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac9d15-0a19-434f-badd-9d2582bac00a service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:09.759240 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac9d15-0a19-434f-badd-9d2582bac00a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:09.759240 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-97ac9d15-0a19-434f-badd-9d2582bac00a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:31:09.899670 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ac9d15-0a19-434f-badd-9d2582bac00a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:09.901212 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ac9d15-0a19-434f-badd-9d2582bac00a service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:09.914487 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1038/2101] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:31:09 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:31:12.826388 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c1d0b-7dd9-4a41-9d3d-1d56ec280a9b None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:12.826909 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c1d0b-7dd9-4a41-9d3d-1d56ec280a9b None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:12.826985 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c1d0b-7dd9-4a41-9d3d-1d56ec280a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:12.857809 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-c39c1d0b-7dd9-4a41-9d3d-1d56ec280a9b None None] MFA Rules not processed for user `c42a4b22cda34bb68980388f63e822cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:31:12.859102 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-c39c1d0b-7dd9-4a41-9d3d-1d56ec280a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:31:12.927527 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1064/2102] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:31:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:31:12.942246 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac9d15-0a19-434f-badd-9d2582bac00a service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:12.943783 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-97ac9d15-0a19-434f-badd-9d2582bac00a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:31:12.966721 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:31:13.065907 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac9d15-0a19-434f-badd-9d2582bac00a service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:13.077365 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f2263-f2ff-4e9d-a8a0-79da5e37277c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13530240e2d446b6bf26a431d001362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:13.078306 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f2263-f2ff-4e9d-a8a0-79da5e37277c service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:13.078773 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f2263-f2ff-4e9d-a8a0-79da5e37277c service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:13.079294 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f2263-f2ff-4e9d-a8a0-79da5e37277c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:13.088852 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834f2263-f2ff-4e9d-a8a0-79da5e37277c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:13.090567 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834f2263-f2ff-4e9d-a8a0-79da5e37277c service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:13.104559 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1039/2103] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:31:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:31:15.055812 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b49e5-9d0f-465c-add5-da36f1a09544 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:15.056702 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b49e5-9d0f-465c-add5-da36f1a09544 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:15.057127 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b49e5-9d0f-465c-add5-da36f1a09544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:15.080730 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-305b49e5-9d0f-465c-add5-da36f1a09544 None None] MFA Rules not processed for user `c42a4b22cda34bb68980388f63e822cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:31:15.081974 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-305b49e5-9d0f-465c-add5-da36f1a09544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:31:15.105523 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1065/2104] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:31:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:31:15.418279 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f2263-f2ff-4e9d-a8a0-79da5e37277c service nova] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:15.420297 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-834f2263-f2ff-4e9d-a8a0-79da5e37277c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:31:15.445577 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f2263-f2ff-4e9d-a8a0-79da5e37277c service nova] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:15.459900 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7583b6dd-6a48-4969-b15b-ffc4dc10b875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:15.461362 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7583b6dd-6a48-4969-b15b-ffc4dc10b875 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:15.462566 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7583b6dd-6a48-4969-b15b-ffc4dc10b875 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:15.463958 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7583b6dd-6a48-4969-b15b-ffc4dc10b875 admin admin] PATH_INFO: `/v3/users/8a474d7a1e8c4dd280cc5529d3cb15ff` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:15.471981 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7583b6dd-6a48-4969-b15b-ffc4dc10b875 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a474d7a1e8c4dd280cc5529d3cb15ff)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:15.485473 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7583b6dd-6a48-4969-b15b-ffc4dc10b875 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:15.560744 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-7583b6dd-6a48-4969-b15b-ffc4dc10b875 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a474d7a1e8c4dd280cc5529d3cb15ff'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:15.564149 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-7583b6dd-6a48-4969-b15b-ffc4dc10b875 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a474d7a1e8c4dd280cc5529d3cb15ff'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:15.565099 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-7583b6dd-6a48-4969-b15b-ffc4dc10b875 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a474d7a1e8c4dd280cc5529d3cb15ff'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:15.580700 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-7583b6dd-6a48-4969-b15b-ffc4dc10b875 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a474d7a1e8c4dd280cc5529d3cb15ff'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:15.590157 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-7583b6dd-6a48-4969-b15b-ffc4dc10b875 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a474d7a1e8c4dd280cc5529d3cb15ff'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:15.607247 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1040/2105] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:31:15 2022] DELETE /identity/v3/users/8a474d7a1e8c4dd280cc5529d3cb15ff => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:31:15.612240 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ded23b-4d1f-49d3-a75a-d821fbfdc0c5 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:15.612873 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ded23b-4d1f-49d3-a75a-d821fbfdc0c5 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:15.613954 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ded23b-4d1f-49d3-a75a-d821fbfdc0c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:15.635175 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-f3ded23b-4d1f-49d3-a75a-d821fbfdc0c5 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:31:15.636500 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-f3ded23b-4d1f-49d3-a75a-d821fbfdc0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:31:15.704119 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:31:15.731157 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1066/2106] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:31:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:31:15.737254 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7583b6dd-6a48-4969-b15b-ffc4dc10b875 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:15.742079 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7583b6dd-6a48-4969-b15b-ffc4dc10b875 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:31:15.851993 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7583b6dd-6a48-4969-b15b-ffc4dc10b875 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:15.857092 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74292706-93ff-412f-90b2-16ba22688124 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:15.857826 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74292706-93ff-412f-90b2-16ba22688124 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:15.858090 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74292706-93ff-412f-90b2-16ba22688124 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:15.858368 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74292706-93ff-412f-90b2-16ba22688124 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:15.878835 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74292706-93ff-412f-90b2-16ba22688124 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:15.880805 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74292706-93ff-412f-90b2-16ba22688124 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:15.911750 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1041/2107] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:31:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:31:16.503229 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ded23b-4d1f-49d3-a75a-d821fbfdc0c5 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:16.507281 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-f3ded23b-4d1f-49d3-a75a-d821fbfdc0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:31:16.533596 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ded23b-4d1f-49d3-a75a-d821fbfdc0c5 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:16.541636 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbccd7d-989b-4555-b9d3-9740f09b4efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:16.542784 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbccd7d-989b-4555-b9d3-9740f09b4efc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:16.543289 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbccd7d-989b-4555-b9d3-9740f09b4efc admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:16.543708 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbccd7d-989b-4555-b9d3-9740f09b4efc admin admin] PATH_INFO: `/v3/projects/0ce02c424395486abd544101c88b3b4f` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:16.545363 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbccd7d-989b-4555-b9d3-9740f09b4efc admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ce02c424395486abd544101c88b3b4f)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:16.547539 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbccd7d-989b-4555-b9d3-9740f09b4efc admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:16.610642 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6cbccd7d-989b-4555-b9d3-9740f09b4efc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ce02c424395486abd544101c88b3b4f', 'request_id': 'req-6cbccd7d-989b-4555-b9d3-9740f09b4efc'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:16.620547 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6cbccd7d-989b-4555-b9d3-9740f09b4efc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ce02c424395486abd544101c88b3b4f', 'request_id': 'req-6cbccd7d-989b-4555-b9d3-9740f09b4efc'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:16.628831 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6cbccd7d-989b-4555-b9d3-9740f09b4efc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ce02c424395486abd544101c88b3b4f', 'request_id': 'req-6cbccd7d-989b-4555-b9d3-9740f09b4efc'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:16.653115 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6cbccd7d-989b-4555-b9d3-9740f09b4efc admin admin] The token cache is being invalidate because project 0ce02c424395486abd544101c88b3b4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:31:16.653777 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6cbccd7d-989b-4555-b9d3-9740f09b4efc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:16.654778 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6cbccd7d-989b-4555-b9d3-9740f09b4efc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:16.656899 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1067/2108] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:31:16 2022] DELETE /identity/v3/projects/0ce02c424395486abd544101c88b3b4f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:31:16.661869 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f17ba3-7a4f-4714-940a-e0278adee55f None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:16.663297 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f17ba3-7a4f-4714-940a-e0278adee55f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:16.663881 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f17ba3-7a4f-4714-940a-e0278adee55f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:16.690338 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-44f17ba3-7a4f-4714-940a-e0278adee55f None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:31:16.692872 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-44f17ba3-7a4f-4714-940a-e0278adee55f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:31:16.712334 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:31:16.818704 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1042/2109] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:31:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:31:16.820723 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af6338-d29c-4c59-b122-bed61f96e8b3 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:16.821102 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af6338-d29c-4c59-b122-bed61f96e8b3 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:16.821379 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af6338-d29c-4c59-b122-bed61f96e8b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:16.849703 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-88af6338-d29c-4c59-b122-bed61f96e8b3 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:31:16.851439 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-88af6338-d29c-4c59-b122-bed61f96e8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:31:16.865482 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1068/2110] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:31:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 03:31:16.870406 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f17ba3-7a4f-4714-940a-e0278adee55f None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:16.882103 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f17ba3-7a4f-4714-940a-e0278adee55f None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:16.887204 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b75e445-13bc-47d6-8cdc-24d4cfbc5dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:16.887986 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75e445-13bc-47d6-8cdc-24d4cfbc5dff admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:16.888354 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75e445-13bc-47d6-8cdc-24d4cfbc5dff admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:16.888737 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75e445-13bc-47d6-8cdc-24d4cfbc5dff admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:16.889559 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b75e445-13bc-47d6-8cdc-24d4cfbc5dff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:31:16.889978 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b75e445-13bc-47d6-8cdc-24d4cfbc5dff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:16.891699 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b75e445-13bc-47d6-8cdc-24d4cfbc5dff admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:16.928042 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88af6338-d29c-4c59-b122-bed61f96e8b3 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:16.930326 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1043/2111] 10.222.0.60 () {58 vars in 1152 bytes} [Sat Jul 2 03:31:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:31:16.938128 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88af6338-d29c-4c59-b122-bed61f96e8b3 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:16.943619 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa0a0f4-b3b2-409e-9a93-c2331729f0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:16.944448 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0a0f4-b3b2-409e-9a93-c2331729f0b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:16.944936 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0a0f4-b3b2-409e-9a93-c2331729f0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:16.945332 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0a0f4-b3b2-409e-9a93-c2331729f0b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:16.946269 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa0a0f4-b3b2-409e-9a93-c2331729f0b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:16.951510 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa0a0f4-b3b2-409e-9a93-c2331729f0b8 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:16.988192 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1069/2112] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:31:16 2022] POST /identity/v3/projects => generated 383 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:31:16.992315 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b75e445-13bc-47d6-8cdc-24d4cfbc5dff admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:17.003486 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b75e445-13bc-47d6-8cdc-24d4cfbc5dff admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:17.085265 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1f5002-4420-44a2-ad45-80d441d8de81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:17.086098 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f5002-4420-44a2-ad45-80d441d8de81 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:17.086373 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f5002-4420-44a2-ad45-80d441d8de81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:17.090233 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f5002-4420-44a2-ad45-80d441d8de81 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:17.091013 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1f5002-4420-44a2-ad45-80d441d8de81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:17.092995 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1f5002-4420-44a2-ad45-80d441d8de81 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:17.124125 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1044/2113] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:31:16 2022] POST /identity/v3/users => generated 292 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:31:17.126454 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa0a0f4-b3b2-409e-9a93-c2331729f0b8 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:17.142859 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa0a0f4-b3b2-409e-9a93-c2331729f0b8 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:17.147614 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407217d5-5ba4-4cb4-8acf-b9f459d77dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:17.148572 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407217d5-5ba4-4cb4-8acf-b9f459d77dad admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:17.148994 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407217d5-5ba4-4cb4-8acf-b9f459d77dad admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:17.149956 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407217d5-5ba4-4cb4-8acf-b9f459d77dad admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:17.151099 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407217d5-5ba4-4cb4-8acf-b9f459d77dad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:17.152972 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407217d5-5ba4-4cb4-8acf-b9f459d77dad admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:17.168993 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1070/2114] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:31:17 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:31:17.173475 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1f5002-4420-44a2-ad45-80d441d8de81 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:17.183568 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1f5002-4420-44a2-ad45-80d441d8de81 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:17.190896 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbc5ac1-e4f0-407b-9002-f8d61126fdb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:17.191661 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc5ac1-e4f0-407b-9002-f8d61126fdb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:17.192065 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc5ac1-e4f0-407b-9002-f8d61126fdb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:17.192335 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc5ac1-e4f0-407b-9002-f8d61126fdb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:17.193183 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbc5ac1-e4f0-407b-9002-f8d61126fdb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:17.194815 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbc5ac1-e4f0-407b-9002-f8d61126fdb6 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:17.206892 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1045/2115] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:31:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:31:17.211309 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407217d5-5ba4-4cb4-8acf-b9f459d77dad admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:17.221792 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407217d5-5ba4-4cb4-8acf-b9f459d77dad admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:17.230551 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656ec6b9-2624-4c04-883d-abf5ce0c2966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:17.231772 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ec6b9-2624-4c04-883d-abf5ce0c2966 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:17.232219 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ec6b9-2624-4c04-883d-abf5ce0c2966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:17.232634 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ec6b9-2624-4c04-883d-abf5ce0c2966 admin admin] PATH_INFO: `/v3/projects/4205b52c30f3484398dd4edd58f96508/users/7b0336a1ee514b63890167d1801cb410/roles/c43aada0326446c4ade0ab1262918fa4` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:17.250415 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656ec6b9-2624-4c04-883d-abf5ce0c2966 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4205b52c30f3484398dd4edd58f96508, user_id=7b0336a1ee514b63890167d1801cb410, role_id=c43aada0326446c4ade0ab1262918fa4)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:17.253267 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656ec6b9-2624-4c04-883d-abf5ce0c2966 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:17.275317 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1071/2116] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:31:17 2022] PUT /identity/v3/projects/4205b52c30f3484398dd4edd58f96508/users/7b0336a1ee514b63890167d1801cb410/roles/c43aada0326446c4ade0ab1262918fa4 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:31:17.280909 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c56c8-a6c5-4fc6-b974-e9363fae3e47 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:17.281347 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c56c8-a6c5-4fc6-b974-e9363fae3e47 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:17.281766 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c56c8-a6c5-4fc6-b974-e9363fae3e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:17.304799 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-976c56c8-a6c5-4fc6-b974-e9363fae3e47 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:31:17.306561 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-976c56c8-a6c5-4fc6-b974-e9363fae3e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:31:17.396287 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1046/2117] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:31:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:31:17.405254 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656ec6b9-2624-4c04-883d-abf5ce0c2966 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:17.407622 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-656ec6b9-2624-4c04-883d-abf5ce0c2966 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:31:17.476887 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656ec6b9-2624-4c04-883d-abf5ce0c2966 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:17.481179 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e74d4e-ba67-4fc5-b674-9f2713e04b0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:17.481844 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e74d4e-ba67-4fc5-b674-9f2713e04b0d service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:17.482119 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e74d4e-ba67-4fc5-b674-9f2713e04b0d service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:17.482385 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e74d4e-ba67-4fc5-b674-9f2713e04b0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:17.493674 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e74d4e-ba67-4fc5-b674-9f2713e04b0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:17.495207 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e74d4e-ba67-4fc5-b674-9f2713e04b0d service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:17.506965 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1072/2118] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:31:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:31:18.327677 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531cc6da-c67c-4f49-8f54-509d9b108d17 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:18.328243 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531cc6da-c67c-4f49-8f54-509d9b108d17 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:18.328919 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531cc6da-c67c-4f49-8f54-509d9b108d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:18.377516 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-531cc6da-c67c-4f49-8f54-509d9b108d17 None None] MFA Rules not processed for user `7b0336a1ee514b63890167d1801cb410`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:31:18.387489 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-531cc6da-c67c-4f49-8f54-509d9b108d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:31:18.401254 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:31:18.471266 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1047/2119] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:31:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:31:18.483702 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e74d4e-ba67-4fc5-b674-9f2713e04b0d service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:18.485309 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-b8e74d4e-ba67-4fc5-b674-9f2713e04b0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:31:18.519297 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:31:18.568846 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e74d4e-ba67-4fc5-b674-9f2713e04b0d service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:18.580615 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e3a316-3383-47f2-8b5f-0bffd846451c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:18.581291 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3a316-3383-47f2-8b5f-0bffd846451c service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:18.581750 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3a316-3383-47f2-8b5f-0bffd846451c service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:18.582031 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3a316-3383-47f2-8b5f-0bffd846451c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:18.597958 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e3a316-3383-47f2-8b5f-0bffd846451c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:18.600041 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e3a316-3383-47f2-8b5f-0bffd846451c service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:18.615009 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1073/2120] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:31:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:31:20.073252 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b4ef99-ea8c-4ae9-b95b-4bc1b4588be7 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:20.073832 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b4ef99-ea8c-4ae9-b95b-4bc1b4588be7 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:20.073832 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b4ef99-ea8c-4ae9-b95b-4bc1b4588be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:20.106304 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-90b4ef99-ea8c-4ae9-b95b-4bc1b4588be7 None None] MFA Rules not processed for user `7b0336a1ee514b63890167d1801cb410`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:31:20.107696 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-90b4ef99-ea8c-4ae9-b95b-4bc1b4588be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:31:20.126575 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1048/2121] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:31:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:31:21.610619 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e3a316-3383-47f2-8b5f-0bffd846451c service cinder] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:21.612301 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-b1e3a316-3383-47f2-8b5f-0bffd846451c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:31:21.626907 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e3a316-3383-47f2-8b5f-0bffd846451c service cinder] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:21.631885 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee29fc1b-805c-4b24-bf53-5e967c63e9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:21.632742 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29fc1b-805c-4b24-bf53-5e967c63e9aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:21.633018 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29fc1b-805c-4b24-bf53-5e967c63e9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:21.633289 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29fc1b-805c-4b24-bf53-5e967c63e9aa admin admin] PATH_INFO: `/v3/users/f8792d18a330488d98b401ca11456447` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:21.634499 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee29fc1b-805c-4b24-bf53-5e967c63e9aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8792d18a330488d98b401ca11456447)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:21.636458 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee29fc1b-805c-4b24-bf53-5e967c63e9aa admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:21.684864 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-ee29fc1b-805c-4b24-bf53-5e967c63e9aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8792d18a330488d98b401ca11456447'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:21.685538 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-ee29fc1b-805c-4b24-bf53-5e967c63e9aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8792d18a330488d98b401ca11456447'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:21.693874 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-ee29fc1b-805c-4b24-bf53-5e967c63e9aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8792d18a330488d98b401ca11456447'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:21.694571 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-ee29fc1b-805c-4b24-bf53-5e967c63e9aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8792d18a330488d98b401ca11456447'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:21.708088 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-ee29fc1b-805c-4b24-bf53-5e967c63e9aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8792d18a330488d98b401ca11456447'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:21.722175 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1074/2122] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:31:21 2022] DELETE /identity/v3/users/f8792d18a330488d98b401ca11456447 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:31:21.727020 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee99f52-5304-429b-a7ab-2f3ae5199a66 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:21.727621 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee99f52-5304-429b-a7ab-2f3ae5199a66 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:21.727621 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee99f52-5304-429b-a7ab-2f3ae5199a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:21.746903 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-cee99f52-5304-429b-a7ab-2f3ae5199a66 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:31:21.748151 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-cee99f52-5304-429b-a7ab-2f3ae5199a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:31:21.810601 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1049/2123] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:31:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 03:31:21.820536 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee29fc1b-805c-4b24-bf53-5e967c63e9aa admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:21.822012 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-ee29fc1b-805c-4b24-bf53-5e967c63e9aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:31:21.883624 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee29fc1b-805c-4b24-bf53-5e967c63e9aa admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:21.887435 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40e9460-6378-4667-ad8a-c94db7835df8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:21.888091 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e9460-6378-4667-ad8a-c94db7835df8 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:21.888385 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e9460-6378-4667-ad8a-c94db7835df8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:21.888689 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e9460-6378-4667-ad8a-c94db7835df8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:21.898217 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40e9460-6378-4667-ad8a-c94db7835df8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:21.899698 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40e9460-6378-4667-ad8a-c94db7835df8 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:21.909530 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1075/2124] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:31:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 03:31:22.197141 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee99f52-5304-429b-a7ab-2f3ae5199a66 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:22.198620 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-cee99f52-5304-429b-a7ab-2f3ae5199a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:31:22.214036 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee99f52-5304-429b-a7ab-2f3ae5199a66 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:22.219822 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b4ba4b-bf58-4aee-b0e4-38197c292516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:22.220812 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b4ba4b-bf58-4aee-b0e4-38197c292516 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:22.221123 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b4ba4b-bf58-4aee-b0e4-38197c292516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:22.221368 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b4ba4b-bf58-4aee-b0e4-38197c292516 admin admin] PATH_INFO: `/v3/projects/89665522f57242dca2be4f84bf51538a` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:22.222789 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b4ba4b-bf58-4aee-b0e4-38197c292516 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89665522f57242dca2be4f84bf51538a)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:22.224865 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b4ba4b-bf58-4aee-b0e4-38197c292516 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:22.275869 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-37b4ba4b-bf58-4aee-b0e4-38197c292516 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89665522f57242dca2be4f84bf51538a', 'request_id': 'req-37b4ba4b-bf58-4aee-b0e4-38197c292516'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:22.281389 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-37b4ba4b-bf58-4aee-b0e4-38197c292516 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89665522f57242dca2be4f84bf51538a', 'request_id': 'req-37b4ba4b-bf58-4aee-b0e4-38197c292516'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:22.290914 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-37b4ba4b-bf58-4aee-b0e4-38197c292516 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89665522f57242dca2be4f84bf51538a', 'request_id': 'req-37b4ba4b-bf58-4aee-b0e4-38197c292516'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:22.307512 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-37b4ba4b-bf58-4aee-b0e4-38197c292516 admin admin] The token cache is being invalidate because project 89665522f57242dca2be4f84bf51538a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:31:22.307814 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-37b4ba4b-bf58-4aee-b0e4-38197c292516 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:22.308766 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-37b4ba4b-bf58-4aee-b0e4-38197c292516 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:22.310420 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1050/2125] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:31:22 2022] DELETE /identity/v3/projects/89665522f57242dca2be4f84bf51538a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:31:22.315896 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c151f-3067-48c2-ad3a-bb67aa03782e None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:22.316178 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c151f-3067-48c2-ad3a-bb67aa03782e None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:22.316451 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c151f-3067-48c2-ad3a-bb67aa03782e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:22.334744 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-ea4c151f-3067-48c2-ad3a-bb67aa03782e None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:31:22.336186 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-ea4c151f-3067-48c2-ad3a-bb67aa03782e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:31:22.388555 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:31:22.418509 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1076/2126] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:31:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:31:22.426532 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f8f9c-9ebd-44df-8ac1-bb1afcf9a1b3 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:22.426811 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f8f9c-9ebd-44df-8ac1-bb1afcf9a1b3 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:22.427103 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f8f9c-9ebd-44df-8ac1-bb1afcf9a1b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:22.447032 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-2d9f8f9c-9ebd-44df-8ac1-bb1afcf9a1b3 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:31:22.448261 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2d9f8f9c-9ebd-44df-8ac1-bb1afcf9a1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:31:22.457818 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1051/2127] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:31:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:31:22.462044 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c151f-3067-48c2-ad3a-bb67aa03782e None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:22.472103 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c151f-3067-48c2-ad3a-bb67aa03782e None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:22.477575 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51eeb27-f189-43a6-896a-cc78f8f302f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:22.478330 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51eeb27-f189-43a6-896a-cc78f8f302f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:22.478674 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51eeb27-f189-43a6-896a-cc78f8f302f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:22.479019 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51eeb27-f189-43a6-896a-cc78f8f302f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:22.480117 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51eeb27-f189-43a6-896a-cc78f8f302f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:31:22.480425 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51eeb27-f189-43a6-896a-cc78f8f302f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:22.482367 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51eeb27-f189-43a6-896a-cc78f8f302f5 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:22.500754 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f8f9c-9ebd-44df-8ac1-bb1afcf9a1b3 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:22.507353 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1077/2128] 10.222.0.60 () {58 vars in 1152 bytes} [Sat Jul 2 03:31:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:31:22.510907 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f8f9c-9ebd-44df-8ac1-bb1afcf9a1b3 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:22.515843 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b35ad51-36eb-4d21-94e1-b744226f0321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:22.516709 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35ad51-36eb-4d21-94e1-b744226f0321 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:22.517111 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35ad51-36eb-4d21-94e1-b744226f0321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:22.517490 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35ad51-36eb-4d21-94e1-b744226f0321 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:22.518282 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b35ad51-36eb-4d21-94e1-b744226f0321 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:22.520432 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b35ad51-36eb-4d21-94e1-b744226f0321 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:22.543160 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:31:22.556962 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1052/2129] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:31:22 2022] POST /identity/v3/projects => generated 365 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 03:31:22.559761 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51eeb27-f189-43a6-896a-cc78f8f302f5 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:22.571983 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51eeb27-f189-43a6-896a-cc78f8f302f5 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:22.638112 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81637bec-cc14-44cf-bdef-b9565a59848d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:22.638791 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81637bec-cc14-44cf-bdef-b9565a59848d admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:22.639069 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81637bec-cc14-44cf-bdef-b9565a59848d admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:22.639378 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81637bec-cc14-44cf-bdef-b9565a59848d admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:22.640078 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81637bec-cc14-44cf-bdef-b9565a59848d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:22.642001 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81637bec-cc14-44cf-bdef-b9565a59848d admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:22.666035 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1078/2130] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:31:22 2022] POST /identity/v3/users => generated 283 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:31:22.673530 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b35ad51-36eb-4d21-94e1-b744226f0321 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:22.684880 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b35ad51-36eb-4d21-94e1-b744226f0321 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:22.690960 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2405cb-2514-493b-98f9-cc8c50e8a4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:22.691687 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2405cb-2514-493b-98f9-cc8c50e8a4c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:22.691962 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2405cb-2514-493b-98f9-cc8c50e8a4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:22.692233 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2405cb-2514-493b-98f9-cc8c50e8a4c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:22.692964 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2405cb-2514-493b-98f9-cc8c50e8a4c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:22.694572 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2405cb-2514-493b-98f9-cc8c50e8a4c6 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:22.720712 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1053/2131] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:31:22.724985 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81637bec-cc14-44cf-bdef-b9565a59848d admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:22.735815 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81637bec-cc14-44cf-bdef-b9565a59848d admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:22.740951 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abfca69-79d0-421e-9fbd-da8f262bf97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:22.741694 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abfca69-79d0-421e-9fbd-da8f262bf97f admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:22.742067 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abfca69-79d0-421e-9fbd-da8f262bf97f admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:22.742436 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abfca69-79d0-421e-9fbd-da8f262bf97f admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:22.743347 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abfca69-79d0-421e-9fbd-da8f262bf97f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:22.745035 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abfca69-79d0-421e-9fbd-da8f262bf97f admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:22.760902 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1079/2132] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:31:22.765236 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2405cb-2514-493b-98f9-cc8c50e8a4c6 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:22.776917 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2405cb-2514-493b-98f9-cc8c50e8a4c6 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:22.781688 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08717fae-59ec-4dec-b3d9-6b7a5b70deaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:22.782593 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08717fae-59ec-4dec-b3d9-6b7a5b70deaf admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:22.783067 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08717fae-59ec-4dec-b3d9-6b7a5b70deaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:22.783395 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08717fae-59ec-4dec-b3d9-6b7a5b70deaf admin admin] PATH_INFO: `/v3/projects/494081725f8f429eae68d597cd34126e/users/c7696781261b4929824d11956a00c01d/roles/c43aada0326446c4ade0ab1262918fa4` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:22.802821 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08717fae-59ec-4dec-b3d9-6b7a5b70deaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=494081725f8f429eae68d597cd34126e, user_id=c7696781261b4929824d11956a00c01d, role_id=c43aada0326446c4ade0ab1262918fa4)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:22.805652 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08717fae-59ec-4dec-b3d9-6b7a5b70deaf admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:22.821685 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1054/2133] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:31:22 2022] PUT /identity/v3/projects/494081725f8f429eae68d597cd34126e/users/c7696781261b4929824d11956a00c01d/roles/c43aada0326446c4ade0ab1262918fa4 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 03:31:22.833686 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70a8ce-8835-4e58-8cf0-87afaced26e5 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:22.833971 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70a8ce-8835-4e58-8cf0-87afaced26e5 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:22.834247 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70a8ce-8835-4e58-8cf0-87afaced26e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:22.861170 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-2a70a8ce-8835-4e58-8cf0-87afaced26e5 None None] MFA Rules not processed for user `c7696781261b4929824d11956a00c01d`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:31:22.862465 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-2a70a8ce-8835-4e58-8cf0-87afaced26e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:31:22.944444 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1080/2134] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:31:22 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:31:22.955501 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08717fae-59ec-4dec-b3d9-6b7a5b70deaf admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:22.957383 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-08717fae-59ec-4dec-b3d9-6b7a5b70deaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:31:23.015577 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08717fae-59ec-4dec-b3d9-6b7a5b70deaf admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:23.020065 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca64c8e-ac77-45b1-98d4-fe53a74fe2ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:23.020816 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca64c8e-ac77-45b1-98d4-fe53a74fe2ba service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:23.021096 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca64c8e-ac77-45b1-98d4-fe53a74fe2ba service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:23.021367 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca64c8e-ac77-45b1-98d4-fe53a74fe2ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:23.030570 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca64c8e-ac77-45b1-98d4-fe53a74fe2ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:23.032034 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca64c8e-ac77-45b1-98d4-fe53a74fe2ba service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:23.042821 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1055/2135] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:31:22 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:31:32.940940 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=81,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:31:33.037537 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=41,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:31:34.557601 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a70a8ce-8835-4e58-8cf0-87afaced26e5 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:34.559902 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-2a70a8ce-8835-4e58-8cf0-87afaced26e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:31:34.641628 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a70a8ce-8835-4e58-8cf0-87afaced26e5 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:34.652287 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee762525-941e-4ddc-b3b0-857c3401d6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:34.653215 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee762525-941e-4ddc-b3b0-857c3401d6fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:34.653516 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee762525-941e-4ddc-b3b0-857c3401d6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:34.653794 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee762525-941e-4ddc-b3b0-857c3401d6fb admin admin] PATH_INFO: `/v3/users/7d13955bcc234bedb4a991d5f81efdf9` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:34.656095 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee762525-941e-4ddc-b3b0-857c3401d6fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d13955bcc234bedb4a991d5f81efdf9)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:34.658093 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee762525-941e-4ddc-b3b0-857c3401d6fb admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:34.714973 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-ee762525-941e-4ddc-b3b0-857c3401d6fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d13955bcc234bedb4a991d5f81efdf9'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:34.716502 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-ee762525-941e-4ddc-b3b0-857c3401d6fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d13955bcc234bedb4a991d5f81efdf9'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:34.725678 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-ee762525-941e-4ddc-b3b0-857c3401d6fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d13955bcc234bedb4a991d5f81efdf9'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:34.726326 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-ee762525-941e-4ddc-b3b0-857c3401d6fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d13955bcc234bedb4a991d5f81efdf9'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:34.739965 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-ee762525-941e-4ddc-b3b0-857c3401d6fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d13955bcc234bedb4a991d5f81efdf9'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:34.755752 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1081/2136] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:31:34 2022] DELETE /identity/v3/users/7d13955bcc234bedb4a991d5f81efdf9 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:31:34.940927 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca64c8e-ac77-45b1-98d4-fe53a74fe2ba service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:34.967745 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca64c8e-ac77-45b1-98d4-fe53a74fe2ba service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:35.026176 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b6c7c5-b800-4454-9fd1-5cf6b57b8cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:35.027057 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6c7c5-b800-4454-9fd1-5cf6b57b8cc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:35.027360 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6c7c5-b800-4454-9fd1-5cf6b57b8cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:35.027641 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6c7c5-b800-4454-9fd1-5cf6b57b8cc6 admin admin] PATH_INFO: `/v3/projects/7657296bbf764ac4a92e570b02589973` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:35.028880 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b6c7c5-b800-4454-9fd1-5cf6b57b8cc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7657296bbf764ac4a92e570b02589973)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:35.030818 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b6c7c5-b800-4454-9fd1-5cf6b57b8cc6 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:35.085547 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-06b6c7c5-b800-4454-9fd1-5cf6b57b8cc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7657296bbf764ac4a92e570b02589973', 'request_id': 'req-06b6c7c5-b800-4454-9fd1-5cf6b57b8cc6'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:35.103190 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-06b6c7c5-b800-4454-9fd1-5cf6b57b8cc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7657296bbf764ac4a92e570b02589973', 'request_id': 'req-06b6c7c5-b800-4454-9fd1-5cf6b57b8cc6'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:35.115824 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-06b6c7c5-b800-4454-9fd1-5cf6b57b8cc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7657296bbf764ac4a92e570b02589973', 'request_id': 'req-06b6c7c5-b800-4454-9fd1-5cf6b57b8cc6'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:35.128110 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-06b6c7c5-b800-4454-9fd1-5cf6b57b8cc6 admin admin] The token cache is being invalidate because project 7657296bbf764ac4a92e570b02589973 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:31:35.128402 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-06b6c7c5-b800-4454-9fd1-5cf6b57b8cc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:35.129266 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-06b6c7c5-b800-4454-9fd1-5cf6b57b8cc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:35.130892 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1056/2137] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:31:34 2022] DELETE /identity/v3/projects/7657296bbf764ac4a92e570b02589973 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:31:35.134944 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee762525-941e-4ddc-b3b0-857c3401d6fb admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:35.136458 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-ee762525-941e-4ddc-b3b0-857c3401d6fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:31:35.152187 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee762525-941e-4ddc-b3b0-857c3401d6fb admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:35.239305 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a7714a-3823-4def-a348-a62e5637d61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:35.240282 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7714a-3823-4def-a348-a62e5637d61b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:35.240578 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7714a-3823-4def-a348-a62e5637d61b admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:35.240853 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7714a-3823-4def-a348-a62e5637d61b admin admin] PATH_INFO: `/v3/users/ce6323c35a5d4b1da6e074381c77b677` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:35.242233 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a7714a-3823-4def-a348-a62e5637d61b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce6323c35a5d4b1da6e074381c77b677)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:35.244464 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a7714a-3823-4def-a348-a62e5637d61b admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:35.267865 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:31:35.295581 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-a8a7714a-3823-4def-a348-a62e5637d61b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce6323c35a5d4b1da6e074381c77b677'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:35.296254 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-a8a7714a-3823-4def-a348-a62e5637d61b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce6323c35a5d4b1da6e074381c77b677'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:35.304792 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-a8a7714a-3823-4def-a348-a62e5637d61b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce6323c35a5d4b1da6e074381c77b677'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:35.305761 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-a8a7714a-3823-4def-a348-a62e5637d61b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce6323c35a5d4b1da6e074381c77b677'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:35.319755 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-a8a7714a-3823-4def-a348-a62e5637d61b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce6323c35a5d4b1da6e074381c77b677'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:35.339527 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1082/2138] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:31:35 2022] DELETE /identity/v3/users/ce6323c35a5d4b1da6e074381c77b677 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 03:31:35.529555 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b6c7c5-b800-4454-9fd1-5cf6b57b8cc6 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:35.531611 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-06b6c7c5-b800-4454-9fd1-5cf6b57b8cc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:31:35.560795 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b6c7c5-b800-4454-9fd1-5cf6b57b8cc6 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:35.633153 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16dbaed-4bf7-47d5-b39e-d4f5a499a8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:35.634330 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16dbaed-4bf7-47d5-b39e-d4f5a499a8f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:35.634677 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16dbaed-4bf7-47d5-b39e-d4f5a499a8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:35.635542 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16dbaed-4bf7-47d5-b39e-d4f5a499a8f9 admin admin] PATH_INFO: `/v3/projects/79d46c14a2554ed8b775e3c147563420` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:35.636562 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16dbaed-4bf7-47d5-b39e-d4f5a499a8f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79d46c14a2554ed8b775e3c147563420)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:35.638785 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16dbaed-4bf7-47d5-b39e-d4f5a499a8f9 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:35.682295 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:31:35.698176 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-c16dbaed-4bf7-47d5-b39e-d4f5a499a8f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79d46c14a2554ed8b775e3c147563420', 'request_id': 'req-c16dbaed-4bf7-47d5-b39e-d4f5a499a8f9'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:35.703788 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-c16dbaed-4bf7-47d5-b39e-d4f5a499a8f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79d46c14a2554ed8b775e3c147563420', 'request_id': 'req-c16dbaed-4bf7-47d5-b39e-d4f5a499a8f9'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:35.712359 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-c16dbaed-4bf7-47d5-b39e-d4f5a499a8f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79d46c14a2554ed8b775e3c147563420', 'request_id': 'req-c16dbaed-4bf7-47d5-b39e-d4f5a499a8f9'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:35.723817 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-c16dbaed-4bf7-47d5-b39e-d4f5a499a8f9 admin admin] The token cache is being invalidate because project 79d46c14a2554ed8b775e3c147563420 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:31:35.724156 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-c16dbaed-4bf7-47d5-b39e-d4f5a499a8f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:35.724819 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-c16dbaed-4bf7-47d5-b39e-d4f5a499a8f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:35.726439 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1057/2139] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:31:35 2022] DELETE /identity/v3/projects/79d46c14a2554ed8b775e3c147563420 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:31:35.731660 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec4cc2-fb19-4336-a169-e30ec65d1abf None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:35.732134 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec4cc2-fb19-4336-a169-e30ec65d1abf None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:35.732341 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec4cc2-fb19-4336-a169-e30ec65d1abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:35.750910 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-22ec4cc2-fb19-4336-a169-e30ec65d1abf None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:31:35.752182 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-22ec4cc2-fb19-4336-a169-e30ec65d1abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:31:35.814011 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1083/2140] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:31:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:31:35.822577 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d6bec-c98a-4d31-9d08-4a8fd7c8c472 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:35.822868 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d6bec-c98a-4d31-9d08-4a8fd7c8c472 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:35.823139 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d6bec-c98a-4d31-9d08-4a8fd7c8c472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:35.841874 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-bb3d6bec-c98a-4d31-9d08-4a8fd7c8c472 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:31:35.843101 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-bb3d6bec-c98a-4d31-9d08-4a8fd7c8c472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:31:35.851245 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1058/2141] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:31:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:31:35.856383 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ec4cc2-fb19-4336-a169-e30ec65d1abf None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:35.867783 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ec4cc2-fb19-4336-a169-e30ec65d1abf None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:35.873839 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bd7529-66ec-4110-90da-7156cc05274c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:35.874497 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd7529-66ec-4110-90da-7156cc05274c admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:35.874777 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd7529-66ec-4110-90da-7156cc05274c admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:35.875044 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd7529-66ec-4110-90da-7156cc05274c admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:35.876324 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bd7529-66ec-4110-90da-7156cc05274c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:31:35.876634 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bd7529-66ec-4110-90da-7156cc05274c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:35.878258 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bd7529-66ec-4110-90da-7156cc05274c admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:35.892218 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1084/2142] 10.222.0.60 () {58 vars in 1152 bytes} [Sat Jul 2 03:31:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:31:35.896535 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d6bec-c98a-4d31-9d08-4a8fd7c8c472 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:35.910005 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d6bec-c98a-4d31-9d08-4a8fd7c8c472 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:35.922165 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95031a30-9a2d-4574-a83b-768da4868d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:35.923309 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95031a30-9a2d-4574-a83b-768da4868d33 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:35.923796 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95031a30-9a2d-4574-a83b-768da4868d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:35.924423 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95031a30-9a2d-4574-a83b-768da4868d33 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:35.925318 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95031a30-9a2d-4574-a83b-768da4868d33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:35.927594 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95031a30-9a2d-4574-a83b-768da4868d33 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:35.963451 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1059/2143] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:31:35 2022] POST /identity/v3/projects => generated 383 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:31:35.967490 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bd7529-66ec-4110-90da-7156cc05274c admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:35.985694 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bd7529-66ec-4110-90da-7156cc05274c admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:36.056087 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33713ab-097a-4ad8-9455-947bb30b76cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:36.056827 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33713ab-097a-4ad8-9455-947bb30b76cf admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:36.057166 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33713ab-097a-4ad8-9455-947bb30b76cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:36.057504 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33713ab-097a-4ad8-9455-947bb30b76cf admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:36.058266 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33713ab-097a-4ad8-9455-947bb30b76cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:36.060412 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33713ab-097a-4ad8-9455-947bb30b76cf admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:36.088117 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1085/2144] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:31:35 2022] POST /identity/v3/users => generated 292 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:31:36.089975 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95031a30-9a2d-4574-a83b-768da4868d33 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:36.102790 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95031a30-9a2d-4574-a83b-768da4868d33 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:36.109711 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b92f3-8c20-4079-956b-32fd8c40ae32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:36.110434 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b92f3-8c20-4079-956b-32fd8c40ae32 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:36.110778 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b92f3-8c20-4079-956b-32fd8c40ae32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:36.111847 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b92f3-8c20-4079-956b-32fd8c40ae32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:36.112684 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97b92f3-8c20-4079-956b-32fd8c40ae32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:36.114898 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97b92f3-8c20-4079-956b-32fd8c40ae32 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:36.130237 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1060/2145] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:31:36 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:31:36.135909 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33713ab-097a-4ad8-9455-947bb30b76cf admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:36.163234 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33713ab-097a-4ad8-9455-947bb30b76cf admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:36.168378 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7382945c-c308-4c01-b301-4a23229208d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:36.169044 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382945c-c308-4c01-b301-4a23229208d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:36.169328 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382945c-c308-4c01-b301-4a23229208d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:36.169599 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382945c-c308-4c01-b301-4a23229208d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:36.170363 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7382945c-c308-4c01-b301-4a23229208d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:36.172040 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7382945c-c308-4c01-b301-4a23229208d8 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:36.183715 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1086/2146] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:31:36 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:31:36.188480 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b92f3-8c20-4079-956b-32fd8c40ae32 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:36.198581 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b92f3-8c20-4079-956b-32fd8c40ae32 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:36.203270 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e3d8c2-c27c-4d44-b53e-7ce09d0153db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:36.204179 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3d8c2-c27c-4d44-b53e-7ce09d0153db admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:36.204480 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3d8c2-c27c-4d44-b53e-7ce09d0153db admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:36.204759 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3d8c2-c27c-4d44-b53e-7ce09d0153db admin admin] PATH_INFO: `/v3/projects/aab4c616a2204ff88af6ce826b6ccb6d/users/f4f026998b1844d0aeae1090af6529a7/roles/c43aada0326446c4ade0ab1262918fa4` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:36.220191 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e3d8c2-c27c-4d44-b53e-7ce09d0153db admin admin] RBAC: Authorizing `identity:create_grant(project_id=aab4c616a2204ff88af6ce826b6ccb6d, user_id=f4f026998b1844d0aeae1090af6529a7, role_id=c43aada0326446c4ade0ab1262918fa4)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:36.223061 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e3d8c2-c27c-4d44-b53e-7ce09d0153db admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:36.236721 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1061/2147] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:31:36 2022] PUT /identity/v3/projects/aab4c616a2204ff88af6ce826b6ccb6d/users/f4f026998b1844d0aeae1090af6529a7/roles/c43aada0326446c4ade0ab1262918fa4 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 03:31:36.246832 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f683f1-f6fa-4bc8-8950-fe8c7bef72b3 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:36.247257 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f683f1-f6fa-4bc8-8950-fe8c7bef72b3 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:36.247629 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f683f1-f6fa-4bc8-8950-fe8c7bef72b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:36.257081 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:31:36.304278 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-96f683f1-f6fa-4bc8-8950-fe8c7bef72b3 None None] MFA Rules not processed for user `f4f026998b1844d0aeae1090af6529a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:31:36.305521 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-96f683f1-f6fa-4bc8-8950-fe8c7bef72b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:31:36.406555 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1087/2148] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:31:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:31:36.417352 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e3d8c2-c27c-4d44-b53e-7ce09d0153db admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:36.419448 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f4e3d8c2-c27c-4d44-b53e-7ce09d0153db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:31:36.492504 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e3d8c2-c27c-4d44-b53e-7ce09d0153db admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:36.496585 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d15297-6c86-402d-ab15-1e7510d7e196 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:36.497425 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d15297-6c86-402d-ab15-1e7510d7e196 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:36.497980 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d15297-6c86-402d-ab15-1e7510d7e196 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:36.498507 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d15297-6c86-402d-ab15-1e7510d7e196 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:36.511107 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d15297-6c86-402d-ab15-1e7510d7e196 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:36.512723 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d15297-6c86-402d-ab15-1e7510d7e196 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:36.524675 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1062/2149] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:31:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:31:39.110702 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f683f1-f6fa-4bc8-8950-fe8c7bef72b3 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:39.112200 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-96f683f1-f6fa-4bc8-8950-fe8c7bef72b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:31:39.182786 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f683f1-f6fa-4bc8-8950-fe8c7bef72b3 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:39.188500 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff37c3a-75c1-44b4-917f-e4c515105482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:39.189627 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff37c3a-75c1-44b4-917f-e4c515105482 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:39.190003 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff37c3a-75c1-44b4-917f-e4c515105482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:39.190292 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff37c3a-75c1-44b4-917f-e4c515105482 admin admin] PATH_INFO: `/v3/users/806d54f336ea437ea6fd78172085ee5a` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:39.191875 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff37c3a-75c1-44b4-917f-e4c515105482 admin admin] RBAC: Authorizing `identity:delete_user(user_id=806d54f336ea437ea6fd78172085ee5a)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:39.194246 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff37c3a-75c1-44b4-917f-e4c515105482 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:39.255063 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-7ff37c3a-75c1-44b4-917f-e4c515105482 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '806d54f336ea437ea6fd78172085ee5a'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:39.255913 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-7ff37c3a-75c1-44b4-917f-e4c515105482 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '806d54f336ea437ea6fd78172085ee5a'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:39.268416 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-7ff37c3a-75c1-44b4-917f-e4c515105482 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '806d54f336ea437ea6fd78172085ee5a'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:39.269531 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-7ff37c3a-75c1-44b4-917f-e4c515105482 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '806d54f336ea437ea6fd78172085ee5a'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:39.301719 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-7ff37c3a-75c1-44b4-917f-e4c515105482 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '806d54f336ea437ea6fd78172085ee5a'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:39.320716 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1088/2150] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:31:39 2022] DELETE /identity/v3/users/806d54f336ea437ea6fd78172085ee5a => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:31:39.324579 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23200a-6e97-47fd-9ce0-68fee50bf51b None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:39.324579 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23200a-6e97-47fd-9ce0-68fee50bf51b None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:39.324579 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23200a-6e97-47fd-9ce0-68fee50bf51b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:39.349121 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-7c23200a-6e97-47fd-9ce0-68fee50bf51b None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:31:39.350348 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7c23200a-6e97-47fd-9ce0-68fee50bf51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:31:39.434506 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:31:39.444864 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1063/2151] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:31:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 03:31:39.455571 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff37c3a-75c1-44b4-917f-e4c515105482 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:39.457155 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-7ff37c3a-75c1-44b4-917f-e4c515105482 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:31:39.474939 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:31:39.557886 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff37c3a-75c1-44b4-917f-e4c515105482 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:39.564378 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bf179b-9738-4776-bc96-3dc995140706 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:39.565072 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf179b-9738-4776-bc96-3dc995140706 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:39.565400 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf179b-9738-4776-bc96-3dc995140706 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:39.565683 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf179b-9738-4776-bc96-3dc995140706 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:39.576820 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bf179b-9738-4776-bc96-3dc995140706 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:39.578305 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bf179b-9738-4776-bc96-3dc995140706 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:39.604689 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1089/2152] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:31:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 03:31:40.055419 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c23200a-6e97-47fd-9ce0-68fee50bf51b None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:40.057438 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7c23200a-6e97-47fd-9ce0-68fee50bf51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:31:40.097230 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c23200a-6e97-47fd-9ce0-68fee50bf51b None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:40.109742 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d28cf4-8a3e-49a1-ad15-39fc7829b3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:40.110623 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d28cf4-8a3e-49a1-ad15-39fc7829b3ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:40.110903 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d28cf4-8a3e-49a1-ad15-39fc7829b3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:40.111213 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d28cf4-8a3e-49a1-ad15-39fc7829b3ae admin admin] PATH_INFO: `/v3/projects/7d1d4a2ee0c74db9b6d02520da2ae917` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:40.112401 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d28cf4-8a3e-49a1-ad15-39fc7829b3ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d1d4a2ee0c74db9b6d02520da2ae917)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:40.114357 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d28cf4-8a3e-49a1-ad15-39fc7829b3ae admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:40.162075 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-46d28cf4-8a3e-49a1-ad15-39fc7829b3ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d1d4a2ee0c74db9b6d02520da2ae917', 'request_id': 'req-46d28cf4-8a3e-49a1-ad15-39fc7829b3ae'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:40.169885 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-46d28cf4-8a3e-49a1-ad15-39fc7829b3ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d1d4a2ee0c74db9b6d02520da2ae917', 'request_id': 'req-46d28cf4-8a3e-49a1-ad15-39fc7829b3ae'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:40.179468 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-46d28cf4-8a3e-49a1-ad15-39fc7829b3ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d1d4a2ee0c74db9b6d02520da2ae917', 'request_id': 'req-46d28cf4-8a3e-49a1-ad15-39fc7829b3ae'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:40.191592 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-46d28cf4-8a3e-49a1-ad15-39fc7829b3ae admin admin] The token cache is being invalidate because project 7d1d4a2ee0c74db9b6d02520da2ae917 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:31:40.191836 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-46d28cf4-8a3e-49a1-ad15-39fc7829b3ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:40.192540 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-46d28cf4-8a3e-49a1-ad15-39fc7829b3ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:40.194160 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1064/2153] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:31:40 2022] DELETE /identity/v3/projects/7d1d4a2ee0c74db9b6d02520da2ae917 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:31:42.269430 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bf179b-9738-4776-bc96-3dc995140706 service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:42.271039 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-83bf179b-9738-4776-bc96-3dc995140706 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:31:42.285572 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bf179b-9738-4776-bc96-3dc995140706 service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:42.345128 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0f4c12-3b80-43fa-82cd-034344bc0fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:42.346002 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f4c12-3b80-43fa-82cd-034344bc0fc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:42.346276 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f4c12-3b80-43fa-82cd-034344bc0fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:42.346563 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f4c12-3b80-43fa-82cd-034344bc0fc2 admin admin] PATH_INFO: `/v3/users/f4f026998b1844d0aeae1090af6529a7` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:42.347782 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0f4c12-3b80-43fa-82cd-034344bc0fc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4f026998b1844d0aeae1090af6529a7)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:42.349722 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0f4c12-3b80-43fa-82cd-034344bc0fc2 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:42.401231 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-bf0f4c12-3b80-43fa-82cd-034344bc0fc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4f026998b1844d0aeae1090af6529a7'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:42.401945 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-bf0f4c12-3b80-43fa-82cd-034344bc0fc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4f026998b1844d0aeae1090af6529a7'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:42.412571 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-bf0f4c12-3b80-43fa-82cd-034344bc0fc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4f026998b1844d0aeae1090af6529a7'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:42.413339 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-bf0f4c12-3b80-43fa-82cd-034344bc0fc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4f026998b1844d0aeae1090af6529a7'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:42.427159 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-bf0f4c12-3b80-43fa-82cd-034344bc0fc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4f026998b1844d0aeae1090af6529a7'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:42.440721 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1090/2154] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:31:42 2022] DELETE /identity/v3/users/f4f026998b1844d0aeae1090af6529a7 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:31:42.445476 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65876384-8578-4304-94a9-741119abb950 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:42.445976 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65876384-8578-4304-94a9-741119abb950 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:42.445976 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65876384-8578-4304-94a9-741119abb950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:42.464437 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-65876384-8578-4304-94a9-741119abb950 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:31:42.465702 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-65876384-8578-4304-94a9-741119abb950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:31:42.528767 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1065/2155] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:31:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:31:42.538761 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0f4c12-3b80-43fa-82cd-034344bc0fc2 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:42.540833 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-bf0f4c12-3b80-43fa-82cd-034344bc0fc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:31:42.583838 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:31:42.603817 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0f4c12-3b80-43fa-82cd-034344bc0fc2 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:42.608250 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5bf198-3b8b-444b-a0b3-a516d6ae028d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:42.608938 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5bf198-3b8b-444b-a0b3-a516d6ae028d service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:42.609188 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5bf198-3b8b-444b-a0b3-a516d6ae028d service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:42.609499 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5bf198-3b8b-444b-a0b3-a516d6ae028d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:42.619713 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5bf198-3b8b-444b-a0b3-a516d6ae028d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:42.621168 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5bf198-3b8b-444b-a0b3-a516d6ae028d service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:42.630904 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1091/2156] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:31:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:31:42.924895 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65876384-8578-4304-94a9-741119abb950 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:42.926574 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-65876384-8578-4304-94a9-741119abb950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:31:42.941095 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65876384-8578-4304-94a9-741119abb950 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:42.946770 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a990b129-4aec-4352-ab9d-69e77e253d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:42.947713 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990b129-4aec-4352-ab9d-69e77e253d44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:42.947994 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990b129-4aec-4352-ab9d-69e77e253d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:42.948276 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990b129-4aec-4352-ab9d-69e77e253d44 admin admin] PATH_INFO: `/v3/projects/aab4c616a2204ff88af6ce826b6ccb6d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:42.949589 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a990b129-4aec-4352-ab9d-69e77e253d44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aab4c616a2204ff88af6ce826b6ccb6d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:42.951709 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a990b129-4aec-4352-ab9d-69e77e253d44 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:43.008924 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a990b129-4aec-4352-ab9d-69e77e253d44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aab4c616a2204ff88af6ce826b6ccb6d', 'request_id': 'req-a990b129-4aec-4352-ab9d-69e77e253d44'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:43.014375 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a990b129-4aec-4352-ab9d-69e77e253d44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aab4c616a2204ff88af6ce826b6ccb6d', 'request_id': 'req-a990b129-4aec-4352-ab9d-69e77e253d44'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:43.026695 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a990b129-4aec-4352-ab9d-69e77e253d44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aab4c616a2204ff88af6ce826b6ccb6d', 'request_id': 'req-a990b129-4aec-4352-ab9d-69e77e253d44'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:43.038731 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a990b129-4aec-4352-ab9d-69e77e253d44 admin admin] The token cache is being invalidate because project aab4c616a2204ff88af6ce826b6ccb6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:31:43.038952 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a990b129-4aec-4352-ab9d-69e77e253d44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:43.039622 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a990b129-4aec-4352-ab9d-69e77e253d44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:43.041721 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1066/2157] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:31:42 2022] DELETE /identity/v3/projects/aab4c616a2204ff88af6ce826b6ccb6d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:31:43.047050 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e91f3-60c9-4549-8b61-5baa03228138 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:43.047559 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e91f3-60c9-4549-8b61-5baa03228138 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:43.051396 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e91f3-60c9-4549-8b61-5baa03228138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:43.069993 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-297e91f3-60c9-4549-8b61-5baa03228138 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:31:43.071438 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-297e91f3-60c9-4549-8b61-5baa03228138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:31:43.146144 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1092/2158] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:31:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:31:43.155550 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc7926-5063-4ae8-aad0-c4130c976220 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:43.155841 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc7926-5063-4ae8-aad0-c4130c976220 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:43.156118 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc7926-5063-4ae8-aad0-c4130c976220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:43.169945 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:31:43.181199 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-6efc7926-5063-4ae8-aad0-c4130c976220 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:31:43.183484 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-6efc7926-5063-4ae8-aad0-c4130c976220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:31:43.192686 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1067/2159] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:31:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:31:43.197015 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e91f3-60c9-4549-8b61-5baa03228138 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:43.206616 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e91f3-60c9-4549-8b61-5baa03228138 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:43.211168 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b827e53-f8dd-487c-bffa-888ca023a8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:43.211986 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b827e53-f8dd-487c-bffa-888ca023a8b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:43.212265 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b827e53-f8dd-487c-bffa-888ca023a8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:43.212545 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b827e53-f8dd-487c-bffa-888ca023a8b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:43.213268 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b827e53-f8dd-487c-bffa-888ca023a8b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:31:43.213571 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b827e53-f8dd-487c-bffa-888ca023a8b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:43.215175 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b827e53-f8dd-487c-bffa-888ca023a8b0 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:43.228969 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1093/2160] 10.222.0.60 () {58 vars in 1152 bytes} [Sat Jul 2 03:31:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:31:43.233543 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efc7926-5063-4ae8-aad0-c4130c976220 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:43.245055 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efc7926-5063-4ae8-aad0-c4130c976220 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:43.250035 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0a973a-f85c-4e51-86ef-b5e063671776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:43.250689 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0a973a-f85c-4e51-86ef-b5e063671776 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:43.250969 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0a973a-f85c-4e51-86ef-b5e063671776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:43.251281 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0a973a-f85c-4e51-86ef-b5e063671776 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:43.251975 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0a973a-f85c-4e51-86ef-b5e063671776 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:43.253928 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0a973a-f85c-4e51-86ef-b5e063671776 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:43.282048 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1068/2161] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:31:43 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:31:43.286541 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b827e53-f8dd-487c-bffa-888ca023a8b0 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:43.297211 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b827e53-f8dd-487c-bffa-888ca023a8b0 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:43.359354 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dbc3b1-e1e8-4cef-8773-4856d413a723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:43.360048 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dbc3b1-e1e8-4cef-8773-4856d413a723 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:43.360322 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dbc3b1-e1e8-4cef-8773-4856d413a723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:43.360588 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dbc3b1-e1e8-4cef-8773-4856d413a723 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:43.361278 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dbc3b1-e1e8-4cef-8773-4856d413a723 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:43.363221 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dbc3b1-e1e8-4cef-8773-4856d413a723 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:43.391462 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1094/2162] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:31:43 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:31:43.392936 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0a973a-f85c-4e51-86ef-b5e063671776 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:43.404381 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0a973a-f85c-4e51-86ef-b5e063671776 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:43.409607 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea2bd7-253b-42d8-9ffe-037604d73666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:43.410280 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea2bd7-253b-42d8-9ffe-037604d73666 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:43.410568 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea2bd7-253b-42d8-9ffe-037604d73666 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:43.410845 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea2bd7-253b-42d8-9ffe-037604d73666 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:43.411654 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eea2bd7-253b-42d8-9ffe-037604d73666 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:43.413266 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eea2bd7-253b-42d8-9ffe-037604d73666 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:43.425313 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1069/2163] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:31:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:31:43.429288 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dbc3b1-e1e8-4cef-8773-4856d413a723 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:43.440496 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dbc3b1-e1e8-4cef-8773-4856d413a723 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:43.446111 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2435b511-270d-4b52-b263-8ce6f4809796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:43.446891 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2435b511-270d-4b52-b263-8ce6f4809796 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:43.447190 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2435b511-270d-4b52-b263-8ce6f4809796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:43.447463 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2435b511-270d-4b52-b263-8ce6f4809796 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:43.448192 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2435b511-270d-4b52-b263-8ce6f4809796 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:43.449785 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2435b511-270d-4b52-b263-8ce6f4809796 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:43.460653 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1095/2164] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:31:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:31:43.465137 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea2bd7-253b-42d8-9ffe-037604d73666 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:43.475686 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea2bd7-253b-42d8-9ffe-037604d73666 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:43.480837 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97db4221-51ed-452b-b775-18d2233998c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:43.481748 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db4221-51ed-452b-b775-18d2233998c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:43.482031 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db4221-51ed-452b-b775-18d2233998c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:43.482325 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db4221-51ed-452b-b775-18d2233998c4 admin admin] PATH_INFO: `/v3/projects/eec561e79ea240b1b79aa5c4b8edac98/users/5eea1226e3e94755a29d8943c5198c63/roles/c43aada0326446c4ade0ab1262918fa4` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:43.497087 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97db4221-51ed-452b-b775-18d2233998c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eec561e79ea240b1b79aa5c4b8edac98, user_id=5eea1226e3e94755a29d8943c5198c63, role_id=c43aada0326446c4ade0ab1262918fa4)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:43.499793 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97db4221-51ed-452b-b775-18d2233998c4 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:43.515370 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1070/2165] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:31:43 2022] PUT /identity/v3/projects/eec561e79ea240b1b79aa5c4b8edac98/users/5eea1226e3e94755a29d8943c5198c63/roles/c43aada0326446c4ade0ab1262918fa4 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:31:43.525738 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db43d0f-d745-4d36-9df6-25e76a62dd0a None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:43.526044 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db43d0f-d745-4d36-9df6-25e76a62dd0a None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:43.526276 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db43d0f-d745-4d36-9df6-25e76a62dd0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:43.554295 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-7db43d0f-d745-4d36-9df6-25e76a62dd0a None None] MFA Rules not processed for user `5eea1226e3e94755a29d8943c5198c63`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:31:43.555486 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-7db43d0f-d745-4d36-9df6-25e76a62dd0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:31:43.591343 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:31:43.628109 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1096/2166] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:31:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:31:43.639149 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97db4221-51ed-452b-b775-18d2233998c4 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:43.641062 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-97db4221-51ed-452b-b775-18d2233998c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:31:43.706611 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97db4221-51ed-452b-b775-18d2233998c4 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:43.710835 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f6294b-8ade-4a94-9da2-2dd592c9d453 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:43.711541 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f6294b-8ade-4a94-9da2-2dd592c9d453 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:43.711813 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f6294b-8ade-4a94-9da2-2dd592c9d453 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:43.712284 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f6294b-8ade-4a94-9da2-2dd592c9d453 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:43.721448 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f6294b-8ade-4a94-9da2-2dd592c9d453 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:43.723108 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f6294b-8ade-4a94-9da2-2dd592c9d453 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:43.732877 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1071/2167] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:31:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:31:46.816130 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db43d0f-d745-4d36-9df6-25e76a62dd0a None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:46.889364 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db43d0f-d745-4d36-9df6-25e76a62dd0a None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:46.894364 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f381b2-d1a7-44ac-8690-e66ccbd9c756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:46.895317 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f381b2-d1a7-44ac-8690-e66ccbd9c756 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:46.895595 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f381b2-d1a7-44ac-8690-e66ccbd9c756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:46.895865 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f381b2-d1a7-44ac-8690-e66ccbd9c756 admin admin] PATH_INFO: `/v3/users/5eea1226e3e94755a29d8943c5198c63` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:46.897156 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f381b2-d1a7-44ac-8690-e66ccbd9c756 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5eea1226e3e94755a29d8943c5198c63)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:46.899159 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f381b2-d1a7-44ac-8690-e66ccbd9c756 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:46.954497 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-36f381b2-d1a7-44ac-8690-e66ccbd9c756 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5eea1226e3e94755a29d8943c5198c63'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:46.955210 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-36f381b2-d1a7-44ac-8690-e66ccbd9c756 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5eea1226e3e94755a29d8943c5198c63'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:46.966239 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-36f381b2-d1a7-44ac-8690-e66ccbd9c756 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5eea1226e3e94755a29d8943c5198c63'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:46.966886 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-36f381b2-d1a7-44ac-8690-e66ccbd9c756 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5eea1226e3e94755a29d8943c5198c63'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:46.979896 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-36f381b2-d1a7-44ac-8690-e66ccbd9c756 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5eea1226e3e94755a29d8943c5198c63'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:46.993060 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1097/2168] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:31:46 2022] DELETE /identity/v3/users/5eea1226e3e94755a29d8943c5198c63 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:31:46.997884 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b2cb18-5972-43d4-bb7c-ecd92f59ae99 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:46.998382 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b2cb18-5972-43d4-bb7c-ecd92f59ae99 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:46.998518 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b2cb18-5972-43d4-bb7c-ecd92f59ae99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:47.019188 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-e0b2cb18-5972-43d4-bb7c-ecd92f59ae99 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:31:47.020620 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e0b2cb18-5972-43d4-bb7c-ecd92f59ae99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:31:47.082136 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1072/2169] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:31:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:31:47.093519 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f381b2-d1a7-44ac-8690-e66ccbd9c756 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:47.095023 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-36f381b2-d1a7-44ac-8690-e66ccbd9c756 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:31:47.158218 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f381b2-d1a7-44ac-8690-e66ccbd9c756 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:47.162748 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6bf524-c68c-4117-8178-79f984bb24c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:47.163437 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6bf524-c68c-4117-8178-79f984bb24c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:47.163721 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6bf524-c68c-4117-8178-79f984bb24c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:47.164037 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6bf524-c68c-4117-8178-79f984bb24c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:47.172304 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:31:47.174815 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6bf524-c68c-4117-8178-79f984bb24c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:47.176394 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6bf524-c68c-4117-8178-79f984bb24c4 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:47.189756 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1098/2170] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:31:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:31:47.475710 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b2cb18-5972-43d4-bb7c-ecd92f59ae99 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:47.477208 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e0b2cb18-5972-43d4-bb7c-ecd92f59ae99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:31:47.492301 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b2cb18-5972-43d4-bb7c-ecd92f59ae99 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:47.498496 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5a9215-c445-4358-9f60-1b8c04e6f168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:47.499514 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a9215-c445-4358-9f60-1b8c04e6f168 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:47.499805 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a9215-c445-4358-9f60-1b8c04e6f168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:47.500081 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a9215-c445-4358-9f60-1b8c04e6f168 admin admin] PATH_INFO: `/v3/projects/eec561e79ea240b1b79aa5c4b8edac98` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:47.501418 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5a9215-c445-4358-9f60-1b8c04e6f168 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eec561e79ea240b1b79aa5c4b8edac98)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:47.503438 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5a9215-c445-4358-9f60-1b8c04e6f168 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:47.546479 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:31:47.553333 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ea5a9215-c445-4358-9f60-1b8c04e6f168 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eec561e79ea240b1b79aa5c4b8edac98', 'request_id': 'req-ea5a9215-c445-4358-9f60-1b8c04e6f168'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:47.560043 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ea5a9215-c445-4358-9f60-1b8c04e6f168 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eec561e79ea240b1b79aa5c4b8edac98', 'request_id': 'req-ea5a9215-c445-4358-9f60-1b8c04e6f168'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:47.568741 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ea5a9215-c445-4358-9f60-1b8c04e6f168 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eec561e79ea240b1b79aa5c4b8edac98', 'request_id': 'req-ea5a9215-c445-4358-9f60-1b8c04e6f168'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:47.581033 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ea5a9215-c445-4358-9f60-1b8c04e6f168 admin admin] The token cache is being invalidate because project eec561e79ea240b1b79aa5c4b8edac98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:31:47.581331 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ea5a9215-c445-4358-9f60-1b8c04e6f168 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:47.582065 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ea5a9215-c445-4358-9f60-1b8c04e6f168 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:47.583745 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1073/2171] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:31:47 2022] DELETE /identity/v3/projects/eec561e79ea240b1b79aa5c4b8edac98 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:31:47.588922 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d984c-08aa-4faa-8abd-cae5b009a802 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:47.589137 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d984c-08aa-4faa-8abd-cae5b009a802 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:47.589412 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d984c-08aa-4faa-8abd-cae5b009a802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:47.607737 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-8c2d984c-08aa-4faa-8abd-cae5b009a802 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:31:47.608955 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-8c2d984c-08aa-4faa-8abd-cae5b009a802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:31:47.668654 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1099/2172] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:31:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:31:47.676768 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a302b085-a0b6-41dd-933b-8e597df0a5e2 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:47.677057 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a302b085-a0b6-41dd-933b-8e597df0a5e2 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:47.677337 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a302b085-a0b6-41dd-933b-8e597df0a5e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:47.696316 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-a302b085-a0b6-41dd-933b-8e597df0a5e2 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:31:47.697568 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a302b085-a0b6-41dd-933b-8e597df0a5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:31:47.706049 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1074/2173] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:31:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:31:47.711598 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2d984c-08aa-4faa-8abd-cae5b009a802 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:47.721826 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2d984c-08aa-4faa-8abd-cae5b009a802 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:47.730441 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b928e90b-6805-41af-9e2e-b214383b2d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:47.731222 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b928e90b-6805-41af-9e2e-b214383b2d08 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:47.731561 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b928e90b-6805-41af-9e2e-b214383b2d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:47.731917 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b928e90b-6805-41af-9e2e-b214383b2d08 admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:47.732744 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b928e90b-6805-41af-9e2e-b214383b2d08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:31:47.733108 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b928e90b-6805-41af-9e2e-b214383b2d08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:47.735034 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b928e90b-6805-41af-9e2e-b214383b2d08 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:47.748515 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1100/2174] 10.222.0.60 () {58 vars in 1152 bytes} [Sat Jul 2 03:31:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:31:47.753339 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a302b085-a0b6-41dd-933b-8e597df0a5e2 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:47.763987 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a302b085-a0b6-41dd-933b-8e597df0a5e2 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:47.773524 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad92634-5ec7-4e95-a40d-de5f4e7ef295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:47.774238 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad92634-5ec7-4e95-a40d-de5f4e7ef295 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:47.774516 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad92634-5ec7-4e95-a40d-de5f4e7ef295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:47.774780 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad92634-5ec7-4e95-a40d-de5f4e7ef295 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:47.775532 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad92634-5ec7-4e95-a40d-de5f4e7ef295 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:47.777493 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad92634-5ec7-4e95-a40d-de5f4e7ef295 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:47.809494 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1075/2175] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:31:47 2022] POST /identity/v3/projects => generated 399 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:31:47.814201 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b928e90b-6805-41af-9e2e-b214383b2d08 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:47.825934 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b928e90b-6805-41af-9e2e-b214383b2d08 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:47.890660 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc3ca5-d25e-41dd-bce1-e051a1d8fb44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:47.891373 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc3ca5-d25e-41dd-bce1-e051a1d8fb44 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:47.891653 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc3ca5-d25e-41dd-bce1-e051a1d8fb44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:47.891926 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc3ca5-d25e-41dd-bce1-e051a1d8fb44 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:47.892678 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cc3ca5-d25e-41dd-bce1-e051a1d8fb44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:47.894761 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cc3ca5-d25e-41dd-bce1-e051a1d8fb44 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:47.920045 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1101/2176] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:31:47 2022] POST /identity/v3/users => generated 300 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:31:47.924210 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad92634-5ec7-4e95-a40d-de5f4e7ef295 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:47.935056 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad92634-5ec7-4e95-a40d-de5f4e7ef295 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:47.940692 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51fda18-c8b9-49c2-8984-faecf73d2340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:47.941479 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51fda18-c8b9-49c2-8984-faecf73d2340 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:47.941845 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51fda18-c8b9-49c2-8984-faecf73d2340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:47.942124 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51fda18-c8b9-49c2-8984-faecf73d2340 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:47.942874 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51fda18-c8b9-49c2-8984-faecf73d2340 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:47.944555 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51fda18-c8b9-49c2-8984-faecf73d2340 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:47.955753 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1076/2177] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:31:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:31:47.960609 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc3ca5-d25e-41dd-bce1-e051a1d8fb44 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:47.972078 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc3ca5-d25e-41dd-bce1-e051a1d8fb44 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:47.976976 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135e726c-a389-4fbb-8db2-5e0ef09e1a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:47.977706 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e726c-a389-4fbb-8db2-5e0ef09e1a13 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:47.977987 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e726c-a389-4fbb-8db2-5e0ef09e1a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:47.978263 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e726c-a389-4fbb-8db2-5e0ef09e1a13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:47.979005 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135e726c-a389-4fbb-8db2-5e0ef09e1a13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:47.980681 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135e726c-a389-4fbb-8db2-5e0ef09e1a13 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:47.991108 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1102/2178] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:31:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:31:47.995571 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51fda18-c8b9-49c2-8984-faecf73d2340 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:48.006656 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51fda18-c8b9-49c2-8984-faecf73d2340 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:48.013102 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef451e2-7697-48b1-aebd-bd311abfc0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:48.014014 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef451e2-7697-48b1-aebd-bd311abfc0af admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:48.014299 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef451e2-7697-48b1-aebd-bd311abfc0af admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:48.014610 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef451e2-7697-48b1-aebd-bd311abfc0af admin admin] PATH_INFO: `/v3/projects/6e66a96f6adf4053b1b8cfce5c545575/users/40465bf9a7ad45edb8466c911f435dc3/roles/c43aada0326446c4ade0ab1262918fa4` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:48.030993 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef451e2-7697-48b1-aebd-bd311abfc0af admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e66a96f6adf4053b1b8cfce5c545575, user_id=40465bf9a7ad45edb8466c911f435dc3, role_id=c43aada0326446c4ade0ab1262918fa4)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:48.033749 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef451e2-7697-48b1-aebd-bd311abfc0af admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:48.052591 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1077/2179] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:31:47 2022] PUT /identity/v3/projects/6e66a96f6adf4053b1b8cfce5c545575/users/40465bf9a7ad45edb8466c911f435dc3/roles/c43aada0326446c4ade0ab1262918fa4 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:31:48.064252 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ef9bf-9e9f-4644-8f69-ae97611865c8 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:48.064596 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ef9bf-9e9f-4644-8f69-ae97611865c8 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:48.064936 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ef9bf-9e9f-4644-8f69-ae97611865c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:48.093092 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-a19ef9bf-9e9f-4644-8f69-ae97611865c8 None None] MFA Rules not processed for user `40465bf9a7ad45edb8466c911f435dc3`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:31:48.094313 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-a19ef9bf-9e9f-4644-8f69-ae97611865c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:31:48.146139 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:31:48.164647 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1103/2180] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:31:48 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:31:48.177679 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef451e2-7697-48b1-aebd-bd311abfc0af admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:48.180208 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-aef451e2-7697-48b1-aebd-bd311abfc0af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:31:48.246725 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef451e2-7697-48b1-aebd-bd311abfc0af admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:48.251029 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179faba8-afcc-4f12-b53b-cb3d1929fb10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:48.251715 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179faba8-afcc-4f12-b53b-cb3d1929fb10 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:48.251993 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179faba8-afcc-4f12-b53b-cb3d1929fb10 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:48.252266 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179faba8-afcc-4f12-b53b-cb3d1929fb10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:48.261990 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179faba8-afcc-4f12-b53b-cb3d1929fb10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:48.264336 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179faba8-afcc-4f12-b53b-cb3d1929fb10 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:48.277177 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1078/2181] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:31:48 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:31:53.341118 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19ef9bf-9e9f-4644-8f69-ae97611865c8 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:53.416219 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19ef9bf-9e9f-4644-8f69-ae97611865c8 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:53.421236 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652fca67-8587-4a45-abd1-2d8ec6774ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:53.422124 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652fca67-8587-4a45-abd1-2d8ec6774ddb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:53.422400 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652fca67-8587-4a45-abd1-2d8ec6774ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:53.422670 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652fca67-8587-4a45-abd1-2d8ec6774ddb admin admin] PATH_INFO: `/v3/users/40465bf9a7ad45edb8466c911f435dc3` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:53.423991 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652fca67-8587-4a45-abd1-2d8ec6774ddb admin admin] RBAC: Authorizing `identity:delete_user(user_id=40465bf9a7ad45edb8466c911f435dc3)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:53.425980 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652fca67-8587-4a45-abd1-2d8ec6774ddb admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:53.487233 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-652fca67-8587-4a45-abd1-2d8ec6774ddb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40465bf9a7ad45edb8466c911f435dc3'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:53.488559 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-652fca67-8587-4a45-abd1-2d8ec6774ddb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40465bf9a7ad45edb8466c911f435dc3'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:53.497463 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-652fca67-8587-4a45-abd1-2d8ec6774ddb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40465bf9a7ad45edb8466c911f435dc3'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:53.498084 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-652fca67-8587-4a45-abd1-2d8ec6774ddb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40465bf9a7ad45edb8466c911f435dc3'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:53.512518 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-652fca67-8587-4a45-abd1-2d8ec6774ddb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40465bf9a7ad45edb8466c911f435dc3'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:53.530707 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1104/2182] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:31:53 2022] DELETE /identity/v3/users/40465bf9a7ad45edb8466c911f435dc3 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:31:53.537039 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7f887-f825-47e6-98eb-bf20537a50d9 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:53.537600 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7f887-f825-47e6-98eb-bf20537a50d9 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:53.537600 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7f887-f825-47e6-98eb-bf20537a50d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:53.559910 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-85f7f887-f825-47e6-98eb-bf20537a50d9 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:31:53.561185 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-85f7f887-f825-47e6-98eb-bf20537a50d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:31:53.648254 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1079/2183] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:31:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:31:53.658806 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652fca67-8587-4a45-abd1-2d8ec6774ddb admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:53.665344 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-652fca67-8587-4a45-abd1-2d8ec6774ddb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:31:53.743833 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652fca67-8587-4a45-abd1-2d8ec6774ddb admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:53.748116 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a396e670-6951-4f14-a1a1-eae098d0c26d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:53.748768 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a396e670-6951-4f14-a1a1-eae098d0c26d service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:53.749033 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a396e670-6951-4f14-a1a1-eae098d0c26d service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:53.749305 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a396e670-6951-4f14-a1a1-eae098d0c26d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:53.764044 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a396e670-6951-4f14-a1a1-eae098d0c26d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:53.765573 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a396e670-6951-4f14-a1a1-eae098d0c26d service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:53.777904 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1105/2184] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:31:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:31:54.076160 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f7f887-f825-47e6-98eb-bf20537a50d9 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:31:54.077754 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-85f7f887-f825-47e6-98eb-bf20537a50d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:31:54.091213 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f7f887-f825-47e6-98eb-bf20537a50d9 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:31:54.096381 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f8eb58-b8ef-4fbf-a7f3-4af0e40384bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:31:54.097256 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8eb58-b8ef-4fbf-a7f3-4af0e40384bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:31:54.097533 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8eb58-b8ef-4fbf-a7f3-4af0e40384bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:31:54.097848 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8eb58-b8ef-4fbf-a7f3-4af0e40384bb admin admin] PATH_INFO: `/v3/projects/6e66a96f6adf4053b1b8cfce5c545575` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:31:54.099066 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f8eb58-b8ef-4fbf-a7f3-4af0e40384bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e66a96f6adf4053b1b8cfce5c545575)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:31:54.101044 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f8eb58-b8ef-4fbf-a7f3-4af0e40384bb admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:31:54.104249 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:31:54.168397 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-d4f8eb58-b8ef-4fbf-a7f3-4af0e40384bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e66a96f6adf4053b1b8cfce5c545575', 'request_id': 'req-d4f8eb58-b8ef-4fbf-a7f3-4af0e40384bb'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:54.175154 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-d4f8eb58-b8ef-4fbf-a7f3-4af0e40384bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e66a96f6adf4053b1b8cfce5c545575', 'request_id': 'req-d4f8eb58-b8ef-4fbf-a7f3-4af0e40384bb'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:54.185517 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-d4f8eb58-b8ef-4fbf-a7f3-4af0e40384bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e66a96f6adf4053b1b8cfce5c545575', 'request_id': 'req-d4f8eb58-b8ef-4fbf-a7f3-4af0e40384bb'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:54.200164 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-d4f8eb58-b8ef-4fbf-a7f3-4af0e40384bb admin admin] The token cache is being invalidate because project 6e66a96f6adf4053b1b8cfce5c545575 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:31:54.200454 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-d4f8eb58-b8ef-4fbf-a7f3-4af0e40384bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:54.201093 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-d4f8eb58-b8ef-4fbf-a7f3-4af0e40384bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:31:54.202669 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1080/2185] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:31:54 2022] DELETE /identity/v3/projects/6e66a96f6adf4053b1b8cfce5c545575 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:32:03.772833 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=83,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:32:04.197301 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=23,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:32:13.469462 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a396e670-6951-4f14-a1a1-eae098d0c26d service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:32:13.471004 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-a396e670-6951-4f14-a1a1-eae098d0c26d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:32:13.555193 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a396e670-6951-4f14-a1a1-eae098d0c26d service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:32:13.618258 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85013ffc-5321-465a-b035-c09eee9ac338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:32:13.618913 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85013ffc-5321-465a-b035-c09eee9ac338 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:32:13.619228 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85013ffc-5321-465a-b035-c09eee9ac338 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:32:13.619509 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85013ffc-5321-465a-b035-c09eee9ac338 admin admin] PATH_INFO: `/v3/users/c7696781261b4929824d11956a00c01d` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:32:13.620787 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85013ffc-5321-465a-b035-c09eee9ac338 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7696781261b4929824d11956a00c01d)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:32:13.622772 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85013ffc-5321-465a-b035-c09eee9ac338 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:32:13.674292 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-85013ffc-5321-465a-b035-c09eee9ac338 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7696781261b4929824d11956a00c01d'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:32:13.674957 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-85013ffc-5321-465a-b035-c09eee9ac338 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7696781261b4929824d11956a00c01d'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:32:13.684807 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-85013ffc-5321-465a-b035-c09eee9ac338 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7696781261b4929824d11956a00c01d'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:32:13.685868 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-85013ffc-5321-465a-b035-c09eee9ac338 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7696781261b4929824d11956a00c01d'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:32:13.701530 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-85013ffc-5321-465a-b035-c09eee9ac338 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7696781261b4929824d11956a00c01d'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:32:13.714531 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1106/2186] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:32:13 2022] DELETE /identity/v3/users/c7696781261b4929824d11956a00c01d => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:32:13.719024 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5b8bb-a4ef-4848-989b-d7e7e623899d None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:32:13.719525 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5b8bb-a4ef-4848-989b-d7e7e623899d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:32:13.719638 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5b8bb-a4ef-4848-989b-d7e7e623899d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:32:13.748319 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-2cc5b8bb-a4ef-4848-989b-d7e7e623899d None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:32:13.749505 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2cc5b8bb-a4ef-4848-989b-d7e7e623899d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:32:13.809970 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1081/2187] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:32:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:32:13.819970 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85013ffc-5321-465a-b035-c09eee9ac338 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:32:13.821415 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-85013ffc-5321-465a-b035-c09eee9ac338 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:32:13.844355 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:32:13.921332 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85013ffc-5321-465a-b035-c09eee9ac338 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:32:13.925313 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864857ef-4f2e-4d80-9dd5-5a8373e22fa8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:32:13.925942 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864857ef-4f2e-4d80-9dd5-5a8373e22fa8 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:32:13.926223 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864857ef-4f2e-4d80-9dd5-5a8373e22fa8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:32:13.926498 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864857ef-4f2e-4d80-9dd5-5a8373e22fa8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:32:13.935996 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864857ef-4f2e-4d80-9dd5-5a8373e22fa8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:32:13.937437 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864857ef-4f2e-4d80-9dd5-5a8373e22fa8 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:32:13.947174 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1107/2188] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:32:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:32:14.236601 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc5b8bb-a4ef-4848-989b-d7e7e623899d None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:32:14.238195 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2cc5b8bb-a4ef-4848-989b-d7e7e623899d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:32:14.270476 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc5b8bb-a4ef-4848-989b-d7e7e623899d None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:32:14.277906 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7dbef4-46b3-4ee2-9e0a-45e34973d1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:32:14.278790 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7dbef4-46b3-4ee2-9e0a-45e34973d1d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:32:14.279069 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7dbef4-46b3-4ee2-9e0a-45e34973d1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:32:14.279373 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7dbef4-46b3-4ee2-9e0a-45e34973d1d3 admin admin] PATH_INFO: `/v3/projects/494081725f8f429eae68d597cd34126e` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:32:14.280578 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7dbef4-46b3-4ee2-9e0a-45e34973d1d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=494081725f8f429eae68d597cd34126e)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:32:14.282509 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7dbef4-46b3-4ee2-9e0a-45e34973d1d3 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:32:14.330824 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3d7dbef4-46b3-4ee2-9e0a-45e34973d1d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '494081725f8f429eae68d597cd34126e', 'request_id': 'req-3d7dbef4-46b3-4ee2-9e0a-45e34973d1d3'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:32:14.337062 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3d7dbef4-46b3-4ee2-9e0a-45e34973d1d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '494081725f8f429eae68d597cd34126e', 'request_id': 'req-3d7dbef4-46b3-4ee2-9e0a-45e34973d1d3'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:32:14.344926 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3d7dbef4-46b3-4ee2-9e0a-45e34973d1d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '494081725f8f429eae68d597cd34126e', 'request_id': 'req-3d7dbef4-46b3-4ee2-9e0a-45e34973d1d3'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:32:14.356679 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3d7dbef4-46b3-4ee2-9e0a-45e34973d1d3 admin admin] The token cache is being invalidate because project 494081725f8f429eae68d597cd34126e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:32:14.356991 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3d7dbef4-46b3-4ee2-9e0a-45e34973d1d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:32:14.357623 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3d7dbef4-46b3-4ee2-9e0a-45e34973d1d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:32:14.359306 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1082/2189] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:32:14 2022] DELETE /identity/v3/projects/494081725f8f429eae68d597cd34126e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:32:14.364458 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35237795-fe73-473d-9ab4-dea1761b7b89 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:32:14.364797 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35237795-fe73-473d-9ab4-dea1761b7b89 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:32:14.365077 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35237795-fe73-473d-9ab4-dea1761b7b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:32:14.428906 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-35237795-fe73-473d-9ab4-dea1761b7b89 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:32:14.430243 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-35237795-fe73-473d-9ab4-dea1761b7b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:32:14.491661 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1108/2190] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:32:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 03:32:14.499675 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca3031-cd15-4fa2-a4c7-5eabf005821c None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:32:14.499963 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca3031-cd15-4fa2-a4c7-5eabf005821c None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:32:14.500237 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca3031-cd15-4fa2-a4c7-5eabf005821c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:32:14.519083 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-95ca3031-cd15-4fa2-a4c7-5eabf005821c None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:32:14.520465 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-95ca3031-cd15-4fa2-a4c7-5eabf005821c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:32:14.531215 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1083/2191] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:32:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:32:14.536270 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35237795-fe73-473d-9ab4-dea1761b7b89 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:32:14.550337 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35237795-fe73-473d-9ab4-dea1761b7b89 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:32:14.557743 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cccdd6-ed30-4972-9471-9699a60ee362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:32:14.558503 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cccdd6-ed30-4972-9471-9699a60ee362 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:32:14.558941 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cccdd6-ed30-4972-9471-9699a60ee362 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:32:14.559301 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cccdd6-ed30-4972-9471-9699a60ee362 admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:32:14.560228 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cccdd6-ed30-4972-9471-9699a60ee362 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:32:14.560638 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cccdd6-ed30-4972-9471-9699a60ee362 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:32:14.562893 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cccdd6-ed30-4972-9471-9699a60ee362 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:32:14.575627 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1109/2192] 10.222.0.60 () {58 vars in 1152 bytes} [Sat Jul 2 03:32:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:32:14.580227 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ca3031-cd15-4fa2-a4c7-5eabf005821c None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:32:14.590061 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ca3031-cd15-4fa2-a4c7-5eabf005821c None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:32:14.596158 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dda5da-63df-4bcd-ae33-33e86a53b579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:32:14.596801 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dda5da-63df-4bcd-ae33-33e86a53b579 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:32:14.597079 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dda5da-63df-4bcd-ae33-33e86a53b579 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:32:14.597345 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dda5da-63df-4bcd-ae33-33e86a53b579 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:32:14.598063 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dda5da-63df-4bcd-ae33-33e86a53b579 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:32:14.600005 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dda5da-63df-4bcd-ae33-33e86a53b579 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:32:14.627682 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1084/2193] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:32:14 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 03:32:14.631944 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cccdd6-ed30-4972-9471-9699a60ee362 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:32:14.642621 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cccdd6-ed30-4972-9471-9699a60ee362 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:32:14.692178 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:32:14.704791 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeca5ff-16cd-4522-a63f-2c9c3b8a7e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:32:14.705448 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeca5ff-16cd-4522-a63f-2c9c3b8a7e29 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:32:14.705725 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeca5ff-16cd-4522-a63f-2c9c3b8a7e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:32:14.705990 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeca5ff-16cd-4522-a63f-2c9c3b8a7e29 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:32:14.706678 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeca5ff-16cd-4522-a63f-2c9c3b8a7e29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:32:14.708633 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeca5ff-16cd-4522-a63f-2c9c3b8a7e29 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:32:14.730271 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1110/2194] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:32:14 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:32:14.731660 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dda5da-63df-4bcd-ae33-33e86a53b579 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:32:14.742380 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dda5da-63df-4bcd-ae33-33e86a53b579 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:32:14.747445 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f121147b-ab53-49bc-9bf1-1831104f0981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:32:14.748099 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f121147b-ab53-49bc-9bf1-1831104f0981 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:32:14.748380 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f121147b-ab53-49bc-9bf1-1831104f0981 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:32:14.748652 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f121147b-ab53-49bc-9bf1-1831104f0981 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:32:14.749383 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f121147b-ab53-49bc-9bf1-1831104f0981 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:32:14.751053 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f121147b-ab53-49bc-9bf1-1831104f0981 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:32:14.762038 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1085/2195] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:32:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:32:14.765937 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeca5ff-16cd-4522-a63f-2c9c3b8a7e29 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:32:14.777061 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeca5ff-16cd-4522-a63f-2c9c3b8a7e29 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:32:14.783323 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f3b84-4891-4f47-b61b-593fc19fc253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:32:14.783988 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f3b84-4891-4f47-b61b-593fc19fc253 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:32:14.784284 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f3b84-4891-4f47-b61b-593fc19fc253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:32:14.784556 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f3b84-4891-4f47-b61b-593fc19fc253 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:32:14.785302 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69f3b84-4891-4f47-b61b-593fc19fc253 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:32:14.786396 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e7cb71-8515-418a-857a-bdf6a136aef8 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:32:14.786684 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e7cb71-8515-418a-857a-bdf6a136aef8 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:32:14.786905 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69f3b84-4891-4f47-b61b-593fc19fc253 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:32:14.787057 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e7cb71-8515-418a-857a-bdf6a136aef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:32:14.798202 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1111/2196] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:32:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:32:14.802401 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f3b84-4891-4f47-b61b-593fc19fc253 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:32:14.807847 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-f8e7cb71-8515-418a-857a-bdf6a136aef8 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:32:14.809079 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f8e7cb71-8515-418a-857a-bdf6a136aef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:32:14.812618 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f3b84-4891-4f47-b61b-593fc19fc253 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:32:14.817605 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31323fb-0e1e-4747-8cc9-f3a36f28aea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:32:14.818387 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1086/2197] 10.222.0.64 () {58 vars in 1016 bytes} [Sat Jul 2 03:32:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:32:14.818576 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31323fb-0e1e-4747-8cc9-f3a36f28aea3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:32:14.818751 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31323fb-0e1e-4747-8cc9-f3a36f28aea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:32:14.819021 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31323fb-0e1e-4747-8cc9-f3a36f28aea3 admin admin] PATH_INFO: `/v3/projects/6b35673c0c4d45f2884b4e6181850390/users/4506cc00c308471489c51d69c296e721/roles/c43aada0326446c4ade0ab1262918fa4` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:32:14.834381 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31323fb-0e1e-4747-8cc9-f3a36f28aea3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b35673c0c4d45f2884b4e6181850390, user_id=4506cc00c308471489c51d69c296e721, role_id=c43aada0326446c4ade0ab1262918fa4)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:32:14.837093 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31323fb-0e1e-4747-8cc9-f3a36f28aea3 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:32:14.841991 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e7cb71-8515-418a-857a-bdf6a136aef8 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:32:14.843575 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f8e7cb71-8515-418a-857a-bdf6a136aef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:32:14.851154 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1112/2198] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:32:14 2022] PUT /identity/v3/projects/6b35673c0c4d45f2884b4e6181850390/users/4506cc00c308471489c51d69c296e721/roles/c43aada0326446c4ade0ab1262918fa4 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:32:14.861739 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d08a1-311c-47cb-b761-e65ec6ab7cbf None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:32:14.862377 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d08a1-311c-47cb-b761-e65ec6ab7cbf None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:32:14.862377 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d08a1-311c-47cb-b761-e65ec6ab7cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:32:14.877955 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:32:14.891623 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-372d08a1-311c-47cb-b761-e65ec6ab7cbf None None] MFA Rules not processed for user `4506cc00c308471489c51d69c296e721`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:32:14.892980 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-372d08a1-311c-47cb-b761-e65ec6ab7cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:32:14.920391 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e7cb71-8515-418a-857a-bdf6a136aef8 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:32:14.967409 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1113/2199] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:32:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:32:14.997296 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697167f5-d081-4b21-a174-c6b7ae525f1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13530240e2d446b6bf26a431d001362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:32:14.998089 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697167f5-d081-4b21-a174-c6b7ae525f1c service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:32:14.998305 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697167f5-d081-4b21-a174-c6b7ae525f1c service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:32:14.998655 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697167f5-d081-4b21-a174-c6b7ae525f1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:32:15.040828 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d08a1-311c-47cb-b761-e65ec6ab7cbf None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:32:15.042299 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-372d08a1-311c-47cb-b761-e65ec6ab7cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:32:15.066099 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697167f5-d081-4b21-a174-c6b7ae525f1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:32:15.067746 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697167f5-d081-4b21-a174-c6b7ae525f1c service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:32:15.079105 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1087/2200] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:32:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:32:15.111692 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d08a1-311c-47cb-b761-e65ec6ab7cbf None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:32:15.115307 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbcdda1-0f42-400c-8d3c-2e27ae310cc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:32:15.115949 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbcdda1-0f42-400c-8d3c-2e27ae310cc1 service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:32:15.116218 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbcdda1-0f42-400c-8d3c-2e27ae310cc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:32:15.116487 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbcdda1-0f42-400c-8d3c-2e27ae310cc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:32:15.125206 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbcdda1-0f42-400c-8d3c-2e27ae310cc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:32:15.126716 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbcdda1-0f42-400c-8d3c-2e27ae310cc1 service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:32:15.136411 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1114/2201] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:32:15 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 03:32:16.501180 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d271a96-1508-41f5-9a27-e95e42a0072e None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:32:16.501672 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d271a96-1508-41f5-9a27-e95e42a0072e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:32:16.501765 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d271a96-1508-41f5-9a27-e95e42a0072e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:32:16.519854 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-3d271a96-1508-41f5-9a27-e95e42a0072e None None] MFA Rules not processed for user `4506cc00c308471489c51d69c296e721`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:32:16.521074 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3d271a96-1508-41f5-9a27-e95e42a0072e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:32:16.528705 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1088/2202] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:32:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:32:19.891642 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1bc01-26b1-4450-9ab5-84ee1464dacd None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:32:19.892195 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1bc01-26b1-4450-9ab5-84ee1464dacd None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:32:19.892195 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1bc01-26b1-4450-9ab5-84ee1464dacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:32:19.910517 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-9aa1bc01-26b1-4450-9ab5-84ee1464dacd None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:32:19.911831 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-9aa1bc01-26b1-4450-9ab5-84ee1464dacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:32:19.921106 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1115/2203] 10.222.0.64 () {58 vars in 1016 bytes} [Sat Jul 2 03:32:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:32:19.943383 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d271a96-1508-41f5-9a27-e95e42a0072e None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:32:19.973026 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d271a96-1508-41f5-9a27-e95e42a0072e None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:32:19.979703 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae7671-4eb3-4b3a-8d73-2abba5254958 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13530240e2d446b6bf26a431d001362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:32:19.980911 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae7671-4eb3-4b3a-8d73-2abba5254958 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:32:19.981187 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae7671-4eb3-4b3a-8d73-2abba5254958 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:32:19.981458 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae7671-4eb3-4b3a-8d73-2abba5254958 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:32:19.991598 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae7671-4eb3-4b3a-8d73-2abba5254958 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:32:19.993363 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae7671-4eb3-4b3a-8d73-2abba5254958 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:32:20.004643 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1089/2204] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:32:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:32:24.196543 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c0044d-da2d-40c3-a3ce-67336fa1385a None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:32:24.197144 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c0044d-da2d-40c3-a3ce-67336fa1385a None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:32:24.197144 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c0044d-da2d-40c3-a3ce-67336fa1385a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:32:24.216024 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-a6c0044d-da2d-40c3-a3ce-67336fa1385a None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:32:24.217250 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-a6c0044d-da2d-40c3-a3ce-67336fa1385a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:32:24.226519 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1116/2205] 10.222.0.64 () {58 vars in 1016 bytes} [Sat Jul 2 03:32:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:32:24.255802 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae7671-4eb3-4b3a-8d73-2abba5254958 service nova] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:32:24.267466 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae7671-4eb3-4b3a-8d73-2abba5254958 service nova] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:32:24.274254 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6f4cd-9631-4020-a311-35047cb96735 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13530240e2d446b6bf26a431d001362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:32:24.274796 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6f4cd-9631-4020-a311-35047cb96735 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:32:24.275035 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6f4cd-9631-4020-a311-35047cb96735 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:32:24.275339 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6f4cd-9631-4020-a311-35047cb96735 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:32:24.284775 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e6f4cd-9631-4020-a311-35047cb96735 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:32:24.286364 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e6f4cd-9631-4020-a311-35047cb96735 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:32:24.296635 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1090/2206] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:32:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:32:29.373092 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6372e124-5c0a-4d22-8958-a5334f898260 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:32:29.373562 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6372e124-5c0a-4d22-8958-a5334f898260 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:32:29.373659 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6372e124-5c0a-4d22-8958-a5334f898260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:32:29.400090 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-6372e124-5c0a-4d22-8958-a5334f898260 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:32:29.401325 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-6372e124-5c0a-4d22-8958-a5334f898260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:32:29.410040 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1117/2207] 10.222.0.64 () {58 vars in 1016 bytes} [Sat Jul 2 03:32:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:32:29.431460 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6f4cd-9631-4020-a311-35047cb96735 service nova] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:32:29.433130 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-40e6f4cd-9631-4020-a311-35047cb96735 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:32:29.457218 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:32:29.464088 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6f4cd-9631-4020-a311-35047cb96735 service nova] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:32:29.470918 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae427ba-9762-45c0-91f0-6661f5bf37d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13530240e2d446b6bf26a431d001362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:32:29.471608 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae427ba-9762-45c0-91f0-6661f5bf37d9 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:32:29.471887 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae427ba-9762-45c0-91f0-6661f5bf37d9 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:32:29.472582 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae427ba-9762-45c0-91f0-6661f5bf37d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:32:29.481870 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae427ba-9762-45c0-91f0-6661f5bf37d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:32:29.483515 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae427ba-9762-45c0-91f0-6661f5bf37d9 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:32:29.495489 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1091/2208] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:32:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:32:30.515802 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8ceb3-578a-4165-86e4-a31eb3852634 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:32:30.516331 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8ceb3-578a-4165-86e4-a31eb3852634 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:32:30.516331 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8ceb3-578a-4165-86e4-a31eb3852634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:32:30.534791 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-1bc8ceb3-578a-4165-86e4-a31eb3852634 None None] MFA Rules not processed for user `ac2f872367a9463ab4c7c56cec0c79dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:32:30.536041 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-1bc8ceb3-578a-4165-86e4-a31eb3852634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:32:30.546206 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:32:30.595484 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1118/2209] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:32:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:32:35.671986 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ea1d2-9c10-41a7-8fba-84bb35b293b2 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:32:35.672459 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ea1d2-9c10-41a7-8fba-84bb35b293b2 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:32:35.672570 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ea1d2-9c10-41a7-8fba-84bb35b293b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:32:35.691908 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-c19ea1d2-9c10-41a7-8fba-84bb35b293b2 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:32:35.693121 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c19ea1d2-9c10-41a7-8fba-84bb35b293b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:32:35.702539 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1092/2210] 10.222.0.64 () {58 vars in 1016 bytes} [Sat Jul 2 03:32:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:32:35.747470 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc8ceb3-578a-4165-86e4-a31eb3852634 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:32:35.761614 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc8ceb3-578a-4165-86e4-a31eb3852634 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:32:35.768624 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc51ae3b-cdf4-463f-97ca-d2d2f7843375 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13530240e2d446b6bf26a431d001362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:32:35.769265 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51ae3b-cdf4-463f-97ca-d2d2f7843375 service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:32:35.769545 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51ae3b-cdf4-463f-97ca-d2d2f7843375 service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:32:35.769866 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51ae3b-cdf4-463f-97ca-d2d2f7843375 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:32:35.778673 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc51ae3b-cdf4-463f-97ca-d2d2f7843375 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:32:35.780223 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc51ae3b-cdf4-463f-97ca-d2d2f7843375 service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:32:35.791452 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1119/2211] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:32:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:32:40.896187 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c7e76b-42b1-47e4-94c6-b088c8d9bc94 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:32:40.896739 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c7e76b-42b1-47e4-94c6-b088c8d9bc94 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:32:40.896739 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c7e76b-42b1-47e4-94c6-b088c8d9bc94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:32:40.916517 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-40c7e76b-42b1-47e4-94c6-b088c8d9bc94 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:32:40.917727 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-40c7e76b-42b1-47e4-94c6-b088c8d9bc94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:32:40.926174 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1093/2212] 10.222.0.64 () {58 vars in 1016 bytes} [Sat Jul 2 03:32:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 03:32:40.950260 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc51ae3b-cdf4-463f-97ca-d2d2f7843375 service nova] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:32:40.962108 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc51ae3b-cdf4-463f-97ca-d2d2f7843375 service nova] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:32:40.968673 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb8adae-3515-45a6-a213-caacd35d3bd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13530240e2d446b6bf26a431d001362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:32:40.969244 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8adae-3515-45a6-a213-caacd35d3bd1 service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:32:40.969526 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8adae-3515-45a6-a213-caacd35d3bd1 service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:32:40.969776 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8adae-3515-45a6-a213-caacd35d3bd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:32:40.979482 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb8adae-3515-45a6-a213-caacd35d3bd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:32:40.981086 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb8adae-3515-45a6-a213-caacd35d3bd1 service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:32:40.992414 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1120/2213] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:32:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:32:50.601383 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c7e76b-42b1-47e4-94c6-b088c8d9bc94 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:32:50.602930 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-40c7e76b-42b1-47e4-94c6-b088c8d9bc94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:32:50.694613 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c7e76b-42b1-47e4-94c6-b088c8d9bc94 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:32:50.699915 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39306c69-8aa0-44ff-8488-07ca980d729b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dafc9be75a64db095fe08b9cbb04cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:32:50.700573 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39306c69-8aa0-44ff-8488-07ca980d729b service placement] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:32:50.700854 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39306c69-8aa0-44ff-8488-07ca980d729b service placement] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:32:50.701129 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39306c69-8aa0-44ff-8488-07ca980d729b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:32:50.703151 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-39306c69-8aa0-44ff-8488-07ca980d729b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:32:50.715495 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39306c69-8aa0-44ff-8488-07ca980d729b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:32:50.717106 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39306c69-8aa0-44ff-8488-07ca980d729b service placement] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:32:50.737626 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1094/2214] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:32:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:32:50.986898 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=30 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:32:53.112872 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39465d33-c3ff-427e-ba2f-6a5e2713c7e2 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:32:53.113522 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39465d33-c3ff-427e-ba2f-6a5e2713c7e2 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:32:53.113522 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39465d33-c3ff-427e-ba2f-6a5e2713c7e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:32:53.188626 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-39465d33-c3ff-427e-ba2f-6a5e2713c7e2 None None] MFA Rules not processed for user `3333e7495b9546d882e2a2211ff8875c`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:32:53.190789 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-39465d33-c3ff-427e-ba2f-6a5e2713c7e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:32:53.269510 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1121/2215] 10.222.0.60 () {58 vars in 1009 bytes} [Sat Jul 2 03:32:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:32:53.315628 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39306c69-8aa0-44ff-8488-07ca980d729b service placement] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:32:53.317153 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-39306c69-8aa0-44ff-8488-07ca980d729b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:32:53.422982 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39306c69-8aa0-44ff-8488-07ca980d729b service placement] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:32:53.428298 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077dbe10-92b1-4583-a23a-6360b3d11928 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '692ec343bf9f4339ba691440f55a6c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:32:53.428947 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077dbe10-92b1-4583-a23a-6360b3d11928 service swift] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:32:53.429228 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077dbe10-92b1-4583-a23a-6360b3d11928 service swift] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:32:53.429503 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077dbe10-92b1-4583-a23a-6360b3d11928 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:32:53.437642 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077dbe10-92b1-4583-a23a-6360b3d11928 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:32:53.439293 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077dbe10-92b1-4583-a23a-6360b3d11928 service swift] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:32:53.447417 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1095/2216] 10.222.0.60 () {60 vars in 1384 bytes} [Sat Jul 2 03:32:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 03:32:54.010520 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a7d1d-cf9c-4906-be01-e86e87bb4e33 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:32:54.010816 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a7d1d-cf9c-4906-be01-e86e87bb4e33 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:32:54.011092 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a7d1d-cf9c-4906-be01-e86e87bb4e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:32:54.029197 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-f73a7d1d-cf9c-4906-be01-e86e87bb4e33 None None] MFA Rules not processed for user `3333e7495b9546d882e2a2211ff8875c`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:32:54.030394 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-f73a7d1d-cf9c-4906-be01-e86e87bb4e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:32:54.037869 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1122/2217] 10.222.0.60 () {58 vars in 967 bytes} [Sat Jul 2 03:32:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:32:54.050976 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077dbe10-92b1-4583-a23a-6360b3d11928 service swift] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:32:54.061470 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077dbe10-92b1-4583-a23a-6360b3d11928 service swift] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:32:54.067617 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e51ca4-0200-45d9-898f-506fc12b4805 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '692ec343bf9f4339ba691440f55a6c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:32:54.068415 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e51ca4-0200-45d9-898f-506fc12b4805 service swift] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:32:54.068697 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e51ca4-0200-45d9-898f-506fc12b4805 service swift] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:32:54.068977 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e51ca4-0200-45d9-898f-506fc12b4805 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:32:54.077508 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e51ca4-0200-45d9-898f-506fc12b4805 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:32:54.079093 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e51ca4-0200-45d9-898f-506fc12b4805 service swift] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:32:54.088411 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1096/2218] 10.222.0.60 () {60 vars in 1384 bytes} [Sat Jul 2 03:32:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 03:32:54.301466 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d428eb-4d35-4b6c-9f94-5b8c9893bd98 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:32:54.301924 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d428eb-4d35-4b6c-9f94-5b8c9893bd98 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:32:54.302023 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d428eb-4d35-4b6c-9f94-5b8c9893bd98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:32:54.319992 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-d9d428eb-4d35-4b6c-9f94-5b8c9893bd98 None None] MFA Rules not processed for user `3333e7495b9546d882e2a2211ff8875c`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:32:54.321190 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-d9d428eb-4d35-4b6c-9f94-5b8c9893bd98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:32:54.328880 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1123/2219] 10.222.0.60 () {58 vars in 1009 bytes} [Sat Jul 2 03:32:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:32:54.341195 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e51ca4-0200-45d9-898f-506fc12b4805 service swift] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:32:54.346599 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:32:54.354970 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e51ca4-0200-45d9-898f-506fc12b4805 service swift] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:32:54.361151 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd88aa6-0d56-463e-9684-e146c18b599d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '692ec343bf9f4339ba691440f55a6c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:32:54.361837 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd88aa6-0d56-463e-9684-e146c18b599d service swift] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:32:54.362121 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd88aa6-0d56-463e-9684-e146c18b599d service swift] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:32:54.362397 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd88aa6-0d56-463e-9684-e146c18b599d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:32:54.371620 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd88aa6-0d56-463e-9684-e146c18b599d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:32:54.373279 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd88aa6-0d56-463e-9684-e146c18b599d service swift] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:32:54.382031 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1097/2220] 10.222.0.60 () {60 vars in 1384 bytes} [Sat Jul 2 03:32:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 03:32:54.750738 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5726b00d-55be-4fea-bc5c-1f4454ee9805 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:32:54.751088 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5726b00d-55be-4fea-bc5c-1f4454ee9805 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:32:54.751466 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5726b00d-55be-4fea-bc5c-1f4454ee9805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:32:54.773549 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-5726b00d-55be-4fea-bc5c-1f4454ee9805 None None] MFA Rules not processed for user `3333e7495b9546d882e2a2211ff8875c`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:32:54.774877 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-5726b00d-55be-4fea-bc5c-1f4454ee9805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:32:54.783113 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1124/2221] 10.222.0.60 () {58 vars in 967 bytes} [Sat Jul 2 03:32:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:32:54.795826 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd88aa6-0d56-463e-9684-e146c18b599d service swift] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:32:54.806653 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd88aa6-0d56-463e-9684-e146c18b599d service swift] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:32:54.811851 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe22237-5f57-446c-841f-7479e42ee747 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '692ec343bf9f4339ba691440f55a6c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:32:54.812491 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe22237-5f57-446c-841f-7479e42ee747 service swift] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:32:54.812810 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe22237-5f57-446c-841f-7479e42ee747 service swift] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:32:54.813062 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe22237-5f57-446c-841f-7479e42ee747 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:32:54.822064 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe22237-5f57-446c-841f-7479e42ee747 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:32:54.823732 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe22237-5f57-446c-841f-7479e42ee747 service swift] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:32:54.832277 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1098/2222] 10.222.0.60 () {60 vars in 1384 bytes} [Sat Jul 2 03:32:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 03:32:57.101247 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5726b00d-55be-4fea-bc5c-1f4454ee9805 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:32:57.113938 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5726b00d-55be-4fea-bc5c-1f4454ee9805 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:32:57.118820 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e1c86f-d599-486b-bf1d-d100e392b753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:32:57.119743 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1c86f-d599-486b-bf1d-d100e392b753 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:32:57.120038 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1c86f-d599-486b-bf1d-d100e392b753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:32:57.120314 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1c86f-d599-486b-bf1d-d100e392b753 admin admin] PATH_INFO: `/v3/users/4506cc00c308471489c51d69c296e721` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:32:57.121535 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e1c86f-d599-486b-bf1d-d100e392b753 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4506cc00c308471489c51d69c296e721)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:32:57.123728 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e1c86f-d599-486b-bf1d-d100e392b753 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:32:57.175194 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-61e1c86f-d599-486b-bf1d-d100e392b753 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4506cc00c308471489c51d69c296e721'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:32:57.176012 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-61e1c86f-d599-486b-bf1d-d100e392b753 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4506cc00c308471489c51d69c296e721'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:32:57.183466 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-61e1c86f-d599-486b-bf1d-d100e392b753 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4506cc00c308471489c51d69c296e721'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:32:57.184035 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-61e1c86f-d599-486b-bf1d-d100e392b753 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4506cc00c308471489c51d69c296e721'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:32:57.196063 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-61e1c86f-d599-486b-bf1d-d100e392b753 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4506cc00c308471489c51d69c296e721'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:32:57.208160 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1125/2223] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:32:57 2022] DELETE /identity/v3/users/4506cc00c308471489c51d69c296e721 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:32:57.212901 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f12fa1-eecc-4240-87d4-628c8add066f None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:32:57.213376 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f12fa1-eecc-4240-87d4-628c8add066f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:32:57.213496 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f12fa1-eecc-4240-87d4-628c8add066f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:32:57.231807 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-42f12fa1-eecc-4240-87d4-628c8add066f None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:32:57.233020 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-42f12fa1-eecc-4240-87d4-628c8add066f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:32:57.293246 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1099/2224] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:32:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 03:32:57.303154 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e1c86f-d599-486b-bf1d-d100e392b753 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:32:57.304668 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-61e1c86f-d599-486b-bf1d-d100e392b753 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:32:57.328789 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:32:57.371081 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e1c86f-d599-486b-bf1d-d100e392b753 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:32:57.375510 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f5e55-778a-4ea1-9884-71228df5c883 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:32:57.376215 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f5e55-778a-4ea1-9884-71228df5c883 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:32:57.376456 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f5e55-778a-4ea1-9884-71228df5c883 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:32:57.376741 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f5e55-778a-4ea1-9884-71228df5c883 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:32:57.386644 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489f5e55-778a-4ea1-9884-71228df5c883 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:32:57.388138 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489f5e55-778a-4ea1-9884-71228df5c883 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:32:57.398216 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1126/2225] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:32:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:32:57.582157 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f12fa1-eecc-4240-87d4-628c8add066f None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:32:57.583802 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-42f12fa1-eecc-4240-87d4-628c8add066f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:32:57.596022 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f12fa1-eecc-4240-87d4-628c8add066f None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:32:57.602008 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58df646-a28f-4de7-b055-2d2dfb353d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:32:57.602873 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58df646-a28f-4de7-b055-2d2dfb353d71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:32:57.603187 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58df646-a28f-4de7-b055-2d2dfb353d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:32:57.603467 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58df646-a28f-4de7-b055-2d2dfb353d71 admin admin] PATH_INFO: `/v3/projects/6b35673c0c4d45f2884b4e6181850390` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:32:57.604785 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58df646-a28f-4de7-b055-2d2dfb353d71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b35673c0c4d45f2884b4e6181850390)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:32:57.606735 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58df646-a28f-4de7-b055-2d2dfb353d71 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:32:57.654818 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-d58df646-a28f-4de7-b055-2d2dfb353d71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b35673c0c4d45f2884b4e6181850390', 'request_id': 'req-d58df646-a28f-4de7-b055-2d2dfb353d71'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:32:57.660721 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-d58df646-a28f-4de7-b055-2d2dfb353d71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b35673c0c4d45f2884b4e6181850390', 'request_id': 'req-d58df646-a28f-4de7-b055-2d2dfb353d71'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:32:57.668563 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-d58df646-a28f-4de7-b055-2d2dfb353d71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b35673c0c4d45f2884b4e6181850390', 'request_id': 'req-d58df646-a28f-4de7-b055-2d2dfb353d71'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:32:57.680183 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-d58df646-a28f-4de7-b055-2d2dfb353d71 admin admin] The token cache is being invalidate because project 6b35673c0c4d45f2884b4e6181850390 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:32:57.680483 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-d58df646-a28f-4de7-b055-2d2dfb353d71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:32:57.681175 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-d58df646-a28f-4de7-b055-2d2dfb353d71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:32:57.682821 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1100/2226] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:32:57 2022] DELETE /identity/v3/projects/6b35673c0c4d45f2884b4e6181850390 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:33:03.326013 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f99738-673c-4f47-baf3-a45789ac03c1 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:33:03.326477 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f99738-673c-4f47-baf3-a45789ac03c1 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:33:03.326567 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f99738-673c-4f47-baf3-a45789ac03c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:33:03.344926 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-96f99738-673c-4f47-baf3-a45789ac03c1 None None] MFA Rules not processed for user `3333e7495b9546d882e2a2211ff8875c`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:33:03.346212 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-96f99738-673c-4f47-baf3-a45789ac03c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:33:03.409662 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1127/2227] 10.222.0.60 () {58 vars in 1009 bytes} [Sat Jul 2 03:33:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:33:03.421997 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58df646-a28f-4de7-b055-2d2dfb353d71 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:33:03.423478 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d58df646-a28f-4de7-b055-2d2dfb353d71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:33:03.491781 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:33:03.498516 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58df646-a28f-4de7-b055-2d2dfb353d71 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:33:03.504861 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792103e4-d69f-4739-a088-b6801454bece service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '692ec343bf9f4339ba691440f55a6c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:33:03.505520 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792103e4-d69f-4739-a088-b6801454bece service swift] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:33:03.505800 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792103e4-d69f-4739-a088-b6801454bece service swift] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:33:03.506074 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792103e4-d69f-4739-a088-b6801454bece service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:33:03.514259 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792103e4-d69f-4739-a088-b6801454bece service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:33:03.515930 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792103e4-d69f-4739-a088-b6801454bece service swift] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:33:03.524839 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1101/2228] 10.222.0.60 () {60 vars in 1384 bytes} [Sat Jul 2 03:33:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 03:33:05.728844 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31688fd7-ca99-4e99-b8e3-eccfafd62705 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:33:05.729312 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31688fd7-ca99-4e99-b8e3-eccfafd62705 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:33:05.729312 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31688fd7-ca99-4e99-b8e3-eccfafd62705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:33:05.761761 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-31688fd7-ca99-4e99-b8e3-eccfafd62705 None None] MFA Rules not processed for user `7b0336a1ee514b63890167d1801cb410`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:33:05.762984 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-31688fd7-ca99-4e99-b8e3-eccfafd62705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:33:05.827728 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1128/2229] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:33:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:33:13.520947 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=5 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:33:15.817884 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=69 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:33:18.450929 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4433e7-86c3-4226-8c5e-6272c04fb05a None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:33:18.451533 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4433e7-86c3-4226-8c5e-6272c04fb05a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:33:18.451533 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4433e7-86c3-4226-8c5e-6272c04fb05a None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:33:18.452922 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1102/2230] 10.222.0.60 () {54 vars in 921 bytes} [Sat Jul 2 03:33:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:33:18.459421 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd88646-0f97-4bc4-8639-758b276a1eaa None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:33:18.459871 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd88646-0f97-4bc4-8639-758b276a1eaa None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:33:18.459968 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd88646-0f97-4bc4-8639-758b276a1eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:33:18.497226 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-3bd88646-0f97-4bc4-8639-758b276a1eaa None None] MFA Rules not processed for user `13530240e2d446b6bf26a431d001362a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:33:18.498444 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-3bd88646-0f97-4bc4-8639-758b276a1eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:33:18.564817 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1129/2231] 10.222.0.60 () {58 vars in 1018 bytes} [Sat Jul 2 03:33:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:33:18.579499 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4433e7-86c3-4226-8c5e-6272c04fb05a None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:33:18.579499 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0e4433e7-86c3-4226-8c5e-6272c04fb05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:33:18.673498 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4433e7-86c3-4226-8c5e-6272c04fb05a None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:33:18.678110 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdddd9f7-557c-4aaa-a658-c081bce2ff87 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6470ccbf858f47bf9bb884476bf4235e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:33:18.678754 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdddd9f7-557c-4aaa-a658-c081bce2ff87 service glance] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:33:18.679035 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdddd9f7-557c-4aaa-a658-c081bce2ff87 service glance] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:33:18.679351 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdddd9f7-557c-4aaa-a658-c081bce2ff87 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:33:18.690738 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdddd9f7-557c-4aaa-a658-c081bce2ff87 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:33:18.692251 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdddd9f7-557c-4aaa-a658-c081bce2ff87 service glance] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:33:18.703400 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1103/2232] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:33:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:33:18.780232 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1a282c-2940-4161-95ce-e31f92c58dc5 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:33:18.780430 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1a282c-2940-4161-95ce-e31f92c58dc5 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:33:18.780701 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1a282c-2940-4161-95ce-e31f92c58dc5 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:33:18.782170 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1130/2233] 10.222.0.60 () {54 vars in 921 bytes} [Sat Jul 2 03:33:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:33:18.787531 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce4ee7-e455-49da-bd3d-99af2f1c5a9e None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:33:18.787846 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce4ee7-e455-49da-bd3d-99af2f1c5a9e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:33:18.788124 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce4ee7-e455-49da-bd3d-99af2f1c5a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:33:18.808345 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-95ce4ee7-e455-49da-bd3d-99af2f1c5a9e None None] MFA Rules not processed for user `b0e8a3ba6f84477bb9b4780918f357c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:33:18.809541 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-95ce4ee7-e455-49da-bd3d-99af2f1c5a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:33:18.862458 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1104/2234] 10.222.0.60 () {58 vars in 1018 bytes} [Sat Jul 2 03:33:18 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:33:18.875234 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1a282c-2940-4161-95ce-e31f92c58dc5 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:33:18.877149 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-ed1a282c-2940-4161-95ce-e31f92c58dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:33:18.891726 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1a282c-2940-4161-95ce-e31f92c58dc5 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:33:18.896331 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b688540-7283-4721-9704-e8938609526e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:33:18.897219 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b688540-7283-4721-9704-e8938609526e service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:33:18.897500 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b688540-7283-4721-9704-e8938609526e service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:33:18.897784 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b688540-7283-4721-9704-e8938609526e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:33:18.905555 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b688540-7283-4721-9704-e8938609526e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:33:18.906990 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b688540-7283-4721-9704-e8938609526e service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:33:18.915579 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1131/2235] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:33:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:33:19.034052 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c37a31-a909-4af0-9ea9-13b1fde4510d None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:33:19.034409 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c37a31-a909-4af0-9ea9-13b1fde4510d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:33:19.035246 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c37a31-a909-4af0-9ea9-13b1fde4510d None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:33:19.036571 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1105/2236] 10.222.0.60 () {54 vars in 921 bytes} [Sat Jul 2 03:33:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:33:19.042244 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02331263-c690-4427-bd59-7d372f75a3a3 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:33:19.042455 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02331263-c690-4427-bd59-7d372f75a3a3 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:33:19.042781 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02331263-c690-4427-bd59-7d372f75a3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:33:19.064742 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-02331263-c690-4427-bd59-7d372f75a3a3 None None] MFA Rules not processed for user `13530240e2d446b6bf26a431d001362a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:33:19.066165 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-02331263-c690-4427-bd59-7d372f75a3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:33:19.078665 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1132/2237] 10.222.0.60 () {58 vars in 1018 bytes} [Sat Jul 2 03:33:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:33:19.092497 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c37a31-a909-4af0-9ea9-13b1fde4510d None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:33:19.106445 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c37a31-a909-4af0-9ea9-13b1fde4510d None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:33:19.110193 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e59545-f0bc-42f5-a933-280a6072a392 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:33:19.110836 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e59545-f0bc-42f5-a933-280a6072a392 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:33:19.111114 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e59545-f0bc-42f5-a933-280a6072a392 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:33:19.111417 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e59545-f0bc-42f5-a933-280a6072a392 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:33:19.126659 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e59545-f0bc-42f5-a933-280a6072a392 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:33:19.128481 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e59545-f0bc-42f5-a933-280a6072a392 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:33:19.139509 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1106/2238] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:33:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:33:23.319055 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0563ca5f-9d4d-4b41-a0e0-f6818703e9b7 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:33:23.319653 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0563ca5f-9d4d-4b41-a0e0-f6818703e9b7 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:33:23.319653 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0563ca5f-9d4d-4b41-a0e0-f6818703e9b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:33:23.338869 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-0563ca5f-9d4d-4b41-a0e0-f6818703e9b7 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:33:23.340110 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-0563ca5f-9d4d-4b41-a0e0-f6818703e9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:33:23.410218 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1133/2239] 10.222.0.64 () {58 vars in 1016 bytes} [Sat Jul 2 03:33:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:33:23.436145 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e59545-f0bc-42f5-a933-280a6072a392 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:33:23.437646 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e0e59545-f0bc-42f5-a933-280a6072a392 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:33:23.451956 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e59545-f0bc-42f5-a933-280a6072a392 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:33:23.458221 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fdedea-e810-496f-a85b-533850871efd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13530240e2d446b6bf26a431d001362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:33:23.458474 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fdedea-e810-496f-a85b-533850871efd service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:33:23.458742 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fdedea-e810-496f-a85b-533850871efd service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:33:23.459015 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fdedea-e810-496f-a85b-533850871efd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:33:23.467817 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fdedea-e810-496f-a85b-533850871efd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:33:23.469418 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fdedea-e810-496f-a85b-533850871efd service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:33:23.479849 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1107/2240] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:33:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:33:27.106578 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a514ca-ed3c-4c66-97ba-ed1d7ef92055 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:33:27.107054 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a514ca-ed3c-4c66-97ba-ed1d7ef92055 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:33:27.107170 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a514ca-ed3c-4c66-97ba-ed1d7ef92055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:33:27.125123 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-c7a514ca-ed3c-4c66-97ba-ed1d7ef92055 None None] MFA Rules not processed for user `3333e7495b9546d882e2a2211ff8875c`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:33:27.126343 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-c7a514ca-ed3c-4c66-97ba-ed1d7ef92055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:33:27.133640 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1134/2241] 10.222.0.60 () {58 vars in 1009 bytes} [Sat Jul 2 03:33:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:33:27.145582 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fdedea-e810-496f-a85b-533850871efd service nova] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:33:27.157126 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fdedea-e810-496f-a85b-533850871efd service nova] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:33:27.162637 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66395b8f-c55f-4498-b174-f6b38776da2d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '692ec343bf9f4339ba691440f55a6c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:33:27.163335 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66395b8f-c55f-4498-b174-f6b38776da2d service swift] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:33:27.163909 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66395b8f-c55f-4498-b174-f6b38776da2d service swift] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:33:27.164205 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66395b8f-c55f-4498-b174-f6b38776da2d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:33:27.172334 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66395b8f-c55f-4498-b174-f6b38776da2d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:33:27.173925 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66395b8f-c55f-4498-b174-f6b38776da2d service swift] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:33:27.182182 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1108/2242] 10.222.0.60 () {60 vars in 1384 bytes} [Sat Jul 2 03:33:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 03:33:28.791169 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab93626c-52f4-4ffa-87c7-a9ddddf1e607 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:33:28.792390 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab93626c-52f4-4ffa-87c7-a9ddddf1e607 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:33:28.793020 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab93626c-52f4-4ffa-87c7-a9ddddf1e607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:33:28.811670 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-ab93626c-52f4-4ffa-87c7-a9ddddf1e607 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:33:28.812900 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-ab93626c-52f4-4ffa-87c7-a9ddddf1e607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:33:28.824421 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1135/2243] 10.222.0.64 () {58 vars in 1016 bytes} [Sat Jul 2 03:33:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:33:28.863859 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66395b8f-c55f-4498-b174-f6b38776da2d service swift] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:33:28.865887 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-66395b8f-c55f-4498-b174-f6b38776da2d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:33:28.884714 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66395b8f-c55f-4498-b174-f6b38776da2d service swift] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:33:28.890870 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73659271-3769-4caf-87fd-23ff57585895 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13530240e2d446b6bf26a431d001362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:33:28.891772 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73659271-3769-4caf-87fd-23ff57585895 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:33:28.892212 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73659271-3769-4caf-87fd-23ff57585895 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:33:28.892629 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73659271-3769-4caf-87fd-23ff57585895 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:33:28.902618 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73659271-3769-4caf-87fd-23ff57585895 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:33:28.904444 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73659271-3769-4caf-87fd-23ff57585895 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:33:28.915457 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1109/2244] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:33:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:33:29.263921 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6befe4a3-67f7-4a2f-94c4-04a23d37945b None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:33:29.264198 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6befe4a3-67f7-4a2f-94c4-04a23d37945b None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:33:29.264470 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6befe4a3-67f7-4a2f-94c4-04a23d37945b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:33:29.282999 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-6befe4a3-67f7-4a2f-94c4-04a23d37945b None None] MFA Rules not processed for user `c42a4b22cda34bb68980388f63e822cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:33:29.284445 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-6befe4a3-67f7-4a2f-94c4-04a23d37945b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:33:29.329683 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:33:29.345747 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1136/2245] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:33:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:33:38.910345 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=82 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:33:39.338021 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=4 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:33:49.397660 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a116ce6-8d9e-4fa1-955a-bcea26e87d62 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:33:49.398172 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a116ce6-8d9e-4fa1-955a-bcea26e87d62 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:33:49.398286 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a116ce6-8d9e-4fa1-955a-bcea26e87d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:33:49.418374 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-4a116ce6-8d9e-4fa1-955a-bcea26e87d62 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:33:49.419620 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4a116ce6-8d9e-4fa1-955a-bcea26e87d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:33:49.428186 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1110/2246] 10.222.0.64 () {58 vars in 1016 bytes} [Sat Jul 2 03:33:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:33:49.466548 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6befe4a3-67f7-4a2f-94c4-04a23d37945b None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:33:49.480474 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6befe4a3-67f7-4a2f-94c4-04a23d37945b None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:33:49.487353 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf87b6b6-3fde-4fcb-bd5c-7366a363b69e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13530240e2d446b6bf26a431d001362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:33:49.488003 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87b6b6-3fde-4fcb-bd5c-7366a363b69e service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:33:49.488280 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87b6b6-3fde-4fcb-bd5c-7366a363b69e service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:33:49.488657 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87b6b6-3fde-4fcb-bd5c-7366a363b69e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:33:49.500892 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf87b6b6-3fde-4fcb-bd5c-7366a363b69e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:33:49.503153 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf87b6b6-3fde-4fcb-bd5c-7366a363b69e service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:33:49.518045 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1137/2247] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:33:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:33:59.060622 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e84fa2-b7f5-4fbf-bfaa-50c0d99ccde1 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:33:59.061103 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e84fa2-b7f5-4fbf-bfaa-50c0d99ccde1 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:33:59.061196 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e84fa2-b7f5-4fbf-bfaa-50c0d99ccde1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:33:59.081056 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-62e84fa2-b7f5-4fbf-bfaa-50c0d99ccde1 None None] MFA Rules not processed for user `3333e7495b9546d882e2a2211ff8875c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:33:59.082266 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-62e84fa2-b7f5-4fbf-bfaa-50c0d99ccde1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:33:59.089389 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1111/2248] 10.222.0.60 () {58 vars in 967 bytes} [Sat Jul 2 03:33:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 03:33:59.111141 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf87b6b6-3fde-4fcb-bd5c-7366a363b69e service nova] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:33:59.122592 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf87b6b6-3fde-4fcb-bd5c-7366a363b69e service nova] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:33:59.128131 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3597eb-5fc3-4f76-af36-6815adcc55d4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '692ec343bf9f4339ba691440f55a6c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:33:59.128769 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3597eb-5fc3-4f76-af36-6815adcc55d4 service swift] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:33:59.129053 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3597eb-5fc3-4f76-af36-6815adcc55d4 service swift] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:33:59.129326 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3597eb-5fc3-4f76-af36-6815adcc55d4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:33:59.137702 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3597eb-5fc3-4f76-af36-6815adcc55d4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:33:59.139315 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3597eb-5fc3-4f76-af36-6815adcc55d4 service swift] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:33:59.147464 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1138/2249] 10.222.0.60 () {60 vars in 1384 bytes} [Sat Jul 2 03:33:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 03:33:59.813002 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e67962-4bf8-41b6-8bce-7512d40f5f58 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:33:59.813247 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e67962-4bf8-41b6-8bce-7512d40f5f58 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:33:59.813648 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e67962-4bf8-41b6-8bce-7512d40f5f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:33:59.836399 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-e5e67962-4bf8-41b6-8bce-7512d40f5f58 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:33:59.837810 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e5e67962-4bf8-41b6-8bce-7512d40f5f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:33:59.849329 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1112/2250] 10.222.0.64 () {58 vars in 1016 bytes} [Sat Jul 2 03:33:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 03:33:59.870358 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3597eb-5fc3-4f76-af36-6815adcc55d4 service swift] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:33:59.883690 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3597eb-5fc3-4f76-af36-6815adcc55d4 service swift] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:33:59.891686 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b1446c-eab2-4134-8699-00c2de4733a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13530240e2d446b6bf26a431d001362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:33:59.892774 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b1446c-eab2-4134-8699-00c2de4733a1 service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:33:59.893275 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b1446c-eab2-4134-8699-00c2de4733a1 service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:33:59.893563 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b1446c-eab2-4134-8699-00c2de4733a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:33:59.904042 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b1446c-eab2-4134-8699-00c2de4733a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:33:59.906986 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b1446c-eab2-4134-8699-00c2de4733a1 service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:33:59.919361 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1139/2251] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:33:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:34:07.133588 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a6ad7-e780-4fe7-9c24-814be53dc27a None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:34:07.134099 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a6ad7-e780-4fe7-9c24-814be53dc27a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:34:07.134211 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a6ad7-e780-4fe7-9c24-814be53dc27a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:34:07.153274 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-a23a6ad7-e780-4fe7-9c24-814be53dc27a None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:34:07.154413 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a23a6ad7-e780-4fe7-9c24-814be53dc27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:34:07.162794 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1113/2252] 10.222.0.64 () {58 vars in 1016 bytes} [Sat Jul 2 03:34:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 03:34:07.184657 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b1446c-eab2-4134-8699-00c2de4733a1 service nova] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:34:07.196194 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b1446c-eab2-4134-8699-00c2de4733a1 service nova] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:34:07.203305 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc50c30c-de25-4fa9-a6ba-206b18266796 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13530240e2d446b6bf26a431d001362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:34:07.204003 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50c30c-de25-4fa9-a6ba-206b18266796 service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:34:07.204285 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50c30c-de25-4fa9-a6ba-206b18266796 service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:34:07.204560 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50c30c-de25-4fa9-a6ba-206b18266796 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:34:07.213522 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc50c30c-de25-4fa9-a6ba-206b18266796 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:34:07.215108 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc50c30c-de25-4fa9-a6ba-206b18266796 service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:34:07.225430 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1140/2253] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:34:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:34:17.147980 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=12 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:34:17.220675 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=24 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:34:39.008558 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a6ad7-e780-4fe7-9c24-814be53dc27a None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:34:39.019652 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a6ad7-e780-4fe7-9c24-814be53dc27a None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:34:39.024104 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c53cf4-bab1-40c4-a4d6-e31d3e19aec0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:34:39.024887 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c53cf4-bab1-40c4-a4d6-e31d3e19aec0 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:34:39.025279 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c53cf4-bab1-40c4-a4d6-e31d3e19aec0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:34:39.025547 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c53cf4-bab1-40c4-a4d6-e31d3e19aec0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:34:39.027706 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-18c53cf4-bab1-40c4-a4d6-e31d3e19aec0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:34:39.042084 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c53cf4-bab1-40c4-a4d6-e31d3e19aec0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:34:39.043629 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c53cf4-bab1-40c4-a4d6-e31d3e19aec0 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:34:39.055315 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1114/2254] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:34:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:34:39.315513 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc50c30c-de25-4fa9-a6ba-206b18266796 service nova] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:34:39.325137 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc50c30c-de25-4fa9-a6ba-206b18266796 service nova] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:34:39.329005 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de5ed8-fb86-42d6-b667-cb27475a341c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:34:39.329614 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de5ed8-fb86-42d6-b667-cb27475a341c service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:34:39.329921 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de5ed8-fb86-42d6-b667-cb27475a341c service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:34:39.330193 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de5ed8-fb86-42d6-b667-cb27475a341c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:34:39.332075 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-24de5ed8-fb86-42d6-b667-cb27475a341c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:34:39.346249 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24de5ed8-fb86-42d6-b667-cb27475a341c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:34:39.347740 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24de5ed8-fb86-42d6-b667-cb27475a341c service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:34:39.358875 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1141/2255] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:34:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:34:40.814505 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c53cf4-bab1-40c4-a4d6-e31d3e19aec0 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:34:40.816547 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-18c53cf4-bab1-40c4-a4d6-e31d3e19aec0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:34:40.831758 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c53cf4-bab1-40c4-a4d6-e31d3e19aec0 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:34:40.836558 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02313529-a9a4-46a4-a1e7-bdc14d1b916b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:34:40.837474 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02313529-a9a4-46a4-a1e7-bdc14d1b916b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:34:40.837757 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02313529-a9a4-46a4-a1e7-bdc14d1b916b admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:34:40.838036 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02313529-a9a4-46a4-a1e7-bdc14d1b916b admin admin] PATH_INFO: `/v3/users/7b0336a1ee514b63890167d1801cb410` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:34:40.839392 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02313529-a9a4-46a4-a1e7-bdc14d1b916b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b0336a1ee514b63890167d1801cb410)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:34:40.841357 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02313529-a9a4-46a4-a1e7-bdc14d1b916b admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:34:40.891723 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-02313529-a9a4-46a4-a1e7-bdc14d1b916b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b0336a1ee514b63890167d1801cb410'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:34:40.892294 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-02313529-a9a4-46a4-a1e7-bdc14d1b916b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b0336a1ee514b63890167d1801cb410'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:34:40.892887 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-02313529-a9a4-46a4-a1e7-bdc14d1b916b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b0336a1ee514b63890167d1801cb410'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:34:40.904820 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-02313529-a9a4-46a4-a1e7-bdc14d1b916b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b0336a1ee514b63890167d1801cb410'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:34:40.916626 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-02313529-a9a4-46a4-a1e7-bdc14d1b916b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b0336a1ee514b63890167d1801cb410'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:34:40.933717 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1115/2256] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:34:40 2022] DELETE /identity/v3/users/7b0336a1ee514b63890167d1801cb410 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:34:41.124183 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de5ed8-fb86-42d6-b667-cb27475a341c service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:34:41.140642 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de5ed8-fb86-42d6-b667-cb27475a341c service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:34:41.199864 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb5f5b4-ea20-4343-bc86-99e244de0794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:34:41.200732 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb5f5b4-ea20-4343-bc86-99e244de0794 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:34:41.201288 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb5f5b4-ea20-4343-bc86-99e244de0794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:34:41.201288 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb5f5b4-ea20-4343-bc86-99e244de0794 admin admin] PATH_INFO: `/v3/projects/4205b52c30f3484398dd4edd58f96508` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:34:41.202645 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb5f5b4-ea20-4343-bc86-99e244de0794 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4205b52c30f3484398dd4edd58f96508)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:34:41.204799 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb5f5b4-ea20-4343-bc86-99e244de0794 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:34:41.252423 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-bdb5f5b4-ea20-4343-bc86-99e244de0794 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4205b52c30f3484398dd4edd58f96508', 'request_id': 'req-bdb5f5b4-ea20-4343-bc86-99e244de0794'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:34:41.257876 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-bdb5f5b4-ea20-4343-bc86-99e244de0794 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4205b52c30f3484398dd4edd58f96508', 'request_id': 'req-bdb5f5b4-ea20-4343-bc86-99e244de0794'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:34:41.263822 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-bdb5f5b4-ea20-4343-bc86-99e244de0794 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4205b52c30f3484398dd4edd58f96508', 'request_id': 'req-bdb5f5b4-ea20-4343-bc86-99e244de0794'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:34:41.278443 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-bdb5f5b4-ea20-4343-bc86-99e244de0794 admin admin] The token cache is being invalidate because project 4205b52c30f3484398dd4edd58f96508 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:34:41.278724 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-bdb5f5b4-ea20-4343-bc86-99e244de0794 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:34:41.279435 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-bdb5f5b4-ea20-4343-bc86-99e244de0794 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:34:41.281319 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1142/2257] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:34:41 2022] DELETE /identity/v3/projects/4205b52c30f3484398dd4edd58f96508 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:34:41.286762 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac79b5-4c70-401f-abb7-e5dfe1b3ec0d None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:34:41.287078 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac79b5-4c70-401f-abb7-e5dfe1b3ec0d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:34:41.287697 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac79b5-4c70-401f-abb7-e5dfe1b3ec0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:34:41.307681 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-70ac79b5-4c70-401f-abb7-e5dfe1b3ec0d None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:34:41.308885 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-70ac79b5-4c70-401f-abb7-e5dfe1b3ec0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:34:41.372485 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1116/2258] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:34:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:34:41.380125 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70afe16b-8517-48c6-b19f-52c8cc0980dd None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:34:41.380406 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70afe16b-8517-48c6-b19f-52c8cc0980dd None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:34:41.380692 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70afe16b-8517-48c6-b19f-52c8cc0980dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:34:41.399162 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-70afe16b-8517-48c6-b19f-52c8cc0980dd None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:34:41.400280 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-70afe16b-8517-48c6-b19f-52c8cc0980dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:34:41.408311 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1143/2259] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:34:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:34:41.413062 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ac79b5-4c70-401f-abb7-e5dfe1b3ec0d None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:34:41.423036 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ac79b5-4c70-401f-abb7-e5dfe1b3ec0d None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:34:41.428053 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5abd78-d68e-4870-be57-acab913bf4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:34:41.428787 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5abd78-d68e-4870-be57-acab913bf4c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:34:41.429159 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5abd78-d68e-4870-be57-acab913bf4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:34:41.429495 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5abd78-d68e-4870-be57-acab913bf4c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:34:41.430324 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5abd78-d68e-4870-be57-acab913bf4c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:34:41.430632 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5abd78-d68e-4870-be57-acab913bf4c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:34:41.432250 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5abd78-d68e-4870-be57-acab913bf4c6 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:34:41.444257 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1117/2260] 10.222.0.60 () {58 vars in 1152 bytes} [Sat Jul 2 03:34:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:34:41.448626 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70afe16b-8517-48c6-b19f-52c8cc0980dd None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:34:41.458125 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70afe16b-8517-48c6-b19f-52c8cc0980dd None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:34:41.462952 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a109675-d0a8-4502-aafc-d5f812e6b122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:34:41.464126 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a109675-d0a8-4502-aafc-d5f812e6b122 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:34:41.464126 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a109675-d0a8-4502-aafc-d5f812e6b122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:34:41.464126 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a109675-d0a8-4502-aafc-d5f812e6b122 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:34:41.464841 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a109675-d0a8-4502-aafc-d5f812e6b122 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:34:41.466742 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a109675-d0a8-4502-aafc-d5f812e6b122 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:34:41.495445 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1144/2261] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:34:41 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:34:41.499676 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5abd78-d68e-4870-be57-acab913bf4c6 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:34:41.510216 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5abd78-d68e-4870-be57-acab913bf4c6 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:34:41.555286 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:34:41.570601 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec416775-2a18-4dae-87cf-92dadd096d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:34:41.571308 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec416775-2a18-4dae-87cf-92dadd096d8f admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:34:41.571587 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec416775-2a18-4dae-87cf-92dadd096d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:34:41.571857 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec416775-2a18-4dae-87cf-92dadd096d8f admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:34:41.572556 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec416775-2a18-4dae-87cf-92dadd096d8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:34:41.574475 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec416775-2a18-4dae-87cf-92dadd096d8f admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:34:41.594891 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1118/2262] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:34:41 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 03:34:41.599211 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a109675-d0a8-4502-aafc-d5f812e6b122 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:34:41.610298 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a109675-d0a8-4502-aafc-d5f812e6b122 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:34:41.615460 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b4482-0708-4379-9a16-60ee10dee8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:34:41.617007 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b4482-0708-4379-9a16-60ee10dee8de admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:34:41.617322 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b4482-0708-4379-9a16-60ee10dee8de admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:34:41.617600 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b4482-0708-4379-9a16-60ee10dee8de admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:34:41.618339 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338b4482-0708-4379-9a16-60ee10dee8de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:34:41.620019 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338b4482-0708-4379-9a16-60ee10dee8de admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:34:41.631004 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1145/2263] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:34:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:34:41.634906 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec416775-2a18-4dae-87cf-92dadd096d8f admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:34:41.645282 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec416775-2a18-4dae-87cf-92dadd096d8f admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:34:41.651341 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10a2ac0-f81f-477e-877e-aa37373e30fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:34:41.651959 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a2ac0-f81f-477e-877e-aa37373e30fd admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:34:41.652267 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a2ac0-f81f-477e-877e-aa37373e30fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:34:41.652526 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a2ac0-f81f-477e-877e-aa37373e30fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:34:41.653260 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10a2ac0-f81f-477e-877e-aa37373e30fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:34:41.654890 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10a2ac0-f81f-477e-877e-aa37373e30fd admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:34:41.666044 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1119/2264] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:34:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 03:34:41.670489 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b4482-0708-4379-9a16-60ee10dee8de admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:34:41.681341 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b4482-0708-4379-9a16-60ee10dee8de admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:34:41.686794 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87673c20-9553-4177-bf72-31abc41eaee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:34:41.687743 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87673c20-9553-4177-bf72-31abc41eaee7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:34:41.688022 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87673c20-9553-4177-bf72-31abc41eaee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:34:41.688300 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87673c20-9553-4177-bf72-31abc41eaee7 admin admin] PATH_INFO: `/v3/projects/30ab2b5c51184c4298a4e98a1562e407/users/4790ced1b60d4936a186c3fd80f9476e/roles/c43aada0326446c4ade0ab1262918fa4` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:34:41.704719 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87673c20-9553-4177-bf72-31abc41eaee7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30ab2b5c51184c4298a4e98a1562e407, user_id=4790ced1b60d4936a186c3fd80f9476e, role_id=c43aada0326446c4ade0ab1262918fa4)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:34:41.707894 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87673c20-9553-4177-bf72-31abc41eaee7 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:34:41.723038 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1146/2265] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:34:41 2022] PUT /identity/v3/projects/30ab2b5c51184c4298a4e98a1562e407/users/4790ced1b60d4936a186c3fd80f9476e/roles/c43aada0326446c4ade0ab1262918fa4 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:34:41.729461 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f36d6-7e65-4058-8ef0-fd249cc96fe6 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:34:41.729849 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f36d6-7e65-4058-8ef0-fd249cc96fe6 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:34:41.730278 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f36d6-7e65-4058-8ef0-fd249cc96fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:34:41.755546 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-dd5f36d6-7e65-4058-8ef0-fd249cc96fe6 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:34:41.756793 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-dd5f36d6-7e65-4058-8ef0-fd249cc96fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:34:41.819272 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1120/2266] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:34:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:34:41.829550 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87673c20-9553-4177-bf72-31abc41eaee7 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:34:41.831458 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-87673c20-9553-4177-bf72-31abc41eaee7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:34:41.847064 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:34:41.893738 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87673c20-9553-4177-bf72-31abc41eaee7 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:34:41.898186 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84f3d44-f626-409e-947b-566733a4bc9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:34:41.898860 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84f3d44-f626-409e-947b-566733a4bc9d service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:34:41.899165 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84f3d44-f626-409e-947b-566733a4bc9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:34:41.899489 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84f3d44-f626-409e-947b-566733a4bc9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:34:41.909729 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84f3d44-f626-409e-947b-566733a4bc9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:34:41.911300 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84f3d44-f626-409e-947b-566733a4bc9d service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:34:41.921355 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1147/2267] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:34:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 03:34:45.897694 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e8d19-f0a6-4a69-965d-2d2474f0ff55 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:34:45.898287 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e8d19-f0a6-4a69-965d-2d2474f0ff55 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:34:45.898287 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e8d19-f0a6-4a69-965d-2d2474f0ff55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:34:45.926901 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-dc9e8d19-f0a6-4a69-965d-2d2474f0ff55 None None] MFA Rules not processed for user `ac2f872367a9463ab4c7c56cec0c79dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:34:45.930623 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-dc9e8d19-f0a6-4a69-965d-2d2474f0ff55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:34:46.055352 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1121/2268] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:34:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:34:46.133931 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478bf150-62bb-48f2-b212-48b8b7f3237b None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:34:46.134497 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478bf150-62bb-48f2-b212-48b8b7f3237b None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:34:46.134497 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478bf150-62bb-48f2-b212-48b8b7f3237b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:34:46.175596 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-478bf150-62bb-48f2-b212-48b8b7f3237b None None] MFA Rules not processed for user `4790ced1b60d4936a186c3fd80f9476e`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:34:46.177074 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-478bf150-62bb-48f2-b212-48b8b7f3237b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:34:46.276385 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1148/2269] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:34:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:34:46.281704 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9e8d19-f0a6-4a69-965d-2d2474f0ff55 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:34:46.294709 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9e8d19-f0a6-4a69-965d-2d2474f0ff55 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:34:46.300629 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a57ea-1738-4701-b624-0e642429e804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:34:46.301490 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a57ea-1738-4701-b624-0e642429e804 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:34:46.301823 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a57ea-1738-4701-b624-0e642429e804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:34:46.302195 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a57ea-1738-4701-b624-0e642429e804 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:34:46.303038 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053a57ea-1738-4701-b624-0e642429e804 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:34:46.305334 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053a57ea-1738-4701-b624-0e642429e804 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:34:46.355033 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1122/2270] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:34:46 2022] POST /identity/v3/projects => generated 383 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:34:46.359015 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478bf150-62bb-48f2-b212-48b8b7f3237b None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:34:46.375295 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478bf150-62bb-48f2-b212-48b8b7f3237b None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:34:46.479524 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ecaf4-a803-463f-9536-162904d6d81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:34:46.480613 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ecaf4-a803-463f-9536-162904d6d81b admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:34:46.480986 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ecaf4-a803-463f-9536-162904d6d81b admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:34:46.481363 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ecaf4-a803-463f-9536-162904d6d81b admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:34:46.482750 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2ecaf4-a803-463f-9536-162904d6d81b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:34:46.484817 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2ecaf4-a803-463f-9536-162904d6d81b admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:34:46.508789 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1149/2271] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:34:46 2022] POST /identity/v3/users => generated 298 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:34:46.512933 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a57ea-1738-4701-b624-0e642429e804 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:34:46.523761 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a57ea-1738-4701-b624-0e642429e804 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:34:46.528659 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb10109f-cb5c-47c7-a96d-7f8709ce9494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:34:46.529349 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10109f-cb5c-47c7-a96d-7f8709ce9494 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:34:46.529622 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10109f-cb5c-47c7-a96d-7f8709ce9494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:34:46.529907 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10109f-cb5c-47c7-a96d-7f8709ce9494 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:34:46.530664 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb10109f-cb5c-47c7-a96d-7f8709ce9494 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:34:46.532438 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb10109f-cb5c-47c7-a96d-7f8709ce9494 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:34:46.549017 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1123/2272] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:34:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:34:46.550086 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ecaf4-a803-463f-9536-162904d6d81b admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:34:46.564836 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ecaf4-a803-463f-9536-162904d6d81b admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:34:46.570410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8612b741-4ead-4177-8b5a-38dd5702085f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:34:46.572074 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8612b741-4ead-4177-8b5a-38dd5702085f admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:34:46.572074 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8612b741-4ead-4177-8b5a-38dd5702085f admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:34:46.572074 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8612b741-4ead-4177-8b5a-38dd5702085f admin admin] PATH_INFO: `/v3/projects/55f46c91b05d45b0951f958309c2a179/users/dd386d02e1f0442d843817a11bfcd44a/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:34:46.589845 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8612b741-4ead-4177-8b5a-38dd5702085f admin admin] RBAC: Authorizing `identity:create_grant(project_id=55f46c91b05d45b0951f958309c2a179, user_id=dd386d02e1f0442d843817a11bfcd44a, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:34:46.592672 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8612b741-4ead-4177-8b5a-38dd5702085f admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:34:46.609714 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1150/2273] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:34:46 2022] PUT /identity/v3/projects/55f46c91b05d45b0951f958309c2a179/users/dd386d02e1f0442d843817a11bfcd44a/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 03:34:46.613675 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb10109f-cb5c-47c7-a96d-7f8709ce9494 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:34:46.625031 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb10109f-cb5c-47c7-a96d-7f8709ce9494 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:34:46.665242 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:34:46.691812 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d3d26f-a914-419d-b8a2-4f76a4d11ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:34:46.692505 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3d26f-a914-419d-b8a2-4f76a4d11ae2 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:34:46.692789 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3d26f-a914-419d-b8a2-4f76a4d11ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:34:46.693068 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3d26f-a914-419d-b8a2-4f76a4d11ae2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:34:46.693808 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d3d26f-a914-419d-b8a2-4f76a4d11ae2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:34:46.695547 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d3d26f-a914-419d-b8a2-4f76a4d11ae2 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:34:46.709901 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1124/2274] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:34:46 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:34:46.714212 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8612b741-4ead-4177-8b5a-38dd5702085f admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:34:46.726354 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8612b741-4ead-4177-8b5a-38dd5702085f admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:34:46.732330 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e8b994-4846-4330-9d46-f52880e8b3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:34:46.733251 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8b994-4846-4330-9d46-f52880e8b3dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:34:46.733582 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8b994-4846-4330-9d46-f52880e8b3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:34:46.733931 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8b994-4846-4330-9d46-f52880e8b3dc admin admin] PATH_INFO: `/v3/projects/55f46c91b05d45b0951f958309c2a179/users/dd386d02e1f0442d843817a11bfcd44a/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:34:46.735985 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e8b994-4846-4330-9d46-f52880e8b3dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=55f46c91b05d45b0951f958309c2a179, user_id=dd386d02e1f0442d843817a11bfcd44a, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:34:46.739338 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e8b994-4846-4330-9d46-f52880e8b3dc admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:34:46.745763 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:34:46.752432 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1151/2275] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:34:46 2022] PUT /identity/v3/projects/55f46c91b05d45b0951f958309c2a179/users/dd386d02e1f0442d843817a11bfcd44a/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:34:51.343867 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d1f79c-5247-4525-8797-9cc113641608 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:34:51.344373 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d1f79c-5247-4525-8797-9cc113641608 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:34:51.344463 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d1f79c-5247-4525-8797-9cc113641608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:34:51.371193 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-32d1f79c-5247-4525-8797-9cc113641608 None None] MFA Rules not processed for user `dd386d02e1f0442d843817a11bfcd44a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:34:51.372752 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-32d1f79c-5247-4525-8797-9cc113641608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:34:51.442912 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1125/2276] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:34:51 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:34:51.454404 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e8b994-4846-4330-9d46-f52880e8b3dc admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:34:51.456250 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-a9e8b994-4846-4330-9d46-f52880e8b3dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:34:51.514974 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e8b994-4846-4330-9d46-f52880e8b3dc admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:34:51.519222 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea02142c-9386-4611-afb5-0bf2853f3417 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6470ccbf858f47bf9bb884476bf4235e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:34:51.519877 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02142c-9386-4611-afb5-0bf2853f3417 service glance] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:34:51.520156 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02142c-9386-4611-afb5-0bf2853f3417 service glance] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:34:51.520431 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02142c-9386-4611-afb5-0bf2853f3417 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:34:51.579212 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea02142c-9386-4611-afb5-0bf2853f3417 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:34:51.580639 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea02142c-9386-4611-afb5-0bf2853f3417 service glance] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:34:51.589633 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1152/2277] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:34:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:34:51.688717 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7eaef0-9f78-478f-ba1a-83f350cbac7f None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:34:51.689003 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7eaef0-9f78-478f-ba1a-83f350cbac7f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:34:51.689285 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7eaef0-9f78-478f-ba1a-83f350cbac7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:34:51.707761 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-7d7eaef0-9f78-478f-ba1a-83f350cbac7f None None] MFA Rules not processed for user `3333e7495b9546d882e2a2211ff8875c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:34:51.709209 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7d7eaef0-9f78-478f-ba1a-83f350cbac7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:34:51.780148 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1126/2278] 10.222.0.60 () {58 vars in 1009 bytes} [Sat Jul 2 03:34:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:34:51.794201 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea02142c-9386-4611-afb5-0bf2853f3417 service glance] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:34:51.796489 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-ea02142c-9386-4611-afb5-0bf2853f3417 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:34:51.895974 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea02142c-9386-4611-afb5-0bf2853f3417 service glance] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:34:51.900999 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dca5e57-c046-440c-b6fa-c0275bd512b2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '692ec343bf9f4339ba691440f55a6c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:34:51.901846 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca5e57-c046-440c-b6fa-c0275bd512b2 service swift] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:34:51.902207 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca5e57-c046-440c-b6fa-c0275bd512b2 service swift] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:34:51.902558 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca5e57-c046-440c-b6fa-c0275bd512b2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:34:51.911786 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dca5e57-c046-440c-b6fa-c0275bd512b2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:34:51.913711 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dca5e57-c046-440c-b6fa-c0275bd512b2 service swift] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:34:51.922636 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1153/2279] 10.222.0.60 () {60 vars in 1384 bytes} [Sat Jul 2 03:34:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 03:35:01.143602 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4192329-bbde-41c3-a21f-239a395c310a None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:35:01.144155 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4192329-bbde-41c3-a21f-239a395c310a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:35:01.144155 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4192329-bbde-41c3-a21f-239a395c310a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:35:01.164008 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-b4192329-bbde-41c3-a21f-239a395c310a None None] MFA Rules not processed for user `4790ced1b60d4936a186c3fd80f9476e`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:35:01.165236 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b4192329-bbde-41c3-a21f-239a395c310a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:35:01.173528 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1127/2280] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:35:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:35:01.452750 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dca5e57-c046-440c-b6fa-c0275bd512b2 service swift] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:35:01.455275 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-1dca5e57-c046-440c-b6fa-c0275bd512b2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:35:01.509792 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:35:01.524047 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dca5e57-c046-440c-b6fa-c0275bd512b2 service swift] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:35:01.528576 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc7b9a4-5152-4f8e-af41-c676ff36910d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:35:01.529227 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc7b9a4-5152-4f8e-af41-c676ff36910d service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:35:01.529508 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc7b9a4-5152-4f8e-af41-c676ff36910d service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:35:01.529786 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc7b9a4-5152-4f8e-af41-c676ff36910d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:35:01.531870 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-efc7b9a4-5152-4f8e-af41-c676ff36910d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:35:01.543541 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc7b9a4-5152-4f8e-af41-c676ff36910d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:35:01.545045 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc7b9a4-5152-4f8e-af41-c676ff36910d service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:35:01.554404 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1154/2281] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:35:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:35:01.894640 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4192329-bbde-41c3-a21f-239a395c310a None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:35:01.896206 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b4192329-bbde-41c3-a21f-239a395c310a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:35:01.957370 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:35:01.972054 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4192329-bbde-41c3-a21f-239a395c310a None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:35:01.976997 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad726cdc-c30f-4968-ab3a-8ccc47575bc4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dafc9be75a64db095fe08b9cbb04cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:35:01.977693 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad726cdc-c30f-4968-ab3a-8ccc47575bc4 service placement] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:35:01.977979 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad726cdc-c30f-4968-ab3a-8ccc47575bc4 service placement] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:35:01.978257 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad726cdc-c30f-4968-ab3a-8ccc47575bc4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:35:01.980089 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ad726cdc-c30f-4968-ab3a-8ccc47575bc4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:35:01.991323 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad726cdc-c30f-4968-ab3a-8ccc47575bc4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:35:01.992913 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad726cdc-c30f-4968-ab3a-8ccc47575bc4 service placement] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:35:02.003435 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1128/2282] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:35:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:35:03.602546 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f782d-8b6e-4177-aeae-508657206c1c None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:35:03.603052 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f782d-8b6e-4177-aeae-508657206c1c None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:35:03.603170 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f782d-8b6e-4177-aeae-508657206c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:35:03.621433 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-d49f782d-8b6e-4177-aeae-508657206c1c None None] MFA Rules not processed for user `3333e7495b9546d882e2a2211ff8875c`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:35:03.622723 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-d49f782d-8b6e-4177-aeae-508657206c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:35:03.631649 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1155/2283] 10.222.0.60 () {58 vars in 1009 bytes} [Sat Jul 2 03:35:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:35:03.644027 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad726cdc-c30f-4968-ab3a-8ccc47575bc4 service placement] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:35:03.655882 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad726cdc-c30f-4968-ab3a-8ccc47575bc4 service placement] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:35:03.661722 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f95e5-e82d-444f-b6c2-433326b6305c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '692ec343bf9f4339ba691440f55a6c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:35:03.662688 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f95e5-e82d-444f-b6c2-433326b6305c service swift] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:35:03.663619 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f95e5-e82d-444f-b6c2-433326b6305c service swift] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:35:03.663619 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f95e5-e82d-444f-b6c2-433326b6305c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:35:03.672228 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6f95e5-e82d-444f-b6c2-433326b6305c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:35:03.673852 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6f95e5-e82d-444f-b6c2-433326b6305c service swift] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:35:03.682438 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1129/2284] 10.222.0.60 () {60 vars in 1384 bytes} [Sat Jul 2 03:35:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 03:35:07.699700 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f782d-8b6e-4177-aeae-508657206c1c None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:35:07.702008 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-d49f782d-8b6e-4177-aeae-508657206c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:35:07.785201 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f782d-8b6e-4177-aeae-508657206c1c None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:35:07.791631 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631e6ab4-f26f-4417-86ad-5e29d580e75f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13530240e2d446b6bf26a431d001362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:35:07.792289 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e6ab4-f26f-4417-86ad-5e29d580e75f service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:35:07.792570 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e6ab4-f26f-4417-86ad-5e29d580e75f service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:35:07.793038 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e6ab4-f26f-4417-86ad-5e29d580e75f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:35:07.794895 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-631e6ab4-f26f-4417-86ad-5e29d580e75f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:35:07.868308 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631e6ab4-f26f-4417-86ad-5e29d580e75f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:35:07.870014 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631e6ab4-f26f-4417-86ad-5e29d580e75f service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:35:07.880435 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1156/2285] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:35:07 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:35:13.678854 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=12 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:35:17.876071 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=66 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:35:18.797868 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f95e5-e82d-444f-b6c2-433326b6305c service swift] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:35:18.812493 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f95e5-e82d-444f-b6c2-433326b6305c service swift] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:35:18.818244 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22218abd-ee1f-41ab-ae03-d91a2756f9c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:35:18.818890 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22218abd-ee1f-41ab-ae03-d91a2756f9c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:35:18.819200 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22218abd-ee1f-41ab-ae03-d91a2756f9c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:35:18.819471 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22218abd-ee1f-41ab-ae03-d91a2756f9c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:35:18.821844 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-22218abd-ee1f-41ab-ae03-d91a2756f9c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:35:18.832415 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22218abd-ee1f-41ab-ae03-d91a2756f9c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:35:18.833988 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22218abd-ee1f-41ab-ae03-d91a2756f9c9 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:35:18.842131 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1130/2286] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:35:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:35:28.838624 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=6 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:35:29.673274 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91ee8b-f661-49d9-907e-06efcbe46e19 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:35:29.673862 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91ee8b-f661-49d9-907e-06efcbe46e19 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:35:29.674053 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91ee8b-f661-49d9-907e-06efcbe46e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:35:29.691863 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-0a91ee8b-f661-49d9-907e-06efcbe46e19 None None] MFA Rules not processed for user `11ccfa53ebb7405d9325a22f0295bf61`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:35:29.693059 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-0a91ee8b-f661-49d9-907e-06efcbe46e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:35:29.700275 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1157/2287] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:35:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:35:33.136927 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22218abd-ee1f-41ab-ae03-d91a2756f9c9 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:35:33.138562 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-22218abd-ee1f-41ab-ae03-d91a2756f9c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:35:33.172880 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22218abd-ee1f-41ab-ae03-d91a2756f9c9 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:35:33.180212 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392161a-d935-4e71-93b5-8789ca315e58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13530240e2d446b6bf26a431d001362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:35:33.180981 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392161a-d935-4e71-93b5-8789ca315e58 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:35:33.181827 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392161a-d935-4e71-93b5-8789ca315e58 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:35:33.182126 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392161a-d935-4e71-93b5-8789ca315e58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:35:33.184326 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4392161a-d935-4e71-93b5-8789ca315e58 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:35:33.198134 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4392161a-d935-4e71-93b5-8789ca315e58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:35:33.199885 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4392161a-d935-4e71-93b5-8789ca315e58 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:35:33.213225 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1131/2288] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:35:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:35:34.535846 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a91ee8b-f661-49d9-907e-06efcbe46e19 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:35:34.546177 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a91ee8b-f661-49d9-907e-06efcbe46e19 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:35:34.551490 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48db07e-18ce-4741-a37f-5fe83da19f3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:35:34.552127 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48db07e-18ce-4741-a37f-5fe83da19f3f service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:35:34.552580 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48db07e-18ce-4741-a37f-5fe83da19f3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:35:34.553038 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48db07e-18ce-4741-a37f-5fe83da19f3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:35:34.563030 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48db07e-18ce-4741-a37f-5fe83da19f3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:35:34.564480 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48db07e-18ce-4741-a37f-5fe83da19f3f service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:35:34.574280 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1158/2289] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:35:34 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:35:40.281700 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392161a-d935-4e71-93b5-8789ca315e58 service nova] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:35:40.294559 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392161a-d935-4e71-93b5-8789ca315e58 service nova] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:35:40.300254 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea0eb78-7cb4-42fa-ab4e-80b6de90200a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13530240e2d446b6bf26a431d001362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:35:40.300970 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea0eb78-7cb4-42fa-ab4e-80b6de90200a service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:35:40.301251 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea0eb78-7cb4-42fa-ab4e-80b6de90200a service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:35:40.301530 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea0eb78-7cb4-42fa-ab4e-80b6de90200a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:35:40.303342 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-aea0eb78-7cb4-42fa-ab4e-80b6de90200a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:35:40.316203 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea0eb78-7cb4-42fa-ab4e-80b6de90200a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:35:40.317792 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea0eb78-7cb4-42fa-ab4e-80b6de90200a service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:35:40.328813 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1132/2290] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:35:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:35:44.569955 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=9 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:35:50.324366 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=12 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:35:55.938874 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48db07e-18ce-4741-a37f-5fe83da19f3f service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:35:55.940472 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-f48db07e-18ce-4741-a37f-5fe83da19f3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:35:56.027798 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48db07e-18ce-4741-a37f-5fe83da19f3f service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:35:56.031966 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea7ce9-29ab-44b4-afc9-1a7bdf0b22f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:35:56.032723 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea7ce9-29ab-44b4-afc9-1a7bdf0b22f3 service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:35:56.032883 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea7ce9-29ab-44b4-afc9-1a7bdf0b22f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:35:56.033157 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea7ce9-29ab-44b4-afc9-1a7bdf0b22f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:35:56.034984 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-0fea7ce9-29ab-44b4-afc9-1a7bdf0b22f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:35:56.103366 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fea7ce9-29ab-44b4-afc9-1a7bdf0b22f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:35:56.104806 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fea7ce9-29ab-44b4-afc9-1a7bdf0b22f3 service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:35:56.114167 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1159/2291] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:35:55 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:35:58.092490 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801be911-026c-45ef-bec9-91e016c3bdcf None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:35:58.093089 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801be911-026c-45ef-bec9-91e016c3bdcf None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:35:58.093089 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801be911-026c-45ef-bec9-91e016c3bdcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:35:58.111496 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-801be911-026c-45ef-bec9-91e016c3bdcf None None] MFA Rules not processed for user `c42a4b22cda34bb68980388f63e822cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:35:58.112758 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-801be911-026c-45ef-bec9-91e016c3bdcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:35:58.168466 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1133/2292] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:35:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:36:00.823470 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea7ce9-29ab-44b4-afc9-1a7bdf0b22f3 service cinder] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:36:00.832479 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea7ce9-29ab-44b4-afc9-1a7bdf0b22f3 service cinder] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:36:00.837206 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7e1157-37bd-42c9-b714-05199788182b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:36:00.837926 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e1157-37bd-42c9-b714-05199788182b service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:00.838247 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e1157-37bd-42c9-b714-05199788182b service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:00.838530 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e1157-37bd-42c9-b714-05199788182b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:00.841321 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-1c7e1157-37bd-42c9-b714-05199788182b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:36:00.916080 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7e1157-37bd-42c9-b714-05199788182b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:36:00.917938 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7e1157-37bd-42c9-b714-05199788182b service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:36:00.927323 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1160/2293] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:36:00 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:36:02.303440 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b6b58-9a05-4664-9757-9936744548c2 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:02.304866 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b6b58-9a05-4664-9757-9936744548c2 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:02.305215 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b6b58-9a05-4664-9757-9936744548c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:02.336258 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-d79b6b58-9a05-4664-9757-9936744548c2 None None] MFA Rules not processed for user `5caffa5bd8804abd96e411fb45383c5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:36:02.337940 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d79b6b58-9a05-4664-9757-9936744548c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:36:02.346071 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1134/2294] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:36:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:36:03.080197 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7e1157-37bd-42c9-b714-05199788182b service cinder] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:36:03.090292 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7e1157-37bd-42c9-b714-05199788182b service cinder] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:36:03.094633 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dc6cdf-9e6e-4563-ab9c-e6a1ca0efef2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:36:03.095446 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc6cdf-9e6e-4563-ab9c-e6a1ca0efef2 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:03.095700 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc6cdf-9e6e-4563-ab9c-e6a1ca0efef2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:03.095966 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc6cdf-9e6e-4563-ab9c-e6a1ca0efef2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:03.098064 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-33dc6cdf-9e6e-4563-ab9c-e6a1ca0efef2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:36:03.108802 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dc6cdf-9e6e-4563-ab9c-e6a1ca0efef2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:36:03.110251 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dc6cdf-9e6e-4563-ab9c-e6a1ca0efef2 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:36:03.119107 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1161/2295] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:36:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:36:12.151646 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b6b58-9a05-4664-9757-9936744548c2 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:36:12.197958 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b6b58-9a05-4664-9757-9936744548c2 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:36:12.204246 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854abdd6-d94e-4123-bbe0-5d9ee367a95e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13530240e2d446b6bf26a431d001362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:36:12.205037 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854abdd6-d94e-4123-bbe0-5d9ee367a95e service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:12.205312 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854abdd6-d94e-4123-bbe0-5d9ee367a95e service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:12.205585 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854abdd6-d94e-4123-bbe0-5d9ee367a95e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:12.208143 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-854abdd6-d94e-4123-bbe0-5d9ee367a95e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:36:12.221951 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854abdd6-d94e-4123-bbe0-5d9ee367a95e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:36:12.227130 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854abdd6-d94e-4123-bbe0-5d9ee367a95e service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:36:12.240904 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1135/2296] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:36:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:36:13.115478 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=91 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:36:18.346547 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dc6cdf-9e6e-4563-ab9c-e6a1ca0efef2 service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:36:18.361082 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dc6cdf-9e6e-4563-ab9c-e6a1ca0efef2 service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:36:18.367144 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba949c-d2d4-4942-ba91-80ac553d5b92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13530240e2d446b6bf26a431d001362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:36:18.368312 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba949c-d2d4-4942-ba91-80ac553d5b92 service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:18.368832 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba949c-d2d4-4942-ba91-80ac553d5b92 service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:18.369347 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba949c-d2d4-4942-ba91-80ac553d5b92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:18.371438 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-26ba949c-d2d4-4942-ba91-80ac553d5b92 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:36:18.389260 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ba949c-d2d4-4942-ba91-80ac553d5b92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:36:18.391470 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ba949c-d2d4-4942-ba91-80ac553d5b92 service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:36:18.415359 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1162/2297] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:36:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:36:22.235522 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=34 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:36:25.565426 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854abdd6-d94e-4123-bbe0-5d9ee367a95e service nova] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:36:25.574841 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854abdd6-d94e-4123-bbe0-5d9ee367a95e service nova] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:36:25.578415 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5abd00-2fa1-4800-8296-07dac21d50db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:36:25.579227 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5abd00-2fa1-4800-8296-07dac21d50db service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:25.579503 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5abd00-2fa1-4800-8296-07dac21d50db service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:25.579772 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5abd00-2fa1-4800-8296-07dac21d50db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:25.581571 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0f5abd00-2fa1-4800-8296-07dac21d50db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:36:25.644796 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5abd00-2fa1-4800-8296-07dac21d50db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:36:25.646149 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5abd00-2fa1-4800-8296-07dac21d50db service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:36:25.655876 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1136/2298] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:36:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:36:28.399373 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=6 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:36:29.103433 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba949c-d2d4-4942-ba91-80ac553d5b92 service nova] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:36:29.116111 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba949c-d2d4-4942-ba91-80ac553d5b92 service nova] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:36:29.121687 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d070ed-d507-48a3-9245-813b5f3ba68a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dafc9be75a64db095fe08b9cbb04cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:36:29.122373 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d070ed-d507-48a3-9245-813b5f3ba68a service placement] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:29.122661 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d070ed-d507-48a3-9245-813b5f3ba68a service placement] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:29.122932 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d070ed-d507-48a3-9245-813b5f3ba68a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:29.124971 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-31d070ed-d507-48a3-9245-813b5f3ba68a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:36:29.139343 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d070ed-d507-48a3-9245-813b5f3ba68a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:36:29.140932 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d070ed-d507-48a3-9245-813b5f3ba68a service placement] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:36:29.152682 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1163/2299] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:36:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:36:29.180814 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5abd00-2fa1-4800-8296-07dac21d50db service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:36:29.182334 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0f5abd00-2fa1-4800-8296-07dac21d50db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:36:29.196348 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5abd00-2fa1-4800-8296-07dac21d50db service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:36:29.201825 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f539c7b-4e7c-4085-8523-d731e5a11bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:36:29.202873 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f539c7b-4e7c-4085-8523-d731e5a11bfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:29.203144 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f539c7b-4e7c-4085-8523-d731e5a11bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:29.203425 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f539c7b-4e7c-4085-8523-d731e5a11bfa admin admin] PATH_INFO: `/v3/users/ac2f872367a9463ab4c7c56cec0c79dc` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:29.204637 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f539c7b-4e7c-4085-8523-d731e5a11bfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac2f872367a9463ab4c7c56cec0c79dc)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:36:29.206675 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f539c7b-4e7c-4085-8523-d731e5a11bfa admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:36:29.265484 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3f539c7b-4e7c-4085-8523-d731e5a11bfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac2f872367a9463ab4c7c56cec0c79dc'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:36:29.266225 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3f539c7b-4e7c-4085-8523-d731e5a11bfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac2f872367a9463ab4c7c56cec0c79dc'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:36:29.266814 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3f539c7b-4e7c-4085-8523-d731e5a11bfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac2f872367a9463ab4c7c56cec0c79dc'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:36:29.278691 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3f539c7b-4e7c-4085-8523-d731e5a11bfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac2f872367a9463ab4c7c56cec0c79dc'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:36:29.286713 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3f539c7b-4e7c-4085-8523-d731e5a11bfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac2f872367a9463ab4c7c56cec0c79dc'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:36:29.301723 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1137/2300] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:36:29 2022] DELETE /identity/v3/users/ac2f872367a9463ab4c7c56cec0c79dc => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:36:29.483296 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d070ed-d507-48a3-9245-813b5f3ba68a service placement] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:36:29.494004 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d070ed-d507-48a3-9245-813b5f3ba68a service placement] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:36:29.557694 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd9980-f339-4c98-89fc-4212531c8c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:36:29.558846 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd9980-f339-4c98-89fc-4212531c8c6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:29.559263 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd9980-f339-4c98-89fc-4212531c8c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:29.559652 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd9980-f339-4c98-89fc-4212531c8c6a admin admin] PATH_INFO: `/v3/projects/61cf8610ee6b4f2dbad28242343ff604` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:29.561224 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cd9980-f339-4c98-89fc-4212531c8c6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=61cf8610ee6b4f2dbad28242343ff604)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:36:29.563576 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cd9980-f339-4c98-89fc-4212531c8c6a admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:36:29.610745 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-64cd9980-f339-4c98-89fc-4212531c8c6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61cf8610ee6b4f2dbad28242343ff604', 'request_id': 'req-64cd9980-f339-4c98-89fc-4212531c8c6a'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:36:29.617154 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-64cd9980-f339-4c98-89fc-4212531c8c6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61cf8610ee6b4f2dbad28242343ff604', 'request_id': 'req-64cd9980-f339-4c98-89fc-4212531c8c6a'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:36:29.624508 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-64cd9980-f339-4c98-89fc-4212531c8c6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61cf8610ee6b4f2dbad28242343ff604', 'request_id': 'req-64cd9980-f339-4c98-89fc-4212531c8c6a'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:36:29.640312 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-64cd9980-f339-4c98-89fc-4212531c8c6a admin admin] The token cache is being invalidate because project 61cf8610ee6b4f2dbad28242343ff604 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:36:29.640602 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-64cd9980-f339-4c98-89fc-4212531c8c6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:36:29.641340 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-64cd9980-f339-4c98-89fc-4212531c8c6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:36:29.643000 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1164/2301] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:36:29 2022] DELETE /identity/v3/projects/61cf8610ee6b4f2dbad28242343ff604 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:36:29.648165 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e59f3d7-953b-464c-a829-8e8b2d1ee747 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:29.648453 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e59f3d7-953b-464c-a829-8e8b2d1ee747 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:29.648736 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e59f3d7-953b-464c-a829-8e8b2d1ee747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:29.674419 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-1e59f3d7-953b-464c-a829-8e8b2d1ee747 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:36:29.677553 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1e59f3d7-953b-464c-a829-8e8b2d1ee747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:36:29.746967 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1138/2302] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:36:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:36:29.754911 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e2ff33-9f34-408c-9e90-cde5fefc9886 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:29.755215 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e2ff33-9f34-408c-9e90-cde5fefc9886 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:29.755525 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e2ff33-9f34-408c-9e90-cde5fefc9886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:29.774494 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-a7e2ff33-9f34-408c-9e90-cde5fefc9886 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:36:29.775755 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-a7e2ff33-9f34-408c-9e90-cde5fefc9886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:36:29.784337 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1165/2303] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:36:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:36:29.789909 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e59f3d7-953b-464c-a829-8e8b2d1ee747 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:36:29.805726 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e59f3d7-953b-464c-a829-8e8b2d1ee747 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:36:29.811731 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b30161-f24b-4799-b8b6-8c05d2161310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:36:29.812451 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b30161-f24b-4799-b8b6-8c05d2161310 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:29.812732 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b30161-f24b-4799-b8b6-8c05d2161310 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:29.813008 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b30161-f24b-4799-b8b6-8c05d2161310 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:29.813742 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b30161-f24b-4799-b8b6-8c05d2161310 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:36:29.814045 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b30161-f24b-4799-b8b6-8c05d2161310 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:36:29.815694 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b30161-f24b-4799-b8b6-8c05d2161310 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:36:29.817185 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:36:29.828877 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1139/2304] 10.222.0.60 () {58 vars in 1152 bytes} [Sat Jul 2 03:36:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:36:29.833259 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e2ff33-9f34-408c-9e90-cde5fefc9886 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:36:29.842733 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e2ff33-9f34-408c-9e90-cde5fefc9886 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:36:29.847879 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d88d404-cca0-433c-9a68-8904f062fdb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:36:29.848524 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88d404-cca0-433c-9a68-8904f062fdb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:29.848805 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88d404-cca0-433c-9a68-8904f062fdb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:29.849072 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88d404-cca0-433c-9a68-8904f062fdb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:29.849754 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d88d404-cca0-433c-9a68-8904f062fdb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:36:29.851699 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d88d404-cca0-433c-9a68-8904f062fdb6 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:36:29.888560 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1166/2305] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:36:29 2022] POST /identity/v3/projects => generated 357 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:36:29.892734 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b30161-f24b-4799-b8b6-8c05d2161310 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:36:29.902824 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b30161-f24b-4799-b8b6-8c05d2161310 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:36:29.957416 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a061b7-19ab-4da7-a2fc-b9ebaae5cde3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:36:29.957976 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a061b7-19ab-4da7-a2fc-b9ebaae5cde3 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:29.958252 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a061b7-19ab-4da7-a2fc-b9ebaae5cde3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:29.958518 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a061b7-19ab-4da7-a2fc-b9ebaae5cde3 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:29.959220 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a061b7-19ab-4da7-a2fc-b9ebaae5cde3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:36:29.961128 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a061b7-19ab-4da7-a2fc-b9ebaae5cde3 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:36:29.985948 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1140/2306] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:36:29 2022] POST /identity/v3/users => generated 279 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:36:29.990219 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d88d404-cca0-433c-9a68-8904f062fdb6 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:36:30.006552 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d88d404-cca0-433c-9a68-8904f062fdb6 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:36:30.016831 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034180e3-6749-45e9-9793-40d04109d415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:36:30.016831 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034180e3-6749-45e9-9793-40d04109d415 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:30.016831 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034180e3-6749-45e9-9793-40d04109d415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:30.017169 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034180e3-6749-45e9-9793-40d04109d415 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:30.017715 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034180e3-6749-45e9-9793-40d04109d415 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:36:30.019387 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034180e3-6749-45e9-9793-40d04109d415 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:36:30.031249 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1167/2307] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:36:29 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 03:36:30.035945 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a061b7-19ab-4da7-a2fc-b9ebaae5cde3 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:36:30.047253 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a061b7-19ab-4da7-a2fc-b9ebaae5cde3 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:36:30.052341 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15956e63-abe3-461a-a8cb-dbb6a0bcbd91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:36:30.052979 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15956e63-abe3-461a-a8cb-dbb6a0bcbd91 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:30.053271 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15956e63-abe3-461a-a8cb-dbb6a0bcbd91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:30.053538 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15956e63-abe3-461a-a8cb-dbb6a0bcbd91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:30.054266 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15956e63-abe3-461a-a8cb-dbb6a0bcbd91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:36:30.055912 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15956e63-abe3-461a-a8cb-dbb6a0bcbd91 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:36:30.065874 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1141/2308] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:36:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:36:30.069948 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034180e3-6749-45e9-9793-40d04109d415 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:36:30.081036 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034180e3-6749-45e9-9793-40d04109d415 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:36:30.086479 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef05e378-be1e-480e-b328-23732d5865dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:36:30.087463 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef05e378-be1e-480e-b328-23732d5865dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:30.087748 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef05e378-be1e-480e-b328-23732d5865dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:30.088024 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef05e378-be1e-480e-b328-23732d5865dd admin admin] PATH_INFO: `/v3/projects/b830e7f167d24b6d826ec09218b8812b/users/b0be9f0b6b9a4eb08b8190553aa95e7b/roles/c43aada0326446c4ade0ab1262918fa4` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:30.102709 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef05e378-be1e-480e-b328-23732d5865dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b830e7f167d24b6d826ec09218b8812b, user_id=b0be9f0b6b9a4eb08b8190553aa95e7b, role_id=c43aada0326446c4ade0ab1262918fa4)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:36:30.105372 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef05e378-be1e-480e-b328-23732d5865dd admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:36:30.120181 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1168/2309] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:36:30 2022] PUT /identity/v3/projects/b830e7f167d24b6d826ec09218b8812b/users/b0be9f0b6b9a4eb08b8190553aa95e7b/roles/c43aada0326446c4ade0ab1262918fa4 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:36:30.131265 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd3c2f-5db5-4f72-99e2-ec46f5cf02ab None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:30.131566 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd3c2f-5db5-4f72-99e2-ec46f5cf02ab None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:30.131831 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd3c2f-5db5-4f72-99e2-ec46f5cf02ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:30.160170 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-c3cd3c2f-5db5-4f72-99e2-ec46f5cf02ab None None] MFA Rules not processed for user `b0be9f0b6b9a4eb08b8190553aa95e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:36:30.161769 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c3cd3c2f-5db5-4f72-99e2-ec46f5cf02ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:36:30.227202 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1142/2310] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:36:30 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:36:30.231806 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef05e378-be1e-480e-b328-23732d5865dd admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:36:30.238030 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:36:30.303168 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef05e378-be1e-480e-b328-23732d5865dd admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:36:30.308534 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40229e5-3735-47cb-a669-0e7403202c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:36:30.309193 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40229e5-3735-47cb-a669-0e7403202c85 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:30.309474 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40229e5-3735-47cb-a669-0e7403202c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:30.309746 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40229e5-3735-47cb-a669-0e7403202c85 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:30.310429 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40229e5-3735-47cb-a669-0e7403202c85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:36:30.312463 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40229e5-3735-47cb-a669-0e7403202c85 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:36:30.340083 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1169/2311] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:36:30 2022] POST /identity/v3/projects => generated 357 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:36:30.344316 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd3c2f-5db5-4f72-99e2-ec46f5cf02ab None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:36:30.354923 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd3c2f-5db5-4f72-99e2-ec46f5cf02ab None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:36:30.412658 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7106df-db17-4b2a-9b09-df78f18809c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:36:30.413339 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7106df-db17-4b2a-9b09-df78f18809c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:30.413620 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7106df-db17-4b2a-9b09-df78f18809c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:30.413898 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7106df-db17-4b2a-9b09-df78f18809c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:30.414618 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7106df-db17-4b2a-9b09-df78f18809c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:36:30.416604 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7106df-db17-4b2a-9b09-df78f18809c9 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:36:30.424227 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:36:30.441693 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1143/2312] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:36:30 2022] POST /identity/v3/users => generated 285 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:36:30.445821 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40229e5-3735-47cb-a669-0e7403202c85 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:36:30.456620 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40229e5-3735-47cb-a669-0e7403202c85 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:36:30.462038 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33965013-6e59-4c2d-b100-3dc88067dced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:36:30.462712 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33965013-6e59-4c2d-b100-3dc88067dced admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:30.462997 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33965013-6e59-4c2d-b100-3dc88067dced admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:30.463305 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33965013-6e59-4c2d-b100-3dc88067dced admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:30.464052 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33965013-6e59-4c2d-b100-3dc88067dced admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:36:30.465723 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33965013-6e59-4c2d-b100-3dc88067dced admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:36:30.476854 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1170/2313] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:36:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 03:36:30.481211 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7106df-db17-4b2a-9b09-df78f18809c9 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:36:30.491152 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7106df-db17-4b2a-9b09-df78f18809c9 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:36:30.496018 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518eebc8-25e0-4654-9e34-416aed27c433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:36:30.496883 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518eebc8-25e0-4654-9e34-416aed27c433 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:30.497156 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518eebc8-25e0-4654-9e34-416aed27c433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:30.497421 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518eebc8-25e0-4654-9e34-416aed27c433 admin admin] PATH_INFO: `/v3/projects/5e0c91bb15614cf8ac18f24e967b5325/users/a32dc60fd50f43009ae629fd3183b6be/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:30.512585 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518eebc8-25e0-4654-9e34-416aed27c433 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e0c91bb15614cf8ac18f24e967b5325, user_id=a32dc60fd50f43009ae629fd3183b6be, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:36:30.515273 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518eebc8-25e0-4654-9e34-416aed27c433 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:36:30.531827 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1144/2314] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:36:30 2022] PUT /identity/v3/projects/5e0c91bb15614cf8ac18f24e967b5325/users/a32dc60fd50f43009ae629fd3183b6be/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:36:30.536222 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33965013-6e59-4c2d-b100-3dc88067dced admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:36:30.546919 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33965013-6e59-4c2d-b100-3dc88067dced admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:36:30.603900 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f040aa-cd69-40b4-bc39-aaf7f3e8fc04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:36:30.604558 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f040aa-cd69-40b4-bc39-aaf7f3e8fc04 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:30.604838 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f040aa-cd69-40b4-bc39-aaf7f3e8fc04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:30.605111 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f040aa-cd69-40b4-bc39-aaf7f3e8fc04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:30.605844 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f040aa-cd69-40b4-bc39-aaf7f3e8fc04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:36:30.607487 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f040aa-cd69-40b4-bc39-aaf7f3e8fc04 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:36:30.617154 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1171/2315] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:36:30 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:36:30.621393 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518eebc8-25e0-4654-9e34-416aed27c433 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:36:30.632562 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518eebc8-25e0-4654-9e34-416aed27c433 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:36:30.638069 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd811d8-32bc-4cee-852a-7fdec22b475a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:36:30.638964 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd811d8-32bc-4cee-852a-7fdec22b475a admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:30.639296 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd811d8-32bc-4cee-852a-7fdec22b475a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:30.639574 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd811d8-32bc-4cee-852a-7fdec22b475a admin admin] PATH_INFO: `/v3/projects/5e0c91bb15614cf8ac18f24e967b5325/users/a32dc60fd50f43009ae629fd3183b6be/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:30.641703 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd811d8-32bc-4cee-852a-7fdec22b475a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e0c91bb15614cf8ac18f24e967b5325, user_id=a32dc60fd50f43009ae629fd3183b6be, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:36:30.644437 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd811d8-32bc-4cee-852a-7fdec22b475a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:36:30.655192 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1145/2316] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:36:30 2022] PUT /identity/v3/projects/5e0c91bb15614cf8ac18f24e967b5325/users/a32dc60fd50f43009ae629fd3183b6be/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:36:30.665664 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2a59d-dbdb-4158-b7e4-6c1fea72d622 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:30.665949 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2a59d-dbdb-4158-b7e4-6c1fea72d622 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:30.666220 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2a59d-dbdb-4158-b7e4-6c1fea72d622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:30.693512 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-36a2a59d-dbdb-4158-b7e4-6c1fea72d622 None None] MFA Rules not processed for user `a32dc60fd50f43009ae629fd3183b6be`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:36:30.694715 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-36a2a59d-dbdb-4158-b7e4-6c1fea72d622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:36:30.760760 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:36:30.765330 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1172/2317] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:36:30 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:36:30.776794 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd811d8-32bc-4cee-852a-7fdec22b475a admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:36:30.778920 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-cfd811d8-32bc-4cee-852a-7fdec22b475a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:36:30.838335 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd811d8-32bc-4cee-852a-7fdec22b475a admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:36:30.842653 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143a9652-d4a0-422a-87ad-726d6c18144a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:36:30.843353 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143a9652-d4a0-422a-87ad-726d6c18144a service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:30.843635 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143a9652-d4a0-422a-87ad-726d6c18144a service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:30.843905 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143a9652-d4a0-422a-87ad-726d6c18144a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:30.853828 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143a9652-d4a0-422a-87ad-726d6c18144a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:36:30.855278 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143a9652-d4a0-422a-87ad-726d6c18144a service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:36:30.865644 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1146/2318] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:36:30 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:36:30.941544 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a2a59d-dbdb-4158-b7e4-6c1fea72d622 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:36:30.952612 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a2a59d-dbdb-4158-b7e4-6c1fea72d622 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:36:30.956819 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad4d223-bc0f-4443-be72-c60f775997d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:36:30.957459 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad4d223-bc0f-4443-be72-c60f775997d2 service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:30.957742 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad4d223-bc0f-4443-be72-c60f775997d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:30.958007 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad4d223-bc0f-4443-be72-c60f775997d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:31.014948 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad4d223-bc0f-4443-be72-c60f775997d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:36:31.016308 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad4d223-bc0f-4443-be72-c60f775997d2 service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:36:31.025480 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1173/2319] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:36:30 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:36:40.861354 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:INSERT=4,keystone:SELECT=43 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:36:41.021582 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=28 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:36:46.159448 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143a9652-d4a0-422a-87ad-726d6c18144a service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:36:46.222403 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143a9652-d4a0-422a-87ad-726d6c18144a service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:36:46.227301 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936bc879-8669-4242-9b85-6dd310be28d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:36:46.228232 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936bc879-8669-4242-9b85-6dd310be28d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:46.228513 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936bc879-8669-4242-9b85-6dd310be28d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:46.228790 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936bc879-8669-4242-9b85-6dd310be28d4 admin admin] PATH_INFO: `/v3/users/b0be9f0b6b9a4eb08b8190553aa95e7b` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:46.230013 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936bc879-8669-4242-9b85-6dd310be28d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0be9f0b6b9a4eb08b8190553aa95e7b)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:36:46.232041 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936bc879-8669-4242-9b85-6dd310be28d4 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:36:46.281701 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-936bc879-8669-4242-9b85-6dd310be28d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0be9f0b6b9a4eb08b8190553aa95e7b'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:36:46.282373 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-936bc879-8669-4242-9b85-6dd310be28d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0be9f0b6b9a4eb08b8190553aa95e7b'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:36:46.282974 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-936bc879-8669-4242-9b85-6dd310be28d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0be9f0b6b9a4eb08b8190553aa95e7b'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:36:46.295463 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-936bc879-8669-4242-9b85-6dd310be28d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0be9f0b6b9a4eb08b8190553aa95e7b'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:36:46.302126 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-936bc879-8669-4242-9b85-6dd310be28d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0be9f0b6b9a4eb08b8190553aa95e7b'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:36:46.320820 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1147/2320] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:36:46 2022] DELETE /identity/v3/users/b0be9f0b6b9a4eb08b8190553aa95e7b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:36:46.327542 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c1b61-9ade-4d90-96cf-03e83f8f8345 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:46.328030 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c1b61-9ade-4d90-96cf-03e83f8f8345 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:46.328141 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c1b61-9ade-4d90-96cf-03e83f8f8345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:46.347719 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-c64c1b61-9ade-4d90-96cf-03e83f8f8345 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:36:46.348958 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-c64c1b61-9ade-4d90-96cf-03e83f8f8345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:36:46.411265 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1174/2321] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:36:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:36:46.421185 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936bc879-8669-4242-9b85-6dd310be28d4 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:36:46.422694 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-936bc879-8669-4242-9b85-6dd310be28d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:36:46.481482 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936bc879-8669-4242-9b85-6dd310be28d4 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:36:46.485465 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da02ce69-d01e-4ed1-a92b-b0290c839739 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:36:46.486103 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02ce69-d01e-4ed1-a92b-b0290c839739 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:46.486380 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02ce69-d01e-4ed1-a92b-b0290c839739 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:46.486650 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02ce69-d01e-4ed1-a92b-b0290c839739 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:46.496127 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da02ce69-d01e-4ed1-a92b-b0290c839739 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:36:46.497578 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da02ce69-d01e-4ed1-a92b-b0290c839739 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:36:46.507141 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1148/2322] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:36:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:36:46.791354 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c1b61-9ade-4d90-96cf-03e83f8f8345 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:36:46.792903 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-c64c1b61-9ade-4d90-96cf-03e83f8f8345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:36:46.807724 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c1b61-9ade-4d90-96cf-03e83f8f8345 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:36:46.814186 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d91ead-979d-4035-b9bf-343f6145906b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:36:46.815067 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d91ead-979d-4035-b9bf-343f6145906b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:46.815295 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d91ead-979d-4035-b9bf-343f6145906b admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:46.815572 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d91ead-979d-4035-b9bf-343f6145906b admin admin] PATH_INFO: `/v3/projects/b830e7f167d24b6d826ec09218b8812b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:46.816911 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d91ead-979d-4035-b9bf-343f6145906b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b830e7f167d24b6d826ec09218b8812b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:36:46.819173 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d91ead-979d-4035-b9bf-343f6145906b admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:36:46.869875 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d1d91ead-979d-4035-b9bf-343f6145906b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b830e7f167d24b6d826ec09218b8812b', 'request_id': 'req-d1d91ead-979d-4035-b9bf-343f6145906b'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:36:46.875329 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d1d91ead-979d-4035-b9bf-343f6145906b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b830e7f167d24b6d826ec09218b8812b', 'request_id': 'req-d1d91ead-979d-4035-b9bf-343f6145906b'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:36:46.881595 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d1d91ead-979d-4035-b9bf-343f6145906b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b830e7f167d24b6d826ec09218b8812b', 'request_id': 'req-d1d91ead-979d-4035-b9bf-343f6145906b'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:36:46.895823 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d1d91ead-979d-4035-b9bf-343f6145906b admin admin] The token cache is being invalidate because project b830e7f167d24b6d826ec09218b8812b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:36:46.896107 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d1d91ead-979d-4035-b9bf-343f6145906b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:36:46.896716 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d1d91ead-979d-4035-b9bf-343f6145906b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:36:46.898274 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1175/2323] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:36:46 2022] DELETE /identity/v3/projects/b830e7f167d24b6d826ec09218b8812b => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:36:46.902288 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da02ce69-d01e-4ed1-a92b-b0290c839739 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:36:46.912332 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da02ce69-d01e-4ed1-a92b-b0290c839739 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:36:46.947171 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:36:46.997237 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af31d54-827f-4731-a70f-7c6f68b5940e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:36:46.998145 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af31d54-827f-4731-a70f-7c6f68b5940e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:46.998402 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af31d54-827f-4731-a70f-7c6f68b5940e admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:46.998667 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af31d54-827f-4731-a70f-7c6f68b5940e admin admin] PATH_INFO: `/v3/users/a32dc60fd50f43009ae629fd3183b6be` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:46.999996 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af31d54-827f-4731-a70f-7c6f68b5940e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a32dc60fd50f43009ae629fd3183b6be)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:36:47.001908 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af31d54-827f-4731-a70f-7c6f68b5940e admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:36:47.058174 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4af31d54-827f-4731-a70f-7c6f68b5940e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a32dc60fd50f43009ae629fd3183b6be'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:36:47.058874 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4af31d54-827f-4731-a70f-7c6f68b5940e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a32dc60fd50f43009ae629fd3183b6be'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:36:47.059621 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4af31d54-827f-4731-a70f-7c6f68b5940e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a32dc60fd50f43009ae629fd3183b6be'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:36:47.072196 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4af31d54-827f-4731-a70f-7c6f68b5940e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a32dc60fd50f43009ae629fd3183b6be'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:36:47.079651 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4af31d54-827f-4731-a70f-7c6f68b5940e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a32dc60fd50f43009ae629fd3183b6be'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:36:47.096077 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1149/2324] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:36:46 2022] DELETE /identity/v3/users/a32dc60fd50f43009ae629fd3183b6be => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:36:47.388616 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d91ead-979d-4035-b9bf-343f6145906b admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:36:47.390103 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-d1d91ead-979d-4035-b9bf-343f6145906b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:36:47.404360 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d91ead-979d-4035-b9bf-343f6145906b admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:36:47.465228 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbff7de-258d-4208-91c8-2ffd18f25b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:36:47.466113 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbff7de-258d-4208-91c8-2ffd18f25b51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:47.466377 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbff7de-258d-4208-91c8-2ffd18f25b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:47.466644 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbff7de-258d-4208-91c8-2ffd18f25b51 admin admin] PATH_INFO: `/v3/projects/5e0c91bb15614cf8ac18f24e967b5325` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:47.468010 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbff7de-258d-4208-91c8-2ffd18f25b51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e0c91bb15614cf8ac18f24e967b5325)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:36:47.469938 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbff7de-258d-4208-91c8-2ffd18f25b51 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:36:47.503332 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:36:47.521754 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-3dbff7de-258d-4208-91c8-2ffd18f25b51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e0c91bb15614cf8ac18f24e967b5325', 'request_id': 'req-3dbff7de-258d-4208-91c8-2ffd18f25b51'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:36:47.527615 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-3dbff7de-258d-4208-91c8-2ffd18f25b51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e0c91bb15614cf8ac18f24e967b5325', 'request_id': 'req-3dbff7de-258d-4208-91c8-2ffd18f25b51'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:36:47.533822 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-3dbff7de-258d-4208-91c8-2ffd18f25b51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e0c91bb15614cf8ac18f24e967b5325', 'request_id': 'req-3dbff7de-258d-4208-91c8-2ffd18f25b51'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:36:47.548534 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-3dbff7de-258d-4208-91c8-2ffd18f25b51 admin admin] The token cache is being invalidate because project 5e0c91bb15614cf8ac18f24e967b5325 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:36:47.548819 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-3dbff7de-258d-4208-91c8-2ffd18f25b51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:36:47.549464 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-3dbff7de-258d-4208-91c8-2ffd18f25b51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:36:47.551006 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1176/2325] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:36:47 2022] DELETE /identity/v3/projects/5e0c91bb15614cf8ac18f24e967b5325 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:36:47.556061 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3a4c4-c474-4255-81bc-d68d45026bc2 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:47.556540 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3a4c4-c474-4255-81bc-d68d45026bc2 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:47.556639 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3a4c4-c474-4255-81bc-d68d45026bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:47.575048 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-bef3a4c4-c474-4255-81bc-d68d45026bc2 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:36:47.576268 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-bef3a4c4-c474-4255-81bc-d68d45026bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:36:47.638355 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1150/2326] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:36:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:36:47.652490 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388aff8-8012-422b-aec9-9ff069b87a1e None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:47.652966 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388aff8-8012-422b-aec9-9ff069b87a1e None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:47.653425 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388aff8-8012-422b-aec9-9ff069b87a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:47.678488 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-b388aff8-8012-422b-aec9-9ff069b87a1e None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:36:47.679969 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-b388aff8-8012-422b-aec9-9ff069b87a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:36:47.689445 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1177/2327] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:36:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:36:47.694477 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef3a4c4-c474-4255-81bc-d68d45026bc2 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:36:47.709804 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef3a4c4-c474-4255-81bc-d68d45026bc2 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:36:47.718184 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98456426-8443-4d41-bf8e-3662a363ab1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:36:47.719153 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98456426-8443-4d41-bf8e-3662a363ab1e admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:47.719645 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98456426-8443-4d41-bf8e-3662a363ab1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:47.720068 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98456426-8443-4d41-bf8e-3662a363ab1e admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:47.721123 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98456426-8443-4d41-bf8e-3662a363ab1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:36:47.721488 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98456426-8443-4d41-bf8e-3662a363ab1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:36:47.723958 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98456426-8443-4d41-bf8e-3662a363ab1e admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:36:47.736359 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1151/2328] 10.222.0.60 () {58 vars in 1152 bytes} [Sat Jul 2 03:36:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:36:47.740998 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b388aff8-8012-422b-aec9-9ff069b87a1e None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:36:47.750852 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b388aff8-8012-422b-aec9-9ff069b87a1e None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:36:47.756497 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178360b0-7f5b-4f57-9bd4-cd42d3c9587a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:36:47.757084 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178360b0-7f5b-4f57-9bd4-cd42d3c9587a admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:47.757368 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178360b0-7f5b-4f57-9bd4-cd42d3c9587a admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:47.757642 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178360b0-7f5b-4f57-9bd4-cd42d3c9587a admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:47.758332 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178360b0-7f5b-4f57-9bd4-cd42d3c9587a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:36:47.760291 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178360b0-7f5b-4f57-9bd4-cd42d3c9587a admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:36:47.789878 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1178/2329] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:36:47 2022] POST /identity/v3/projects => generated 363 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:36:47.793954 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98456426-8443-4d41-bf8e-3662a363ab1e admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:36:47.804138 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98456426-8443-4d41-bf8e-3662a363ab1e admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:36:47.829536 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:36:47.860560 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83abe945-0cf2-496e-b7aa-020b8a28745f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:36:47.861220 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83abe945-0cf2-496e-b7aa-020b8a28745f admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:47.861501 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83abe945-0cf2-496e-b7aa-020b8a28745f admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:47.861776 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83abe945-0cf2-496e-b7aa-020b8a28745f admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:47.862462 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83abe945-0cf2-496e-b7aa-020b8a28745f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:36:47.864426 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83abe945-0cf2-496e-b7aa-020b8a28745f admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:36:47.885747 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1152/2330] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:36:47 2022] POST /identity/v3/users => generated 282 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:36:47.890225 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178360b0-7f5b-4f57-9bd4-cd42d3c9587a admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:36:47.900834 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178360b0-7f5b-4f57-9bd4-cd42d3c9587a admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:36:47.905567 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24940fb5-4741-4de1-8944-99cabc5c38bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:36:47.906246 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24940fb5-4741-4de1-8944-99cabc5c38bd admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:47.906525 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24940fb5-4741-4de1-8944-99cabc5c38bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:47.906800 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24940fb5-4741-4de1-8944-99cabc5c38bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:47.907566 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24940fb5-4741-4de1-8944-99cabc5c38bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:36:47.909225 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24940fb5-4741-4de1-8944-99cabc5c38bd admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:36:47.920771 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1179/2331] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:36:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:36:47.925100 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83abe945-0cf2-496e-b7aa-020b8a28745f admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:36:47.935730 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83abe945-0cf2-496e-b7aa-020b8a28745f admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:36:47.941653 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db63453f-2379-4821-b2c2-28df9b21aeea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:36:47.942320 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63453f-2379-4821-b2c2-28df9b21aeea admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:47.942603 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63453f-2379-4821-b2c2-28df9b21aeea admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:47.942878 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63453f-2379-4821-b2c2-28df9b21aeea admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:47.945909 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db63453f-2379-4821-b2c2-28df9b21aeea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:36:47.945909 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db63453f-2379-4821-b2c2-28df9b21aeea admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:36:47.955550 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1153/2332] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:36:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:36:47.960369 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24940fb5-4741-4de1-8944-99cabc5c38bd admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:36:47.976166 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24940fb5-4741-4de1-8944-99cabc5c38bd admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:36:47.984395 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68500942-d11a-4430-8398-afc3a8f55cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:36:47.985827 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68500942-d11a-4430-8398-afc3a8f55cdc admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:47.986223 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68500942-d11a-4430-8398-afc3a8f55cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:47.986641 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68500942-d11a-4430-8398-afc3a8f55cdc admin admin] PATH_INFO: `/v3/projects/5fbd936d9a654aff8f86cadc0bb952e6/users/66040f417f8d43cfb41c841e35a579ef/roles/c43aada0326446c4ade0ab1262918fa4` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:48.005363 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68500942-d11a-4430-8398-afc3a8f55cdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fbd936d9a654aff8f86cadc0bb952e6, user_id=66040f417f8d43cfb41c841e35a579ef, role_id=c43aada0326446c4ade0ab1262918fa4)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:36:48.008118 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68500942-d11a-4430-8398-afc3a8f55cdc admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:36:48.024340 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1180/2333] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:36:47 2022] PUT /identity/v3/projects/5fbd936d9a654aff8f86cadc0bb952e6/users/66040f417f8d43cfb41c841e35a579ef/roles/c43aada0326446c4ade0ab1262918fa4 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:36:48.034812 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c7e74-f3e0-4ddd-b339-07a793584d22 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:48.035443 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c7e74-f3e0-4ddd-b339-07a793584d22 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:48.035711 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c7e74-f3e0-4ddd-b339-07a793584d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:48.063642 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-372c7e74-f3e0-4ddd-b339-07a793584d22 None None] MFA Rules not processed for user `66040f417f8d43cfb41c841e35a579ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:36:48.064835 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-372c7e74-f3e0-4ddd-b339-07a793584d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:36:48.129824 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1154/2334] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:36:48 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:36:48.134592 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68500942-d11a-4430-8398-afc3a8f55cdc admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:36:48.202628 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68500942-d11a-4430-8398-afc3a8f55cdc admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:36:48.207496 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c9b8c3-57ef-4836-b2a4-e6db8a668680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:36:48.208166 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9b8c3-57ef-4836-b2a4-e6db8a668680 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:48.208486 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9b8c3-57ef-4836-b2a4-e6db8a668680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:48.208794 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9b8c3-57ef-4836-b2a4-e6db8a668680 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:48.209453 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c9b8c3-57ef-4836-b2a4-e6db8a668680 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:36:48.211406 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c9b8c3-57ef-4836-b2a4-e6db8a668680 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:36:48.239705 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1181/2335] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:36:48 2022] POST /identity/v3/projects => generated 365 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:36:48.243897 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372c7e74-f3e0-4ddd-b339-07a793584d22 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:36:48.255633 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372c7e74-f3e0-4ddd-b339-07a793584d22 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:36:48.313690 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5117a4-628b-463f-8aa1-5bebcd7f4fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:36:48.314280 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5117a4-628b-463f-8aa1-5bebcd7f4fa0 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:48.314559 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5117a4-628b-463f-8aa1-5bebcd7f4fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:48.314835 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5117a4-628b-463f-8aa1-5bebcd7f4fa0 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:48.315538 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5117a4-628b-463f-8aa1-5bebcd7f4fa0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:36:48.317509 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5117a4-628b-463f-8aa1-5bebcd7f4fa0 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:36:48.339049 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1155/2336] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:36:48 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:36:48.343331 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c9b8c3-57ef-4836-b2a4-e6db8a668680 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:36:48.354334 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c9b8c3-57ef-4836-b2a4-e6db8a668680 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:36:48.359394 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542503dc-aa8c-46c5-8d41-bc0e44d70da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:36:48.360056 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542503dc-aa8c-46c5-8d41-bc0e44d70da3 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:48.360334 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542503dc-aa8c-46c5-8d41-bc0e44d70da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:48.360605 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542503dc-aa8c-46c5-8d41-bc0e44d70da3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:48.361369 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542503dc-aa8c-46c5-8d41-bc0e44d70da3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:36:48.362965 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542503dc-aa8c-46c5-8d41-bc0e44d70da3 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:36:48.374227 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1182/2337] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:36:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 03:36:48.378537 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5117a4-628b-463f-8aa1-5bebcd7f4fa0 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:36:48.392627 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5117a4-628b-463f-8aa1-5bebcd7f4fa0 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:36:48.399440 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d96f24-6418-4c36-9d91-adb21306f0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:36:48.400336 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d96f24-6418-4c36-9d91-adb21306f0be admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:48.400616 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d96f24-6418-4c36-9d91-adb21306f0be admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:48.400892 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d96f24-6418-4c36-9d91-adb21306f0be admin admin] PATH_INFO: `/v3/projects/93e8ba20c14a41478c18e40a66c78398/users/ade958eb98314948b03c9368e1473a5b/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:48.417872 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d96f24-6418-4c36-9d91-adb21306f0be admin admin] RBAC: Authorizing `identity:create_grant(project_id=93e8ba20c14a41478c18e40a66c78398, user_id=ade958eb98314948b03c9368e1473a5b, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:36:48.420696 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d96f24-6418-4c36-9d91-adb21306f0be admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:36:48.435336 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1156/2338] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:36:48 2022] PUT /identity/v3/projects/93e8ba20c14a41478c18e40a66c78398/users/ade958eb98314948b03c9368e1473a5b/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:36:48.439540 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542503dc-aa8c-46c5-8d41-bc0e44d70da3 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:36:48.450004 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542503dc-aa8c-46c5-8d41-bc0e44d70da3 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:36:48.470213 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:36:48.508754 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d4662-86cc-42dc-ada6-4c424aff4e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:36:48.509447 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d4662-86cc-42dc-ada6-4c424aff4e4f admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:48.509733 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d4662-86cc-42dc-ada6-4c424aff4e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:48.510006 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d4662-86cc-42dc-ada6-4c424aff4e4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:48.510735 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331d4662-86cc-42dc-ada6-4c424aff4e4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:36:48.512386 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331d4662-86cc-42dc-ada6-4c424aff4e4f admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:36:48.522466 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1183/2339] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:36:48 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:36:48.526726 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d96f24-6418-4c36-9d91-adb21306f0be admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:36:48.532300 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:36:48.539071 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d96f24-6418-4c36-9d91-adb21306f0be admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:36:48.544324 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e171b6a-636b-4f4e-8ae4-921e099de8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:36:48.545213 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e171b6a-636b-4f4e-8ae4-921e099de8de admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:48.545496 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e171b6a-636b-4f4e-8ae4-921e099de8de admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:48.545773 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e171b6a-636b-4f4e-8ae4-921e099de8de admin admin] PATH_INFO: `/v3/projects/93e8ba20c14a41478c18e40a66c78398/users/ade958eb98314948b03c9368e1473a5b/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:48.547832 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e171b6a-636b-4f4e-8ae4-921e099de8de admin admin] RBAC: Authorizing `identity:create_grant(project_id=93e8ba20c14a41478c18e40a66c78398, user_id=ade958eb98314948b03c9368e1473a5b, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:36:48.550504 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e171b6a-636b-4f4e-8ae4-921e099de8de admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:36:48.561277 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1157/2340] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:36:48 2022] PUT /identity/v3/projects/93e8ba20c14a41478c18e40a66c78398/users/ade958eb98314948b03c9368e1473a5b/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:36:48.572578 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d281b-522c-4143-a6e8-9f16192e9838 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:48.572755 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d281b-522c-4143-a6e8-9f16192e9838 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:48.573063 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d281b-522c-4143-a6e8-9f16192e9838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:48.600577 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-6a6d281b-522c-4143-a6e8-9f16192e9838 None None] MFA Rules not processed for user `ade958eb98314948b03c9368e1473a5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:36:48.602354 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-6a6d281b-522c-4143-a6e8-9f16192e9838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:36:48.678614 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1184/2341] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:36:48 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:36:48.694829 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e171b6a-636b-4f4e-8ae4-921e099de8de admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:36:48.697011 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3e171b6a-636b-4f4e-8ae4-921e099de8de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:36:48.770790 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e171b6a-636b-4f4e-8ae4-921e099de8de admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:36:48.775346 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d99ff3-6fef-4e79-a554-2f677a159cd4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:36:48.775995 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d99ff3-6fef-4e79-a554-2f677a159cd4 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:48.776274 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d99ff3-6fef-4e79-a554-2f677a159cd4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:48.776544 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d99ff3-6fef-4e79-a554-2f677a159cd4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:48.786451 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d99ff3-6fef-4e79-a554-2f677a159cd4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:36:48.787958 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d99ff3-6fef-4e79-a554-2f677a159cd4 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:36:48.797368 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1158/2342] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:36:48 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:36:48.872701 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d281b-522c-4143-a6e8-9f16192e9838 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:36:48.882768 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d281b-522c-4143-a6e8-9f16192e9838 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:36:48.886741 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b256d5-0690-4f42-8efe-6e09c7adc709 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:36:48.887439 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b256d5-0690-4f42-8efe-6e09c7adc709 service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:48.887712 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b256d5-0690-4f42-8efe-6e09c7adc709 service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:48.887979 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b256d5-0690-4f42-8efe-6e09c7adc709 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:48.952262 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b256d5-0690-4f42-8efe-6e09c7adc709 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:36:48.953786 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b256d5-0690-4f42-8efe-6e09c7adc709 service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:36:48.966497 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1185/2343] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:36:48 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:36:51.726132 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d99ff3-6fef-4e79-a554-2f677a159cd4 service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:36:51.790305 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d99ff3-6fef-4e79-a554-2f677a159cd4 service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:36:51.795717 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682be637-2f7a-4a21-abb8-b5e11a655b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:36:51.796590 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682be637-2f7a-4a21-abb8-b5e11a655b3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:51.796867 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682be637-2f7a-4a21-abb8-b5e11a655b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:51.797125 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682be637-2f7a-4a21-abb8-b5e11a655b3f admin admin] PATH_INFO: `/v3/users/66040f417f8d43cfb41c841e35a579ef` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:51.798439 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682be637-2f7a-4a21-abb8-b5e11a655b3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=66040f417f8d43cfb41c841e35a579ef)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:36:51.800435 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682be637-2f7a-4a21-abb8-b5e11a655b3f admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:36:51.852280 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-682be637-2f7a-4a21-abb8-b5e11a655b3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66040f417f8d43cfb41c841e35a579ef'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:36:51.852939 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-682be637-2f7a-4a21-abb8-b5e11a655b3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66040f417f8d43cfb41c841e35a579ef'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:36:51.853640 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-682be637-2f7a-4a21-abb8-b5e11a655b3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66040f417f8d43cfb41c841e35a579ef'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:36:51.866253 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-682be637-2f7a-4a21-abb8-b5e11a655b3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66040f417f8d43cfb41c841e35a579ef'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:36:51.873339 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-682be637-2f7a-4a21-abb8-b5e11a655b3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66040f417f8d43cfb41c841e35a579ef'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:36:51.888343 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1159/2344] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:36:51 2022] DELETE /identity/v3/users/66040f417f8d43cfb41c841e35a579ef => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:36:51.893043 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce48750f-83be-4671-a484-4fa247c8dacc None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:51.893568 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce48750f-83be-4671-a484-4fa247c8dacc None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:51.893680 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce48750f-83be-4671-a484-4fa247c8dacc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:51.911893 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-ce48750f-83be-4671-a484-4fa247c8dacc None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:36:51.913216 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-ce48750f-83be-4671-a484-4fa247c8dacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:36:51.957752 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:36:51.982046 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1186/2345] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:36:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:36:51.991945 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682be637-2f7a-4a21-abb8-b5e11a655b3f admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:36:51.993643 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-682be637-2f7a-4a21-abb8-b5e11a655b3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:36:52.007925 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:36:52.053488 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682be637-2f7a-4a21-abb8-b5e11a655b3f admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:36:52.057570 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce05b929-9063-4f05-8097-512a899954bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:36:52.058210 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05b929-9063-4f05-8097-512a899954bc service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:52.058488 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05b929-9063-4f05-8097-512a899954bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:52.058759 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05b929-9063-4f05-8097-512a899954bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:52.068012 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce05b929-9063-4f05-8097-512a899954bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:36:52.069501 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce05b929-9063-4f05-8097-512a899954bc service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:36:52.078938 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1160/2346] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:36:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 03:36:52.365358 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce48750f-83be-4671-a484-4fa247c8dacc None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:36:52.366832 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-ce48750f-83be-4671-a484-4fa247c8dacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:36:52.381299 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce48750f-83be-4671-a484-4fa247c8dacc None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:36:52.387488 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f8992d-0198-4e9a-acbf-44947544e885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:36:52.389305 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f8992d-0198-4e9a-acbf-44947544e885 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:52.389593 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f8992d-0198-4e9a-acbf-44947544e885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:52.389852 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f8992d-0198-4e9a-acbf-44947544e885 admin admin] PATH_INFO: `/v3/projects/5fbd936d9a654aff8f86cadc0bb952e6` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:52.391313 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f8992d-0198-4e9a-acbf-44947544e885 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fbd936d9a654aff8f86cadc0bb952e6)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:36:52.393374 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f8992d-0198-4e9a-acbf-44947544e885 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:36:52.443072 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-c2f8992d-0198-4e9a-acbf-44947544e885 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fbd936d9a654aff8f86cadc0bb952e6', 'request_id': 'req-c2f8992d-0198-4e9a-acbf-44947544e885'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:36:52.448482 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-c2f8992d-0198-4e9a-acbf-44947544e885 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fbd936d9a654aff8f86cadc0bb952e6', 'request_id': 'req-c2f8992d-0198-4e9a-acbf-44947544e885'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:36:52.454632 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-c2f8992d-0198-4e9a-acbf-44947544e885 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fbd936d9a654aff8f86cadc0bb952e6', 'request_id': 'req-c2f8992d-0198-4e9a-acbf-44947544e885'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:36:52.467052 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-c2f8992d-0198-4e9a-acbf-44947544e885 admin admin] The token cache is being invalidate because project 5fbd936d9a654aff8f86cadc0bb952e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:36:52.467360 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-c2f8992d-0198-4e9a-acbf-44947544e885 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:36:52.468007 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-c2f8992d-0198-4e9a-acbf-44947544e885 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:36:52.469585 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1187/2347] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:36:52 2022] DELETE /identity/v3/projects/5fbd936d9a654aff8f86cadc0bb952e6 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:36:52.473705 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce05b929-9063-4f05-8097-512a899954bc service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:36:52.483736 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce05b929-9063-4f05-8097-512a899954bc service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:36:52.549302 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716e4104-180c-4e7b-8818-f375a6589bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:36:52.550201 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e4104-180c-4e7b-8818-f375a6589bb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:52.550468 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e4104-180c-4e7b-8818-f375a6589bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:52.550746 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e4104-180c-4e7b-8818-f375a6589bb3 admin admin] PATH_INFO: `/v3/users/ade958eb98314948b03c9368e1473a5b` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:52.552105 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716e4104-180c-4e7b-8818-f375a6589bb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ade958eb98314948b03c9368e1473a5b)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:36:52.554097 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716e4104-180c-4e7b-8818-f375a6589bb3 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:36:52.603590 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-716e4104-180c-4e7b-8818-f375a6589bb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ade958eb98314948b03c9368e1473a5b'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:36:52.604321 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-716e4104-180c-4e7b-8818-f375a6589bb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ade958eb98314948b03c9368e1473a5b'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:36:52.605006 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-716e4104-180c-4e7b-8818-f375a6589bb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ade958eb98314948b03c9368e1473a5b'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:36:52.617397 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-716e4104-180c-4e7b-8818-f375a6589bb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ade958eb98314948b03c9368e1473a5b'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:36:52.625520 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-716e4104-180c-4e7b-8818-f375a6589bb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ade958eb98314948b03c9368e1473a5b'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:36:52.640862 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1161/2348] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:36:52 2022] DELETE /identity/v3/users/ade958eb98314948b03c9368e1473a5b => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:36:53.115739 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f8992d-0198-4e9a-acbf-44947544e885 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:36:53.117229 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-c2f8992d-0198-4e9a-acbf-44947544e885 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:36:53.131015 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f8992d-0198-4e9a-acbf-44947544e885 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:36:53.196733 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dac3b9c-d741-4a6b-9a3a-aa2323e3e38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:36:53.197628 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac3b9c-d741-4a6b-9a3a-aa2323e3e38a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:53.197897 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac3b9c-d741-4a6b-9a3a-aa2323e3e38a admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:53.198162 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac3b9c-d741-4a6b-9a3a-aa2323e3e38a admin admin] PATH_INFO: `/v3/projects/93e8ba20c14a41478c18e40a66c78398` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:53.199370 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dac3b9c-d741-4a6b-9a3a-aa2323e3e38a admin admin] RBAC: Authorizing `identity:delete_project(project_id=93e8ba20c14a41478c18e40a66c78398)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:36:53.201268 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dac3b9c-d741-4a6b-9a3a-aa2323e3e38a admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:36:53.248281 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-8dac3b9c-d741-4a6b-9a3a-aa2323e3e38a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93e8ba20c14a41478c18e40a66c78398', 'request_id': 'req-8dac3b9c-d741-4a6b-9a3a-aa2323e3e38a'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:36:53.253796 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-8dac3b9c-d741-4a6b-9a3a-aa2323e3e38a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93e8ba20c14a41478c18e40a66c78398', 'request_id': 'req-8dac3b9c-d741-4a6b-9a3a-aa2323e3e38a'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:36:53.260187 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-8dac3b9c-d741-4a6b-9a3a-aa2323e3e38a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93e8ba20c14a41478c18e40a66c78398', 'request_id': 'req-8dac3b9c-d741-4a6b-9a3a-aa2323e3e38a'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:36:53.270321 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:36:53.276630 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-8dac3b9c-d741-4a6b-9a3a-aa2323e3e38a admin admin] The token cache is being invalidate because project 93e8ba20c14a41478c18e40a66c78398 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:36:53.276866 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-8dac3b9c-d741-4a6b-9a3a-aa2323e3e38a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:36:53.277574 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-8dac3b9c-d741-4a6b-9a3a-aa2323e3e38a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:36:53.279523 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1188/2349] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:36:53 2022] DELETE /identity/v3/projects/93e8ba20c14a41478c18e40a66c78398 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:36:53.284730 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31834308-a145-438b-a9db-f4a13e68847f None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:53.285520 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31834308-a145-438b-a9db-f4a13e68847f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:53.285628 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31834308-a145-438b-a9db-f4a13e68847f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:53.304122 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-31834308-a145-438b-a9db-f4a13e68847f None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:36:53.305242 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-31834308-a145-438b-a9db-f4a13e68847f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:36:53.333561 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:36:53.366576 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1162/2350] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:36:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:36:53.374704 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd4245-91b0-4b53-81ac-2bf0465c3c69 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:53.374975 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd4245-91b0-4b53-81ac-2bf0465c3c69 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:53.375276 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd4245-91b0-4b53-81ac-2bf0465c3c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:53.394597 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-8ccd4245-91b0-4b53-81ac-2bf0465c3c69 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:36:53.395855 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-8ccd4245-91b0-4b53-81ac-2bf0465c3c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:36:53.404631 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1189/2351] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:36:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:36:53.408942 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31834308-a145-438b-a9db-f4a13e68847f None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:36:53.419218 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31834308-a145-438b-a9db-f4a13e68847f None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:36:53.424024 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db20a3-8bd7-425e-aed0-ded34bf2ad72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:36:53.424671 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db20a3-8bd7-425e-aed0-ded34bf2ad72 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:53.424957 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db20a3-8bd7-425e-aed0-ded34bf2ad72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:53.425233 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db20a3-8bd7-425e-aed0-ded34bf2ad72 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:53.425966 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db20a3-8bd7-425e-aed0-ded34bf2ad72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:36:53.426274 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db20a3-8bd7-425e-aed0-ded34bf2ad72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:36:53.427936 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db20a3-8bd7-425e-aed0-ded34bf2ad72 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:36:53.439309 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1163/2352] 10.222.0.60 () {58 vars in 1152 bytes} [Sat Jul 2 03:36:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:36:53.445113 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccd4245-91b0-4b53-81ac-2bf0465c3c69 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:36:53.454655 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccd4245-91b0-4b53-81ac-2bf0465c3c69 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:36:53.460949 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727707e7-1ddf-44f9-9787-889aa4f73348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:36:53.461608 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727707e7-1ddf-44f9-9787-889aa4f73348 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:53.461885 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727707e7-1ddf-44f9-9787-889aa4f73348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:53.462143 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727707e7-1ddf-44f9-9787-889aa4f73348 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:53.462834 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727707e7-1ddf-44f9-9787-889aa4f73348 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:36:53.464794 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727707e7-1ddf-44f9-9787-889aa4f73348 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:36:53.495780 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1190/2353] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:36:53 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 03:36:53.497138 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db20a3-8bd7-425e-aed0-ded34bf2ad72 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:36:53.508107 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db20a3-8bd7-425e-aed0-ded34bf2ad72 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:36:53.569969 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269f69c2-8b9d-4aec-b785-db296ffbdd3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:36:53.570573 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f69c2-8b9d-4aec-b785-db296ffbdd3f admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:53.570855 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f69c2-8b9d-4aec-b785-db296ffbdd3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:53.571160 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f69c2-8b9d-4aec-b785-db296ffbdd3f admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:53.571852 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269f69c2-8b9d-4aec-b785-db296ffbdd3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:36:53.573789 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269f69c2-8b9d-4aec-b785-db296ffbdd3f admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:36:53.595483 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1164/2354] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:36:53 2022] POST /identity/v3/users => generated 294 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:36:53.599762 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727707e7-1ddf-44f9-9787-889aa4f73348 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:36:53.610253 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727707e7-1ddf-44f9-9787-889aa4f73348 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:36:53.615407 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae53f9d1-1798-4250-88d9-b1ccb433424c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:36:53.616059 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae53f9d1-1798-4250-88d9-b1ccb433424c admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:53.616335 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae53f9d1-1798-4250-88d9-b1ccb433424c admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:53.616606 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae53f9d1-1798-4250-88d9-b1ccb433424c admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:53.617325 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae53f9d1-1798-4250-88d9-b1ccb433424c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:36:53.618925 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae53f9d1-1798-4250-88d9-b1ccb433424c admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:36:53.630419 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1191/2355] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:36:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:36:53.634725 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269f69c2-8b9d-4aec-b785-db296ffbdd3f admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:36:53.645505 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269f69c2-8b9d-4aec-b785-db296ffbdd3f admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:36:53.651309 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e96f77-12e4-4ae8-b664-eebc580fe7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:36:53.651965 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e96f77-12e4-4ae8-b664-eebc580fe7ed admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:53.652246 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e96f77-12e4-4ae8-b664-eebc580fe7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:53.652559 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e96f77-12e4-4ae8-b664-eebc580fe7ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:53.653286 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e96f77-12e4-4ae8-b664-eebc580fe7ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:36:53.654895 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e96f77-12e4-4ae8-b664-eebc580fe7ed admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:36:53.665981 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1165/2356] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:36:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:36:53.670263 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae53f9d1-1798-4250-88d9-b1ccb433424c admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:36:53.680883 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae53f9d1-1798-4250-88d9-b1ccb433424c admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:36:53.686362 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954aa1b8-e981-4440-a79e-5230a67a83f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:36:53.687385 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954aa1b8-e981-4440-a79e-5230a67a83f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:53.687661 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954aa1b8-e981-4440-a79e-5230a67a83f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:53.687973 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954aa1b8-e981-4440-a79e-5230a67a83f9 admin admin] PATH_INFO: `/v3/projects/b962aa5552214d769af0cb7ad8ce07ae/users/ea8bb77eacde464696667bbe49c40b24/roles/c43aada0326446c4ade0ab1262918fa4` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:53.703989 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954aa1b8-e981-4440-a79e-5230a67a83f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b962aa5552214d769af0cb7ad8ce07ae, user_id=ea8bb77eacde464696667bbe49c40b24, role_id=c43aada0326446c4ade0ab1262918fa4)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:36:53.706660 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954aa1b8-e981-4440-a79e-5230a67a83f9 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:36:53.723381 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1192/2357] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:36:53 2022] PUT /identity/v3/projects/b962aa5552214d769af0cb7ad8ce07ae/users/ea8bb77eacde464696667bbe49c40b24/roles/c43aada0326446c4ade0ab1262918fa4 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:36:53.733618 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e275e5-c3dd-4265-bcb3-a778312e6a04 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:53.733937 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e275e5-c3dd-4265-bcb3-a778312e6a04 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:53.734217 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e275e5-c3dd-4265-bcb3-a778312e6a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:53.762101 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-b2e275e5-c3dd-4265-bcb3-a778312e6a04 None None] MFA Rules not processed for user `ea8bb77eacde464696667bbe49c40b24`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:36:53.763351 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b2e275e5-c3dd-4265-bcb3-a778312e6a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:36:53.832510 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1166/2358] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:36:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:36:53.837149 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954aa1b8-e981-4440-a79e-5230a67a83f9 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:36:53.902670 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954aa1b8-e981-4440-a79e-5230a67a83f9 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:36:53.907984 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f12ea-82f5-4880-ba8b-f5e859deca1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:36:53.908625 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f12ea-82f5-4880-ba8b-f5e859deca1f admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:53.908903 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f12ea-82f5-4880-ba8b-f5e859deca1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:53.909178 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f12ea-82f5-4880-ba8b-f5e859deca1f admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:53.909863 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40f12ea-82f5-4880-ba8b-f5e859deca1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:36:53.912119 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40f12ea-82f5-4880-ba8b-f5e859deca1f admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:36:53.941908 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1193/2359] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:36:53 2022] POST /identity/v3/projects => generated 387 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:36:53.945983 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e275e5-c3dd-4265-bcb3-a778312e6a04 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:36:53.956939 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e275e5-c3dd-4265-bcb3-a778312e6a04 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:36:53.983183 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:36:54.015401 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488e0f56-2eae-4e34-8bca-b187a2010988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:36:54.016069 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e0f56-2eae-4e34-8bca-b187a2010988 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:54.016351 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e0f56-2eae-4e34-8bca-b187a2010988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:54.016626 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e0f56-2eae-4e34-8bca-b187a2010988 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:54.017311 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488e0f56-2eae-4e34-8bca-b187a2010988 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:36:54.019263 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488e0f56-2eae-4e34-8bca-b187a2010988 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:36:54.041448 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1167/2360] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:36:53 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:36:54.045503 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f12ea-82f5-4880-ba8b-f5e859deca1f admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:36:54.056078 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f12ea-82f5-4880-ba8b-f5e859deca1f admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:36:54.061022 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2252172b-82ca-411c-89b4-20c349c5ca24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:36:54.061710 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252172b-82ca-411c-89b4-20c349c5ca24 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:54.061950 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252172b-82ca-411c-89b4-20c349c5ca24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:54.062253 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252172b-82ca-411c-89b4-20c349c5ca24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:54.062980 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2252172b-82ca-411c-89b4-20c349c5ca24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:36:54.064713 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2252172b-82ca-411c-89b4-20c349c5ca24 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:36:54.075828 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1194/2361] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:36:54.079877 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488e0f56-2eae-4e34-8bca-b187a2010988 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:36:54.089877 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488e0f56-2eae-4e34-8bca-b187a2010988 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:36:54.094927 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3352a93-1c53-4937-8ff9-e4409d1df16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:36:54.095799 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3352a93-1c53-4937-8ff9-e4409d1df16c admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:54.096003 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3352a93-1c53-4937-8ff9-e4409d1df16c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:54.096113 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3352a93-1c53-4937-8ff9-e4409d1df16c admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:54.096833 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3352a93-1c53-4937-8ff9-e4409d1df16c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:36:54.098417 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3352a93-1c53-4937-8ff9-e4409d1df16c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:36:54.108722 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1168/2362] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:36:54.112954 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2252172b-82ca-411c-89b4-20c349c5ca24 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:36:54.122971 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2252172b-82ca-411c-89b4-20c349c5ca24 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:36:54.127996 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae4c862-f682-4926-8221-19444cbc1f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:36:54.128922 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4c862-f682-4926-8221-19444cbc1f90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:54.129205 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4c862-f682-4926-8221-19444cbc1f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:54.129477 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4c862-f682-4926-8221-19444cbc1f90 admin admin] PATH_INFO: `/v3/projects/65a4c9ff85934710a5ccf5e3670a9a15/users/dc69cdc403d14999aa79f4c020fa45ea/roles/c43aada0326446c4ade0ab1262918fa4` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:54.146879 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae4c862-f682-4926-8221-19444cbc1f90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65a4c9ff85934710a5ccf5e3670a9a15, user_id=dc69cdc403d14999aa79f4c020fa45ea, role_id=c43aada0326446c4ade0ab1262918fa4)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:36:54.150242 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae4c862-f682-4926-8221-19444cbc1f90 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:36:54.165655 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1195/2363] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:36:54 2022] PUT /identity/v3/projects/65a4c9ff85934710a5ccf5e3670a9a15/users/dc69cdc403d14999aa79f4c020fa45ea/roles/c43aada0326446c4ade0ab1262918fa4 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:36:54.176618 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490e461-56fd-4e0a-b115-4312706e2861 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:54.176903 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490e461-56fd-4e0a-b115-4312706e2861 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:54.177175 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490e461-56fd-4e0a-b115-4312706e2861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:54.205460 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-5490e461-56fd-4e0a-b115-4312706e2861 None None] MFA Rules not processed for user `dc69cdc403d14999aa79f4c020fa45ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:36:54.206678 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5490e461-56fd-4e0a-b115-4312706e2861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:36:54.272469 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1169/2364] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:36:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 03:36:54.277431 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae4c862-f682-4926-8221-19444cbc1f90 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:36:54.323620 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:36:54.341818 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae4c862-f682-4926-8221-19444cbc1f90 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:36:54.347044 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40766b-afc3-48b8-aef1-e77c55fb3c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:36:54.347730 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40766b-afc3-48b8-aef1-e77c55fb3c80 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:54.348015 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40766b-afc3-48b8-aef1-e77c55fb3c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:54.348287 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40766b-afc3-48b8-aef1-e77c55fb3c80 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:54.348954 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb40766b-afc3-48b8-aef1-e77c55fb3c80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:36:54.350947 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb40766b-afc3-48b8-aef1-e77c55fb3c80 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:36:54.378133 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1196/2365] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:36:54 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:36:54.382574 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5490e461-56fd-4e0a-b115-4312706e2861 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:36:54.393703 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5490e461-56fd-4e0a-b115-4312706e2861 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:36:54.451571 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b23b35d-8813-4d46-93ba-98923bba7edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:36:54.452227 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23b35d-8813-4d46-93ba-98923bba7edd admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:54.452505 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23b35d-8813-4d46-93ba-98923bba7edd admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:54.452776 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23b35d-8813-4d46-93ba-98923bba7edd admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:54.453470 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b23b35d-8813-4d46-93ba-98923bba7edd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:36:54.455425 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b23b35d-8813-4d46-93ba-98923bba7edd admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:36:54.480671 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1170/2366] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:36:54 2022] POST /identity/v3/users => generated 299 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 03:36:54.485183 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40766b-afc3-48b8-aef1-e77c55fb3c80 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:36:54.497687 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40766b-afc3-48b8-aef1-e77c55fb3c80 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:36:54.502856 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f35c2-7292-40e2-9a43-d6da8d3a722e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:36:54.503553 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f35c2-7292-40e2-9a43-d6da8d3a722e admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:54.503837 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f35c2-7292-40e2-9a43-d6da8d3a722e admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:54.504111 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f35c2-7292-40e2-9a43-d6da8d3a722e admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:54.504849 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1f35c2-7292-40e2-9a43-d6da8d3a722e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:36:54.506474 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1f35c2-7292-40e2-9a43-d6da8d3a722e admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:36:54.517532 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1197/2367] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:36:54.521784 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b23b35d-8813-4d46-93ba-98923bba7edd admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:36:54.532005 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b23b35d-8813-4d46-93ba-98923bba7edd admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:36:54.537423 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c736ed-2f32-4cd6-8c8b-2c44738cd1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:36:54.538293 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c736ed-2f32-4cd6-8c8b-2c44738cd1d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:54.538574 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c736ed-2f32-4cd6-8c8b-2c44738cd1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:54.538832 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c736ed-2f32-4cd6-8c8b-2c44738cd1d6 admin admin] PATH_INFO: `/v3/projects/7ba47363d780408a93e5b1a96cf6eeba/users/15ed2c299f3f4865a90b3ed86a742e0b/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:54.554008 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c736ed-2f32-4cd6-8c8b-2c44738cd1d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ba47363d780408a93e5b1a96cf6eeba, user_id=15ed2c299f3f4865a90b3ed86a742e0b, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:36:54.556718 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c736ed-2f32-4cd6-8c8b-2c44738cd1d6 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:36:54.573028 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1171/2368] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:36:54 2022] PUT /identity/v3/projects/7ba47363d780408a93e5b1a96cf6eeba/users/15ed2c299f3f4865a90b3ed86a742e0b/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:36:54.577625 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f35c2-7292-40e2-9a43-d6da8d3a722e admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:36:54.589772 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f35c2-7292-40e2-9a43-d6da8d3a722e admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:36:54.646643 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd6a8fd-45b5-44ff-b60e-86cf84abcf2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:36:54.647278 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd6a8fd-45b5-44ff-b60e-86cf84abcf2d admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:54.647553 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd6a8fd-45b5-44ff-b60e-86cf84abcf2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:54.647826 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd6a8fd-45b5-44ff-b60e-86cf84abcf2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:54.648545 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd6a8fd-45b5-44ff-b60e-86cf84abcf2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:36:54.650181 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd6a8fd-45b5-44ff-b60e-86cf84abcf2d admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:36:54.660502 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1198/2369] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:36:54.665454 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c736ed-2f32-4cd6-8c8b-2c44738cd1d6 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:36:54.674297 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:36:54.680743 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c736ed-2f32-4cd6-8c8b-2c44738cd1d6 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:36:54.686348 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbdff32-47f1-4da1-a254-520b2102d394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:36:54.687276 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbdff32-47f1-4da1-a254-520b2102d394 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:54.687560 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbdff32-47f1-4da1-a254-520b2102d394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:54.687836 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbdff32-47f1-4da1-a254-520b2102d394 admin admin] PATH_INFO: `/v3/projects/7ba47363d780408a93e5b1a96cf6eeba/users/15ed2c299f3f4865a90b3ed86a742e0b/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:54.689863 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbdff32-47f1-4da1-a254-520b2102d394 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ba47363d780408a93e5b1a96cf6eeba, user_id=15ed2c299f3f4865a90b3ed86a742e0b, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:36:54.692590 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbdff32-47f1-4da1-a254-520b2102d394 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:36:54.704095 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1172/2370] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:36:54 2022] PUT /identity/v3/projects/7ba47363d780408a93e5b1a96cf6eeba/users/15ed2c299f3f4865a90b3ed86a742e0b/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:36:54.714257 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b7f25-c126-45fb-8692-a00b5560eb22 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:54.714541 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b7f25-c126-45fb-8692-a00b5560eb22 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:54.714814 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b7f25-c126-45fb-8692-a00b5560eb22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:54.742665 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-fa4b7f25-c126-45fb-8692-a00b5560eb22 None None] MFA Rules not processed for user `15ed2c299f3f4865a90b3ed86a742e0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:36:54.743895 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-fa4b7f25-c126-45fb-8692-a00b5560eb22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:36:54.824612 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1199/2371] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:36:54 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:36:54.836355 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbdff32-47f1-4da1-a254-520b2102d394 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:36:54.838399 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8dbdff32-47f1-4da1-a254-520b2102d394 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:36:54.898054 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbdff32-47f1-4da1-a254-520b2102d394 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:36:54.902071 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6347e60b-c1df-4b1f-8fb0-f6078429613e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:36:54.902697 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347e60b-c1df-4b1f-8fb0-f6078429613e service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:54.902978 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347e60b-c1df-4b1f-8fb0-f6078429613e service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:54.903284 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347e60b-c1df-4b1f-8fb0-f6078429613e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:54.912834 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6347e60b-c1df-4b1f-8fb0-f6078429613e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:36:54.914272 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6347e60b-c1df-4b1f-8fb0-f6078429613e service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:36:54.924089 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1173/2372] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:36:54 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:36:55.434604 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b7f25-c126-45fb-8692-a00b5560eb22 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:36:55.436655 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-fa4b7f25-c126-45fb-8692-a00b5560eb22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:36:55.462171 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b7f25-c126-45fb-8692-a00b5560eb22 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:36:55.466029 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5044f91-8d89-4796-861b-0b7c88e0505a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:36:55.466671 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5044f91-8d89-4796-861b-0b7c88e0505a service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:55.466953 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5044f91-8d89-4796-861b-0b7c88e0505a service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:55.467267 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5044f91-8d89-4796-861b-0b7c88e0505a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:55.510113 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:36:55.531388 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5044f91-8d89-4796-861b-0b7c88e0505a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:36:55.532828 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5044f91-8d89-4796-861b-0b7c88e0505a service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:36:55.542402 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1200/2373] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:36:55 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:36:59.634640 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6347e60b-c1df-4b1f-8fb0-f6078429613e service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:36:59.643542 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6347e60b-c1df-4b1f-8fb0-f6078429613e service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:36:59.647989 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c43ec26-cc8c-4963-a56e-e3f1399d31b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:36:59.648652 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c43ec26-cc8c-4963-a56e-e3f1399d31b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:36:59.648930 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c43ec26-cc8c-4963-a56e-e3f1399d31b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:36:59.649204 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c43ec26-cc8c-4963-a56e-e3f1399d31b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:36:59.706203 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c43ec26-cc8c-4963-a56e-e3f1399d31b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:36:59.707686 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c43ec26-cc8c-4963-a56e-e3f1399d31b9 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:36:59.716984 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1174/2374] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:36:59 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:37:01.847533 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5044f91-8d89-4796-861b-0b7c88e0505a service cinder] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:01.918334 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5044f91-8d89-4796-861b-0b7c88e0505a service cinder] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:01.923848 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b2eab9-0b5c-4a3c-83ae-b8f67aecffea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:01.924723 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b2eab9-0b5c-4a3c-83ae-b8f67aecffea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:01.925005 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b2eab9-0b5c-4a3c-83ae-b8f67aecffea admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:01.925281 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b2eab9-0b5c-4a3c-83ae-b8f67aecffea admin admin] PATH_INFO: `/v3/users/ea8bb77eacde464696667bbe49c40b24` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:01.926551 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b2eab9-0b5c-4a3c-83ae-b8f67aecffea admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea8bb77eacde464696667bbe49c40b24)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:01.928521 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b2eab9-0b5c-4a3c-83ae-b8f67aecffea admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:01.979416 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-86b2eab9-0b5c-4a3c-83ae-b8f67aecffea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea8bb77eacde464696667bbe49c40b24'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:01.980044 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-86b2eab9-0b5c-4a3c-83ae-b8f67aecffea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea8bb77eacde464696667bbe49c40b24'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:01.988986 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-86b2eab9-0b5c-4a3c-83ae-b8f67aecffea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea8bb77eacde464696667bbe49c40b24'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:01.989638 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-86b2eab9-0b5c-4a3c-83ae-b8f67aecffea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea8bb77eacde464696667bbe49c40b24'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:02.001788 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-86b2eab9-0b5c-4a3c-83ae-b8f67aecffea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea8bb77eacde464696667bbe49c40b24'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:02.013989 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1201/2375] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:37:01 2022] DELETE /identity/v3/users/ea8bb77eacde464696667bbe49c40b24 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:37:02.018728 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8703134b-60cc-4b27-956d-da86f19deec1 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:02.019257 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8703134b-60cc-4b27-956d-da86f19deec1 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:02.019374 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8703134b-60cc-4b27-956d-da86f19deec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:02.038228 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-8703134b-60cc-4b27-956d-da86f19deec1 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:37:02.039488 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8703134b-60cc-4b27-956d-da86f19deec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:37:02.103838 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1175/2376] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:37:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:37:02.113699 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b2eab9-0b5c-4a3c-83ae-b8f67aecffea admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:02.115357 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-86b2eab9-0b5c-4a3c-83ae-b8f67aecffea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:37:02.174158 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b2eab9-0b5c-4a3c-83ae-b8f67aecffea admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:02.177896 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7991be4-151a-4470-ba5e-4151272194bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:02.178542 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7991be4-151a-4470-ba5e-4151272194bf service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:02.178830 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7991be4-151a-4470-ba5e-4151272194bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:02.179171 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7991be4-151a-4470-ba5e-4151272194bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:02.189039 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7991be4-151a-4470-ba5e-4151272194bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:02.190554 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7991be4-151a-4470-ba5e-4151272194bf service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:02.196078 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:37:02.202074 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1202/2377] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:37:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:37:02.583069 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8703134b-60cc-4b27-956d-da86f19deec1 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:02.585470 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8703134b-60cc-4b27-956d-da86f19deec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:37:02.599494 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8703134b-60cc-4b27-956d-da86f19deec1 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:02.605740 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37840bec-748d-49c5-824f-0afae76d2e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:02.606847 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37840bec-748d-49c5-824f-0afae76d2e59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:02.607243 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37840bec-748d-49c5-824f-0afae76d2e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:02.607596 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37840bec-748d-49c5-824f-0afae76d2e59 admin admin] PATH_INFO: `/v3/projects/b962aa5552214d769af0cb7ad8ce07ae` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:02.608904 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37840bec-748d-49c5-824f-0afae76d2e59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b962aa5552214d769af0cb7ad8ce07ae)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:02.610899 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37840bec-748d-49c5-824f-0afae76d2e59 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:02.649088 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:37:02.666553 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-37840bec-748d-49c5-824f-0afae76d2e59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b962aa5552214d769af0cb7ad8ce07ae', 'request_id': 'req-37840bec-748d-49c5-824f-0afae76d2e59'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:02.671955 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-37840bec-748d-49c5-824f-0afae76d2e59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b962aa5552214d769af0cb7ad8ce07ae', 'request_id': 'req-37840bec-748d-49c5-824f-0afae76d2e59'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:02.682554 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-37840bec-748d-49c5-824f-0afae76d2e59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b962aa5552214d769af0cb7ad8ce07ae', 'request_id': 'req-37840bec-748d-49c5-824f-0afae76d2e59'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:02.693836 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-37840bec-748d-49c5-824f-0afae76d2e59 admin admin] The token cache is being invalidate because project b962aa5552214d769af0cb7ad8ce07ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:37:02.694120 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-37840bec-748d-49c5-824f-0afae76d2e59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:02.694750 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-37840bec-748d-49c5-824f-0afae76d2e59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:02.696356 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1176/2378] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:37:02 2022] DELETE /identity/v3/projects/b962aa5552214d769af0cb7ad8ce07ae => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:37:02.700341 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7991be4-151a-4470-ba5e-4151272194bf service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:02.710351 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7991be4-151a-4470-ba5e-4151272194bf service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:02.765925 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2899e533-07c3-48f0-9a7a-4d444a03e2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:02.766814 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899e533-07c3-48f0-9a7a-4d444a03e2aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:02.767092 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899e533-07c3-48f0-9a7a-4d444a03e2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:02.767413 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899e533-07c3-48f0-9a7a-4d444a03e2aa admin admin] PATH_INFO: `/v3/users/dc69cdc403d14999aa79f4c020fa45ea` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:02.768773 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2899e533-07c3-48f0-9a7a-4d444a03e2aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc69cdc403d14999aa79f4c020fa45ea)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:02.770780 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2899e533-07c3-48f0-9a7a-4d444a03e2aa admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:02.820447 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-2899e533-07c3-48f0-9a7a-4d444a03e2aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc69cdc403d14999aa79f4c020fa45ea'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:02.822024 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-2899e533-07c3-48f0-9a7a-4d444a03e2aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc69cdc403d14999aa79f4c020fa45ea'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:02.834065 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-2899e533-07c3-48f0-9a7a-4d444a03e2aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc69cdc403d14999aa79f4c020fa45ea'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:02.834862 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-2899e533-07c3-48f0-9a7a-4d444a03e2aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc69cdc403d14999aa79f4c020fa45ea'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:02.847506 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-2899e533-07c3-48f0-9a7a-4d444a03e2aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc69cdc403d14999aa79f4c020fa45ea'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:02.860264 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1203/2379] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:37:02 2022] DELETE /identity/v3/users/dc69cdc403d14999aa79f4c020fa45ea => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:37:03.408334 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37840bec-748d-49c5-824f-0afae76d2e59 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:03.410136 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-37840bec-748d-49c5-824f-0afae76d2e59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:37:03.425102 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37840bec-748d-49c5-824f-0afae76d2e59 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:03.488393 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f010c7f-4012-42dc-b3df-3a9026890b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:03.489266 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f010c7f-4012-42dc-b3df-3a9026890b54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:03.489547 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f010c7f-4012-42dc-b3df-3a9026890b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:03.489821 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f010c7f-4012-42dc-b3df-3a9026890b54 admin admin] PATH_INFO: `/v3/projects/65a4c9ff85934710a5ccf5e3670a9a15` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:03.491013 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f010c7f-4012-42dc-b3df-3a9026890b54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65a4c9ff85934710a5ccf5e3670a9a15)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:03.493070 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f010c7f-4012-42dc-b3df-3a9026890b54 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:03.545241 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6f010c7f-4012-42dc-b3df-3a9026890b54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65a4c9ff85934710a5ccf5e3670a9a15', 'request_id': 'req-6f010c7f-4012-42dc-b3df-3a9026890b54'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:03.551991 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6f010c7f-4012-42dc-b3df-3a9026890b54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65a4c9ff85934710a5ccf5e3670a9a15', 'request_id': 'req-6f010c7f-4012-42dc-b3df-3a9026890b54'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:03.562789 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6f010c7f-4012-42dc-b3df-3a9026890b54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65a4c9ff85934710a5ccf5e3670a9a15', 'request_id': 'req-6f010c7f-4012-42dc-b3df-3a9026890b54'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:03.576863 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6f010c7f-4012-42dc-b3df-3a9026890b54 admin admin] The token cache is being invalidate because project 65a4c9ff85934710a5ccf5e3670a9a15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:37:03.577262 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6f010c7f-4012-42dc-b3df-3a9026890b54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:03.578259 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6f010c7f-4012-42dc-b3df-3a9026890b54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:03.580429 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1177/2380] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:37:03 2022] DELETE /identity/v3/projects/65a4c9ff85934710a5ccf5e3670a9a15 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:37:03.586043 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2899e533-07c3-48f0-9a7a-4d444a03e2aa admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:03.587609 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-2899e533-07c3-48f0-9a7a-4d444a03e2aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:37:03.600936 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2899e533-07c3-48f0-9a7a-4d444a03e2aa admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:03.663083 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d82fc7-9e52-41d2-a7ef-2c5d01cd8c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:03.664003 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d82fc7-9e52-41d2-a7ef-2c5d01cd8c75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:03.664280 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d82fc7-9e52-41d2-a7ef-2c5d01cd8c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:03.664551 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d82fc7-9e52-41d2-a7ef-2c5d01cd8c75 admin admin] PATH_INFO: `/v3/users/15ed2c299f3f4865a90b3ed86a742e0b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:03.665754 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d82fc7-9e52-41d2-a7ef-2c5d01cd8c75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15ed2c299f3f4865a90b3ed86a742e0b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:03.667697 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d82fc7-9e52-41d2-a7ef-2c5d01cd8c75 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:03.690573 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:37:03.721753 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-78d82fc7-9e52-41d2-a7ef-2c5d01cd8c75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15ed2c299f3f4865a90b3ed86a742e0b'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:03.722467 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-78d82fc7-9e52-41d2-a7ef-2c5d01cd8c75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15ed2c299f3f4865a90b3ed86a742e0b'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:03.731838 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-78d82fc7-9e52-41d2-a7ef-2c5d01cd8c75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15ed2c299f3f4865a90b3ed86a742e0b'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:03.732480 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-78d82fc7-9e52-41d2-a7ef-2c5d01cd8c75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15ed2c299f3f4865a90b3ed86a742e0b'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:03.744815 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-78d82fc7-9e52-41d2-a7ef-2c5d01cd8c75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15ed2c299f3f4865a90b3ed86a742e0b'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:03.757741 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1204/2381] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:37:03 2022] DELETE /identity/v3/users/15ed2c299f3f4865a90b3ed86a742e0b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:37:04.034519 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f010c7f-4012-42dc-b3df-3a9026890b54 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:04.036715 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-6f010c7f-4012-42dc-b3df-3a9026890b54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:37:04.052594 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f010c7f-4012-42dc-b3df-3a9026890b54 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:04.096381 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:37:04.113287 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee944e7-713a-463f-910c-396a57425657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:04.114196 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee944e7-713a-463f-910c-396a57425657 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:04.114477 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee944e7-713a-463f-910c-396a57425657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:04.114748 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee944e7-713a-463f-910c-396a57425657 admin admin] PATH_INFO: `/v3/projects/7ba47363d780408a93e5b1a96cf6eeba` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:04.115975 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee944e7-713a-463f-910c-396a57425657 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ba47363d780408a93e5b1a96cf6eeba)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:04.118010 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee944e7-713a-463f-910c-396a57425657 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:04.164113 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-1ee944e7-713a-463f-910c-396a57425657 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ba47363d780408a93e5b1a96cf6eeba', 'request_id': 'req-1ee944e7-713a-463f-910c-396a57425657'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:04.169804 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-1ee944e7-713a-463f-910c-396a57425657 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ba47363d780408a93e5b1a96cf6eeba', 'request_id': 'req-1ee944e7-713a-463f-910c-396a57425657'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:04.179149 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-1ee944e7-713a-463f-910c-396a57425657 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ba47363d780408a93e5b1a96cf6eeba', 'request_id': 'req-1ee944e7-713a-463f-910c-396a57425657'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:04.190873 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-1ee944e7-713a-463f-910c-396a57425657 admin admin] The token cache is being invalidate because project 7ba47363d780408a93e5b1a96cf6eeba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:37:04.191154 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-1ee944e7-713a-463f-910c-396a57425657 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:04.191812 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-1ee944e7-713a-463f-910c-396a57425657 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:04.193996 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1178/2382] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:37:04 2022] DELETE /identity/v3/projects/7ba47363d780408a93e5b1a96cf6eeba => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:37:04.202580 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea1e4e-21bb-4e19-ba90-cc7eee370dca None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:04.203059 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea1e4e-21bb-4e19-ba90-cc7eee370dca None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:04.203059 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea1e4e-21bb-4e19-ba90-cc7eee370dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:04.223345 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-63ea1e4e-21bb-4e19-ba90-cc7eee370dca None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:37:04.224608 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-63ea1e4e-21bb-4e19-ba90-cc7eee370dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:37:04.286383 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1205/2383] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:37:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:37:04.295071 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b89b2-da42-419a-b527-c40f8ac235aa None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:04.295399 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b89b2-da42-419a-b527-c40f8ac235aa None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:04.295673 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b89b2-da42-419a-b527-c40f8ac235aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:04.314563 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-0b4b89b2-da42-419a-b527-c40f8ac235aa None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:37:04.315769 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0b4b89b2-da42-419a-b527-c40f8ac235aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:37:04.324240 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1179/2384] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:37:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:37:04.328638 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ea1e4e-21bb-4e19-ba90-cc7eee370dca None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:04.338986 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ea1e4e-21bb-4e19-ba90-cc7eee370dca None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:04.344698 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d69b396-32e5-4cb0-93c4-d258e91e3ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:04.345370 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69b396-32e5-4cb0-93c4-d258e91e3ea0 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:04.345649 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69b396-32e5-4cb0-93c4-d258e91e3ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:04.345907 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69b396-32e5-4cb0-93c4-d258e91e3ea0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:04.346743 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d69b396-32e5-4cb0-93c4-d258e91e3ea0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:37:04.347061 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d69b396-32e5-4cb0-93c4-d258e91e3ea0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:04.348906 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d69b396-32e5-4cb0-93c4-d258e91e3ea0 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:04.361384 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1206/2385] 10.222.0.60 () {58 vars in 1152 bytes} [Sat Jul 2 03:37:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:37:04.365716 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b89b2-da42-419a-b527-c40f8ac235aa None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:04.375573 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b89b2-da42-419a-b527-c40f8ac235aa None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:04.380935 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b38b21c-91de-4fe9-8125-bccaeadde57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:04.381590 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38b21c-91de-4fe9-8125-bccaeadde57b admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:04.381902 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38b21c-91de-4fe9-8125-bccaeadde57b admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:04.382219 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38b21c-91de-4fe9-8125-bccaeadde57b admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:04.382958 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b38b21c-91de-4fe9-8125-bccaeadde57b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:04.384911 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b38b21c-91de-4fe9-8125-bccaeadde57b admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:04.413499 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1180/2386] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:37:04 2022] POST /identity/v3/projects => generated 389 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 03:37:04.417823 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d69b396-32e5-4cb0-93c4-d258e91e3ea0 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:04.427896 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d69b396-32e5-4cb0-93c4-d258e91e3ea0 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:04.485364 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f23c368-af8b-4c4d-ad43-f51a57468d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:04.485954 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f23c368-af8b-4c4d-ad43-f51a57468d89 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:04.486241 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f23c368-af8b-4c4d-ad43-f51a57468d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:04.486513 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f23c368-af8b-4c4d-ad43-f51a57468d89 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:04.487209 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f23c368-af8b-4c4d-ad43-f51a57468d89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:04.489163 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f23c368-af8b-4c4d-ad43-f51a57468d89 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:04.514102 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1207/2387] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:37:04 2022] POST /identity/v3/users => generated 295 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:37:04.515728 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b38b21c-91de-4fe9-8125-bccaeadde57b admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:04.526580 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b38b21c-91de-4fe9-8125-bccaeadde57b admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:04.531764 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce757d8-bc2f-4308-9aed-dcdd3934e217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:04.532412 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce757d8-bc2f-4308-9aed-dcdd3934e217 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:04.532715 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce757d8-bc2f-4308-9aed-dcdd3934e217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:04.532991 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce757d8-bc2f-4308-9aed-dcdd3934e217 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:04.533725 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce757d8-bc2f-4308-9aed-dcdd3934e217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:04.535686 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce757d8-bc2f-4308-9aed-dcdd3934e217 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:04.546375 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1181/2388] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:37:04.550597 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f23c368-af8b-4c4d-ad43-f51a57468d89 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:04.561354 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f23c368-af8b-4c4d-ad43-f51a57468d89 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:04.566961 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21347279-00e1-47aa-8ed5-e7c1c60a855a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:04.567666 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21347279-00e1-47aa-8ed5-e7c1c60a855a admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:04.567947 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21347279-00e1-47aa-8ed5-e7c1c60a855a admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:04.568217 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21347279-00e1-47aa-8ed5-e7c1c60a855a admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:04.568947 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21347279-00e1-47aa-8ed5-e7c1c60a855a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:04.570617 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21347279-00e1-47aa-8ed5-e7c1c60a855a admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:04.581640 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1208/2389] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:37:04.585930 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce757d8-bc2f-4308-9aed-dcdd3934e217 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:04.596193 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce757d8-bc2f-4308-9aed-dcdd3934e217 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:04.600930 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb9b615-8957-4239-a1f7-d16ceccc7088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:04.601855 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb9b615-8957-4239-a1f7-d16ceccc7088 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:04.602117 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb9b615-8957-4239-a1f7-d16ceccc7088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:04.602382 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb9b615-8957-4239-a1f7-d16ceccc7088 admin admin] PATH_INFO: `/v3/projects/c8bbaaa3e4d44b4b848d077e3326d932/users/1c84c93cc00f4abab7068472a99fca01/roles/c43aada0326446c4ade0ab1262918fa4` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:04.621894 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb9b615-8957-4239-a1f7-d16ceccc7088 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8bbaaa3e4d44b4b848d077e3326d932, user_id=1c84c93cc00f4abab7068472a99fca01, role_id=c43aada0326446c4ade0ab1262918fa4)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:04.624673 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb9b615-8957-4239-a1f7-d16ceccc7088 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:04.639714 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1182/2390] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:37:04 2022] PUT /identity/v3/projects/c8bbaaa3e4d44b4b848d077e3326d932/users/1c84c93cc00f4abab7068472a99fca01/roles/c43aada0326446c4ade0ab1262918fa4 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 03:37:04.652320 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db53d6f6-8eca-4a32-9436-72402e0b4d2a None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:04.652606 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db53d6f6-8eca-4a32-9436-72402e0b4d2a None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:04.652908 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db53d6f6-8eca-4a32-9436-72402e0b4d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:04.660963 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:37:04.681782 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-db53d6f6-8eca-4a32-9436-72402e0b4d2a None None] MFA Rules not processed for user `1c84c93cc00f4abab7068472a99fca01`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:37:04.682990 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-db53d6f6-8eca-4a32-9436-72402e0b4d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:37:04.747592 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1209/2391] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:37:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:37:04.752248 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb9b615-8957-4239-a1f7-d16ceccc7088 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:04.827346 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb9b615-8957-4239-a1f7-d16ceccc7088 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:04.832782 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da196efa-8b64-4df4-914d-baba6223f103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:04.833566 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da196efa-8b64-4df4-914d-baba6223f103 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:04.833921 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da196efa-8b64-4df4-914d-baba6223f103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:04.834270 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da196efa-8b64-4df4-914d-baba6223f103 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:04.835048 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da196efa-8b64-4df4-914d-baba6223f103 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:04.837083 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da196efa-8b64-4df4-914d-baba6223f103 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:04.852974 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:37:04.870614 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1183/2392] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:37:04 2022] POST /identity/v3/projects => generated 389 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 03:37:04.871856 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db53d6f6-8eca-4a32-9436-72402e0b4d2a None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:04.883823 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db53d6f6-8eca-4a32-9436-72402e0b4d2a None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:04.944067 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf795d1-fb5d-4988-b9ac-ffe1337e8738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:04.944991 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf795d1-fb5d-4988-b9ac-ffe1337e8738 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:04.945261 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf795d1-fb5d-4988-b9ac-ffe1337e8738 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:04.945538 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf795d1-fb5d-4988-b9ac-ffe1337e8738 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:04.946247 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf795d1-fb5d-4988-b9ac-ffe1337e8738 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:04.948304 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf795d1-fb5d-4988-b9ac-ffe1337e8738 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:04.972234 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1210/2393] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:37:04 2022] POST /identity/v3/users => generated 301 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 03:37:04.976419 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da196efa-8b64-4df4-914d-baba6223f103 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:04.987241 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da196efa-8b64-4df4-914d-baba6223f103 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:04.993083 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92778704-e64d-4116-b768-305e82b2ee82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:04.993786 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92778704-e64d-4116-b768-305e82b2ee82 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:04.994177 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92778704-e64d-4116-b768-305e82b2ee82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:04.994455 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92778704-e64d-4116-b768-305e82b2ee82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:04.995941 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92778704-e64d-4116-b768-305e82b2ee82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:04.997950 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92778704-e64d-4116-b768-305e82b2ee82 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:05.009688 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1184/2394] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:37:05.014093 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf795d1-fb5d-4988-b9ac-ffe1337e8738 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:05.024751 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf795d1-fb5d-4988-b9ac-ffe1337e8738 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:05.029584 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99cac29-6c99-4833-97c7-7bf803de8d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:05.030481 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99cac29-6c99-4833-97c7-7bf803de8d60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:05.030758 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99cac29-6c99-4833-97c7-7bf803de8d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:05.031037 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99cac29-6c99-4833-97c7-7bf803de8d60 admin admin] PATH_INFO: `/v3/projects/ca2b9ba0013749c48ecfdd14aa92831a/users/21d2df3605ac41fbbd59a8d81efb26ec/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:05.048688 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99cac29-6c99-4833-97c7-7bf803de8d60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca2b9ba0013749c48ecfdd14aa92831a, user_id=21d2df3605ac41fbbd59a8d81efb26ec, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:05.051375 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99cac29-6c99-4833-97c7-7bf803de8d60 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:05.066883 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1211/2395] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:37:05 2022] PUT /identity/v3/projects/ca2b9ba0013749c48ecfdd14aa92831a/users/21d2df3605ac41fbbd59a8d81efb26ec/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 03:37:05.070951 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92778704-e64d-4116-b768-305e82b2ee82 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:05.081157 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92778704-e64d-4116-b768-305e82b2ee82 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:05.144647 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad2af8-56bf-4089-94e3-42cff79ea8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:05.145555 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad2af8-56bf-4089-94e3-42cff79ea8e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:05.145891 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad2af8-56bf-4089-94e3-42cff79ea8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:05.146292 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad2af8-56bf-4089-94e3-42cff79ea8e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:05.147411 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ad2af8-56bf-4089-94e3-42cff79ea8e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:05.149126 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ad2af8-56bf-4089-94e3-42cff79ea8e6 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:05.159070 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1185/2396] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:37:05.163653 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99cac29-6c99-4833-97c7-7bf803de8d60 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:05.174362 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99cac29-6c99-4833-97c7-7bf803de8d60 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:05.179799 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18038ef4-6d56-4590-a570-c25d1641e07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:05.180696 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18038ef4-6d56-4590-a570-c25d1641e07e admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:05.181028 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18038ef4-6d56-4590-a570-c25d1641e07e admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:05.181307 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18038ef4-6d56-4590-a570-c25d1641e07e admin admin] PATH_INFO: `/v3/projects/ca2b9ba0013749c48ecfdd14aa92831a/users/21d2df3605ac41fbbd59a8d81efb26ec/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:05.183396 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18038ef4-6d56-4590-a570-c25d1641e07e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca2b9ba0013749c48ecfdd14aa92831a, user_id=21d2df3605ac41fbbd59a8d81efb26ec, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:05.186034 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18038ef4-6d56-4590-a570-c25d1641e07e admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:05.196982 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1212/2397] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:37:05 2022] PUT /identity/v3/projects/ca2b9ba0013749c48ecfdd14aa92831a/users/21d2df3605ac41fbbd59a8d81efb26ec/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:37:05.207262 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2ba89-cb60-4251-b99b-98278b12e349 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:05.207549 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2ba89-cb60-4251-b99b-98278b12e349 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:05.207855 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2ba89-cb60-4251-b99b-98278b12e349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:05.234247 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-0ca2ba89-cb60-4251-b99b-98278b12e349 None None] MFA Rules not processed for user `21d2df3605ac41fbbd59a8d81efb26ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:37:05.235492 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0ca2ba89-cb60-4251-b99b-98278b12e349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:37:05.309829 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1186/2398] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:37:05 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:37:05.321541 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18038ef4-6d56-4590-a570-c25d1641e07e admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:05.323646 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-18038ef4-6d56-4590-a570-c25d1641e07e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:37:05.382370 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:37:05.387791 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18038ef4-6d56-4590-a570-c25d1641e07e admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:05.392722 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a39dd8a-d3da-4764-97de-88377669c23e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:05.393799 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39dd8a-d3da-4764-97de-88377669c23e service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:05.394088 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39dd8a-d3da-4764-97de-88377669c23e service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:05.394354 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39dd8a-d3da-4764-97de-88377669c23e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:05.403789 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a39dd8a-d3da-4764-97de-88377669c23e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:05.405218 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a39dd8a-d3da-4764-97de-88377669c23e service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:05.415076 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1213/2399] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:37:05 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:37:05.545376 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca2ba89-cb60-4251-b99b-98278b12e349 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:05.608369 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca2ba89-cb60-4251-b99b-98278b12e349 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:05.613125 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1256f843-541e-4910-9f87-67e42b32ddd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:05.613988 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256f843-541e-4910-9f87-67e42b32ddd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:05.614261 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256f843-541e-4910-9f87-67e42b32ddd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:05.614526 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256f843-541e-4910-9f87-67e42b32ddd2 admin admin] PATH_INFO: `/v3/users/1c84c93cc00f4abab7068472a99fca01` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:05.615757 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1256f843-541e-4910-9f87-67e42b32ddd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c84c93cc00f4abab7068472a99fca01)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:05.617700 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1256f843-541e-4910-9f87-67e42b32ddd2 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:05.622996 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:37:05.672259 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-1256f843-541e-4910-9f87-67e42b32ddd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c84c93cc00f4abab7068472a99fca01'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:05.672970 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-1256f843-541e-4910-9f87-67e42b32ddd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c84c93cc00f4abab7068472a99fca01'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:05.673598 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-1256f843-541e-4910-9f87-67e42b32ddd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c84c93cc00f4abab7068472a99fca01'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:05.691944 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-1256f843-541e-4910-9f87-67e42b32ddd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c84c93cc00f4abab7068472a99fca01'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:05.702095 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-1256f843-541e-4910-9f87-67e42b32ddd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c84c93cc00f4abab7068472a99fca01'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:05.716514 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1187/2400] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:37:05 2022] DELETE /identity/v3/users/1c84c93cc00f4abab7068472a99fca01 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:37:05.721169 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e30ba-f611-4659-91a6-d0ea72e179e8 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:05.721456 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e30ba-f611-4659-91a6-d0ea72e179e8 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:05.721726 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e30ba-f611-4659-91a6-d0ea72e179e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:05.740013 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-934e30ba-f611-4659-91a6-d0ea72e179e8 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:37:05.741204 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-934e30ba-f611-4659-91a6-d0ea72e179e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:37:05.800748 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1214/2401] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:37:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:37:05.811158 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1256f843-541e-4910-9f87-67e42b32ddd2 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:05.813073 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1256f843-541e-4910-9f87-67e42b32ddd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:37:05.871634 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1256f843-541e-4910-9f87-67e42b32ddd2 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:05.876187 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2a5a8d-e75b-4051-bf19-5a043c3fdfe6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:05.876834 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a5a8d-e75b-4051-bf19-5a043c3fdfe6 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:05.877123 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a5a8d-e75b-4051-bf19-5a043c3fdfe6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:05.877393 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a5a8d-e75b-4051-bf19-5a043c3fdfe6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:05.887016 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2a5a8d-e75b-4051-bf19-5a043c3fdfe6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:05.888474 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2a5a8d-e75b-4051-bf19-5a043c3fdfe6 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:05.898520 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1188/2402] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:37:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:37:06.319802 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e30ba-f611-4659-91a6-d0ea72e179e8 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:06.321385 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-934e30ba-f611-4659-91a6-d0ea72e179e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:37:06.334070 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e30ba-f611-4659-91a6-d0ea72e179e8 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:06.340288 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea38f16-3878-4d2c-a618-e12620c44c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:06.341102 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea38f16-3878-4d2c-a618-e12620c44c6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:06.341444 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea38f16-3878-4d2c-a618-e12620c44c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:06.341780 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea38f16-3878-4d2c-a618-e12620c44c6b admin admin] PATH_INFO: `/v3/projects/c8bbaaa3e4d44b4b848d077e3326d932` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:06.343619 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea38f16-3878-4d2c-a618-e12620c44c6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8bbaaa3e4d44b4b848d077e3326d932)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:06.350404 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea38f16-3878-4d2c-a618-e12620c44c6b admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:06.406534 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-2ea38f16-3878-4d2c-a618-e12620c44c6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8bbaaa3e4d44b4b848d077e3326d932', 'request_id': 'req-2ea38f16-3878-4d2c-a618-e12620c44c6b'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:06.412533 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-2ea38f16-3878-4d2c-a618-e12620c44c6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8bbaaa3e4d44b4b848d077e3326d932', 'request_id': 'req-2ea38f16-3878-4d2c-a618-e12620c44c6b'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:06.418718 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-2ea38f16-3878-4d2c-a618-e12620c44c6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8bbaaa3e4d44b4b848d077e3326d932', 'request_id': 'req-2ea38f16-3878-4d2c-a618-e12620c44c6b'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:06.430620 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-2ea38f16-3878-4d2c-a618-e12620c44c6b admin admin] The token cache is being invalidate because project c8bbaaa3e4d44b4b848d077e3326d932 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:37:06.430927 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-2ea38f16-3878-4d2c-a618-e12620c44c6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:06.431559 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-2ea38f16-3878-4d2c-a618-e12620c44c6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:06.433106 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1215/2403] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:37:06 2022] DELETE /identity/v3/projects/c8bbaaa3e4d44b4b848d077e3326d932 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:37:06.437189 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2a5a8d-e75b-4051-bf19-5a043c3fdfe6 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:06.447064 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2a5a8d-e75b-4051-bf19-5a043c3fdfe6 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:06.506695 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc03c58-4cfe-408c-9d9b-e31de5d41262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:06.507601 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc03c58-4cfe-408c-9d9b-e31de5d41262 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:06.507875 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc03c58-4cfe-408c-9d9b-e31de5d41262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:06.508144 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc03c58-4cfe-408c-9d9b-e31de5d41262 admin admin] PATH_INFO: `/v3/users/21d2df3605ac41fbbd59a8d81efb26ec` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:06.509386 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc03c58-4cfe-408c-9d9b-e31de5d41262 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21d2df3605ac41fbbd59a8d81efb26ec)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:06.511356 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc03c58-4cfe-408c-9d9b-e31de5d41262 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:06.545504 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:37:06.559264 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-efc03c58-4cfe-408c-9d9b-e31de5d41262 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21d2df3605ac41fbbd59a8d81efb26ec'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:06.559896 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-efc03c58-4cfe-408c-9d9b-e31de5d41262 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21d2df3605ac41fbbd59a8d81efb26ec'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:06.561101 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-efc03c58-4cfe-408c-9d9b-e31de5d41262 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21d2df3605ac41fbbd59a8d81efb26ec'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:06.572823 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-efc03c58-4cfe-408c-9d9b-e31de5d41262 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21d2df3605ac41fbbd59a8d81efb26ec'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:06.579513 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-efc03c58-4cfe-408c-9d9b-e31de5d41262 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21d2df3605ac41fbbd59a8d81efb26ec'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:06.594130 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1189/2404] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:37:06 2022] DELETE /identity/v3/users/21d2df3605ac41fbbd59a8d81efb26ec => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 03:37:06.879468 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea38f16-3878-4d2c-a618-e12620c44c6b admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:06.881084 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-2ea38f16-3878-4d2c-a618-e12620c44c6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:37:06.894903 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea38f16-3878-4d2c-a618-e12620c44c6b admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:06.962030 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22510f0c-385d-4d23-a17b-b1e741e62d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:06.962876 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22510f0c-385d-4d23-a17b-b1e741e62d5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:06.963199 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22510f0c-385d-4d23-a17b-b1e741e62d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:06.963462 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22510f0c-385d-4d23-a17b-b1e741e62d5f admin admin] PATH_INFO: `/v3/projects/ca2b9ba0013749c48ecfdd14aa92831a` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:06.964679 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22510f0c-385d-4d23-a17b-b1e741e62d5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca2b9ba0013749c48ecfdd14aa92831a)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:06.966586 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22510f0c-385d-4d23-a17b-b1e741e62d5f admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:06.982483 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:37:07.017016 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-22510f0c-385d-4d23-a17b-b1e741e62d5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca2b9ba0013749c48ecfdd14aa92831a', 'request_id': 'req-22510f0c-385d-4d23-a17b-b1e741e62d5f'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:07.022681 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-22510f0c-385d-4d23-a17b-b1e741e62d5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca2b9ba0013749c48ecfdd14aa92831a', 'request_id': 'req-22510f0c-385d-4d23-a17b-b1e741e62d5f'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:07.028934 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-22510f0c-385d-4d23-a17b-b1e741e62d5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca2b9ba0013749c48ecfdd14aa92831a', 'request_id': 'req-22510f0c-385d-4d23-a17b-b1e741e62d5f'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:07.042417 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-22510f0c-385d-4d23-a17b-b1e741e62d5f admin admin] The token cache is being invalidate because project ca2b9ba0013749c48ecfdd14aa92831a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:37:07.042707 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-22510f0c-385d-4d23-a17b-b1e741e62d5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:07.043456 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-22510f0c-385d-4d23-a17b-b1e741e62d5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:07.045110 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1216/2405] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:37:06 2022] DELETE /identity/v3/projects/ca2b9ba0013749c48ecfdd14aa92831a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:37:07.050089 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf269fa-a6c6-44ab-b736-71c506e01828 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:07.050380 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf269fa-a6c6-44ab-b736-71c506e01828 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:07.050658 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf269fa-a6c6-44ab-b736-71c506e01828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:07.069707 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-adf269fa-a6c6-44ab-b736-71c506e01828 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:37:07.070922 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-adf269fa-a6c6-44ab-b736-71c506e01828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:37:07.129251 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1190/2406] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:37:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:37:07.138310 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e304f96-3e36-4646-a2a6-e8f71b2d2c3c None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:07.138598 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e304f96-3e36-4646-a2a6-e8f71b2d2c3c None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:07.138872 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e304f96-3e36-4646-a2a6-e8f71b2d2c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:07.157555 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-6e304f96-3e36-4646-a2a6-e8f71b2d2c3c None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:37:07.158755 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-6e304f96-3e36-4646-a2a6-e8f71b2d2c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:37:07.168543 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1217/2407] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:37:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:37:07.226961 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf269fa-a6c6-44ab-b736-71c506e01828 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:07.237483 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf269fa-a6c6-44ab-b736-71c506e01828 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:07.243845 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95434b56-0316-4cac-a81e-d72762f6f872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:07.244503 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95434b56-0316-4cac-a81e-d72762f6f872 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:07.244783 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95434b56-0316-4cac-a81e-d72762f6f872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:07.245056 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95434b56-0316-4cac-a81e-d72762f6f872 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:07.245812 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95434b56-0316-4cac-a81e-d72762f6f872 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:37:07.246117 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95434b56-0316-4cac-a81e-d72762f6f872 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:07.247804 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95434b56-0316-4cac-a81e-d72762f6f872 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:07.260761 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1191/2408] 10.222.0.60 () {58 vars in 1152 bytes} [Sat Jul 2 03:37:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:37:07.265311 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e304f96-3e36-4646-a2a6-e8f71b2d2c3c None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:07.275073 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e304f96-3e36-4646-a2a6-e8f71b2d2c3c None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:07.281051 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba660033-107d-4ce5-a7e7-60ef16893d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:07.281703 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba660033-107d-4ce5-a7e7-60ef16893d9f admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:07.281984 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba660033-107d-4ce5-a7e7-60ef16893d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:07.282250 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba660033-107d-4ce5-a7e7-60ef16893d9f admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:07.282937 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba660033-107d-4ce5-a7e7-60ef16893d9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:07.285208 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba660033-107d-4ce5-a7e7-60ef16893d9f admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:07.315102 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1218/2409] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:37:07 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:37:07.319339 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95434b56-0316-4cac-a81e-d72762f6f872 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:07.329831 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95434b56-0316-4cac-a81e-d72762f6f872 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:07.394382 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0479c7-0cb0-4818-b834-14831e4cd602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:07.395082 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0479c7-0cb0-4818-b834-14831e4cd602 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:07.395444 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0479c7-0cb0-4818-b834-14831e4cd602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:07.395878 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0479c7-0cb0-4818-b834-14831e4cd602 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:07.396715 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0479c7-0cb0-4818-b834-14831e4cd602 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:07.399283 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0479c7-0cb0-4818-b834-14831e4cd602 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:07.425486 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1192/2410] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:37:07 2022] POST /identity/v3/users => generated 283 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:37:07.429499 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba660033-107d-4ce5-a7e7-60ef16893d9f admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:07.440640 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba660033-107d-4ce5-a7e7-60ef16893d9f admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:07.445499 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a2ee8-f14b-4738-836b-89e31e29cafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:07.446182 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a2ee8-f14b-4738-836b-89e31e29cafe admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:07.446481 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a2ee8-f14b-4738-836b-89e31e29cafe admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:07.446741 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a2ee8-f14b-4738-836b-89e31e29cafe admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:07.447523 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20a2ee8-f14b-4738-836b-89e31e29cafe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:07.449140 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20a2ee8-f14b-4738-836b-89e31e29cafe admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:07.460703 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1219/2411] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:37:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:37:07.465114 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0479c7-0cb0-4818-b834-14831e4cd602 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:07.475696 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0479c7-0cb0-4818-b834-14831e4cd602 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:07.480674 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc9210d-9723-476f-aef3-73fdad381cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:07.481347 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc9210d-9723-476f-aef3-73fdad381cd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:07.481624 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc9210d-9723-476f-aef3-73fdad381cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:07.481895 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc9210d-9723-476f-aef3-73fdad381cd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:07.482759 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc9210d-9723-476f-aef3-73fdad381cd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:07.484406 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc9210d-9723-476f-aef3-73fdad381cd2 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:07.499157 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1193/2412] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:37:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:37:07.500781 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a2ee8-f14b-4738-836b-89e31e29cafe admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:07.510939 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a2ee8-f14b-4738-836b-89e31e29cafe admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:07.521622 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe2e5d2-11ef-460f-9ead-30552396efff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:07.522640 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2e5d2-11ef-460f-9ead-30552396efff admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:07.522965 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2e5d2-11ef-460f-9ead-30552396efff admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:07.523378 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2e5d2-11ef-460f-9ead-30552396efff admin admin] PATH_INFO: `/v3/projects/b1be4c3476f04a79940569ca7d121e1e/users/f7412c72b67546068801fc53ef4a3161/roles/c43aada0326446c4ade0ab1262918fa4` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:07.539941 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe2e5d2-11ef-460f-9ead-30552396efff admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1be4c3476f04a79940569ca7d121e1e, user_id=f7412c72b67546068801fc53ef4a3161, role_id=c43aada0326446c4ade0ab1262918fa4)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:07.542717 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe2e5d2-11ef-460f-9ead-30552396efff admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:07.564668 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1220/2413] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:37:07 2022] PUT /identity/v3/projects/b1be4c3476f04a79940569ca7d121e1e/users/f7412c72b67546068801fc53ef4a3161/roles/c43aada0326446c4ade0ab1262918fa4 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:37:07.568648 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26d749d-c1c7-413b-a82f-260dfc191ef1 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:07.569179 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26d749d-c1c7-413b-a82f-260dfc191ef1 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:07.569179 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26d749d-c1c7-413b-a82f-260dfc191ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:07.599477 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:37:07.603064 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-c26d749d-c1c7-413b-a82f-260dfc191ef1 None None] MFA Rules not processed for user `f7412c72b67546068801fc53ef4a3161`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:37:07.604845 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c26d749d-c1c7-413b-a82f-260dfc191ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:37:07.672614 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1194/2414] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:37:07 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:37:07.677853 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe2e5d2-11ef-460f-9ead-30552396efff admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:07.749650 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe2e5d2-11ef-460f-9ead-30552396efff admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:07.755471 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cbcb87-b5d9-4c52-bd95-1c756f1b2c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:07.756198 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cbcb87-b5d9-4c52-bd95-1c756f1b2c28 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:07.756496 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cbcb87-b5d9-4c52-bd95-1c756f1b2c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:07.756790 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cbcb87-b5d9-4c52-bd95-1c756f1b2c28 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:07.757534 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cbcb87-b5d9-4c52-bd95-1c756f1b2c28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:07.759513 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cbcb87-b5d9-4c52-bd95-1c756f1b2c28 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:07.785734 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1221/2415] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:37:07 2022] POST /identity/v3/projects => generated 367 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:37:07.790080 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26d749d-c1c7-413b-a82f-260dfc191ef1 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:07.801691 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26d749d-c1c7-413b-a82f-260dfc191ef1 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:07.863323 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5413aa54-374b-42b8-8b21-82a3eeca54c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:07.863996 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5413aa54-374b-42b8-8b21-82a3eeca54c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:07.864282 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5413aa54-374b-42b8-8b21-82a3eeca54c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:07.864557 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5413aa54-374b-42b8-8b21-82a3eeca54c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:07.865289 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5413aa54-374b-42b8-8b21-82a3eeca54c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:07.867270 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5413aa54-374b-42b8-8b21-82a3eeca54c8 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:07.893223 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1195/2416] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:37:07 2022] POST /identity/v3/users => generated 290 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:37:07.897373 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cbcb87-b5d9-4c52-bd95-1c756f1b2c28 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:07.908515 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cbcb87-b5d9-4c52-bd95-1c756f1b2c28 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:07.914213 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4caa6f4-f98b-4eb8-822a-b5e92d7cf2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:07.914867 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4caa6f4-f98b-4eb8-822a-b5e92d7cf2ef admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:07.915152 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4caa6f4-f98b-4eb8-822a-b5e92d7cf2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:07.915453 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4caa6f4-f98b-4eb8-822a-b5e92d7cf2ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:07.916188 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4caa6f4-f98b-4eb8-822a-b5e92d7cf2ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:07.917790 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4caa6f4-f98b-4eb8-822a-b5e92d7cf2ef admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:07.929442 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1222/2417] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:37:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:37:07.933636 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5413aa54-374b-42b8-8b21-82a3eeca54c8 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:07.944394 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5413aa54-374b-42b8-8b21-82a3eeca54c8 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:07.950297 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32068c7a-5357-4b0c-bc20-338f8a6854b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:07.951225 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32068c7a-5357-4b0c-bc20-338f8a6854b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:07.951507 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32068c7a-5357-4b0c-bc20-338f8a6854b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:07.951784 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32068c7a-5357-4b0c-bc20-338f8a6854b0 admin admin] PATH_INFO: `/v3/projects/4f0be2ac740f4994addf74635b57e816/users/60ce4b99ce9848719b72dcefc3655cfc/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:07.966912 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32068c7a-5357-4b0c-bc20-338f8a6854b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f0be2ac740f4994addf74635b57e816, user_id=60ce4b99ce9848719b72dcefc3655cfc, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:07.969672 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32068c7a-5357-4b0c-bc20-338f8a6854b0 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:07.983703 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1196/2418] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:37:07 2022] PUT /identity/v3/projects/4f0be2ac740f4994addf74635b57e816/users/60ce4b99ce9848719b72dcefc3655cfc/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:37:07.987720 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4caa6f4-f98b-4eb8-822a-b5e92d7cf2ef admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:07.998379 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4caa6f4-f98b-4eb8-822a-b5e92d7cf2ef admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:08.008846 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:37:08.059910 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c7a69-3113-40cb-916d-01c58f807047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:08.060574 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c7a69-3113-40cb-916d-01c58f807047 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:08.060868 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c7a69-3113-40cb-916d-01c58f807047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:08.061141 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c7a69-3113-40cb-916d-01c58f807047 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:08.061885 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448c7a69-3113-40cb-916d-01c58f807047 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:08.063504 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448c7a69-3113-40cb-916d-01c58f807047 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:08.073589 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1223/2419] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:37:07 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:37:08.078113 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32068c7a-5357-4b0c-bc20-338f8a6854b0 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:08.088860 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32068c7a-5357-4b0c-bc20-338f8a6854b0 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:08.093671 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33afcf57-2741-47c3-8f54-396d6135ee13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:08.094552 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33afcf57-2741-47c3-8f54-396d6135ee13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:08.094830 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33afcf57-2741-47c3-8f54-396d6135ee13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:08.095102 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33afcf57-2741-47c3-8f54-396d6135ee13 admin admin] PATH_INFO: `/v3/projects/4f0be2ac740f4994addf74635b57e816/users/60ce4b99ce9848719b72dcefc3655cfc/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:08.097204 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33afcf57-2741-47c3-8f54-396d6135ee13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f0be2ac740f4994addf74635b57e816, user_id=60ce4b99ce9848719b72dcefc3655cfc, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:08.099920 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33afcf57-2741-47c3-8f54-396d6135ee13 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:08.111552 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1197/2420] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:37:08 2022] PUT /identity/v3/projects/4f0be2ac740f4994addf74635b57e816/users/60ce4b99ce9848719b72dcefc3655cfc/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:37:08.121786 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abce979-9850-4bfa-b13d-c6510b401849 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:08.122074 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abce979-9850-4bfa-b13d-c6510b401849 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:08.122371 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abce979-9850-4bfa-b13d-c6510b401849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:08.151426 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-8abce979-9850-4bfa-b13d-c6510b401849 None None] MFA Rules not processed for user `60ce4b99ce9848719b72dcefc3655cfc`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:37:08.152636 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-8abce979-9850-4bfa-b13d-c6510b401849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:37:08.225803 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1224/2421] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:37:08 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:37:08.238366 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33afcf57-2741-47c3-8f54-396d6135ee13 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:08.240340 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-33afcf57-2741-47c3-8f54-396d6135ee13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:37:08.298787 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33afcf57-2741-47c3-8f54-396d6135ee13 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:08.302836 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e47e0b5-7eb7-4734-8686-0235d923e70c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:08.303498 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e47e0b5-7eb7-4734-8686-0235d923e70c service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:08.303864 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e47e0b5-7eb7-4734-8686-0235d923e70c service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:08.304136 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e47e0b5-7eb7-4734-8686-0235d923e70c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:08.313598 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e47e0b5-7eb7-4734-8686-0235d923e70c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:08.315037 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e47e0b5-7eb7-4734-8686-0235d923e70c service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:08.318955 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:37:08.325900 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1198/2422] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:37:08 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:37:08.410558 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abce979-9850-4bfa-b13d-c6510b401849 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:08.421262 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abce979-9850-4bfa-b13d-c6510b401849 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:08.425666 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc89747-2919-4c82-ae25-a24d4e3ff9e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:08.426284 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc89747-2919-4c82-ae25-a24d4e3ff9e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:08.426578 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc89747-2919-4c82-ae25-a24d4e3ff9e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:08.426845 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc89747-2919-4c82-ae25-a24d4e3ff9e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:08.485886 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc89747-2919-4c82-ae25-a24d4e3ff9e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:08.487352 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc89747-2919-4c82-ae25-a24d4e3ff9e9 service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:08.496731 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1225/2423] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:37:08 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:37:13.297971 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e47e0b5-7eb7-4734-8686-0235d923e70c service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:13.364058 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e47e0b5-7eb7-4734-8686-0235d923e70c service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:13.369609 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f06f81-d2c5-4b11-b4d4-8d62fa9640f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:13.370540 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f06f81-d2c5-4b11-b4d4-8d62fa9640f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:13.370759 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f06f81-d2c5-4b11-b4d4-8d62fa9640f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:13.371027 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f06f81-d2c5-4b11-b4d4-8d62fa9640f0 admin admin] PATH_INFO: `/v3/users/f7412c72b67546068801fc53ef4a3161` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:13.372324 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f06f81-d2c5-4b11-b4d4-8d62fa9640f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7412c72b67546068801fc53ef4a3161)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:13.374258 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f06f81-d2c5-4b11-b4d4-8d62fa9640f0 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:13.424089 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-24f06f81-d2c5-4b11-b4d4-8d62fa9640f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7412c72b67546068801fc53ef4a3161'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:13.424737 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-24f06f81-d2c5-4b11-b4d4-8d62fa9640f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7412c72b67546068801fc53ef4a3161'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:13.425332 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-24f06f81-d2c5-4b11-b4d4-8d62fa9640f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7412c72b67546068801fc53ef4a3161'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:13.437600 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-24f06f81-d2c5-4b11-b4d4-8d62fa9640f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7412c72b67546068801fc53ef4a3161'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:13.444537 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-24f06f81-d2c5-4b11-b4d4-8d62fa9640f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7412c72b67546068801fc53ef4a3161'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:13.459264 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1199/2424] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:37:13 2022] DELETE /identity/v3/users/f7412c72b67546068801fc53ef4a3161 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:37:13.463805 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510b5d3-d6fb-4e6e-8dc0-2a59263e9ce8 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:13.464243 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510b5d3-d6fb-4e6e-8dc0-2a59263e9ce8 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:13.464438 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510b5d3-d6fb-4e6e-8dc0-2a59263e9ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:13.482002 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-1510b5d3-d6fb-4e6e-8dc0-2a59263e9ce8 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:37:13.483244 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-1510b5d3-d6fb-4e6e-8dc0-2a59263e9ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:37:13.515159 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:37:13.546191 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1226/2425] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:37:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:37:13.555858 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f06f81-d2c5-4b11-b4d4-8d62fa9640f0 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:13.557389 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-24f06f81-d2c5-4b11-b4d4-8d62fa9640f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:37:13.616781 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f06f81-d2c5-4b11-b4d4-8d62fa9640f0 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:13.620757 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b97503-0b33-43c4-bb6b-ca28feb4955a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:13.621372 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b97503-0b33-43c4-bb6b-ca28feb4955a service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:13.621779 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b97503-0b33-43c4-bb6b-ca28feb4955a service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:13.622052 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b97503-0b33-43c4-bb6b-ca28feb4955a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:13.631105 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b97503-0b33-43c4-bb6b-ca28feb4955a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:13.632587 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b97503-0b33-43c4-bb6b-ca28feb4955a service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:13.642222 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1200/2426] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:37:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 03:37:13.928835 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1510b5d3-d6fb-4e6e-8dc0-2a59263e9ce8 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:13.930427 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-1510b5d3-d6fb-4e6e-8dc0-2a59263e9ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:37:13.949778 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1510b5d3-d6fb-4e6e-8dc0-2a59263e9ce8 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:13.955597 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5357732-bbef-4943-98a9-cde1580a810c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:13.956485 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5357732-bbef-4943-98a9-cde1580a810c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:13.956767 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5357732-bbef-4943-98a9-cde1580a810c admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:13.957034 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5357732-bbef-4943-98a9-cde1580a810c admin admin] PATH_INFO: `/v3/projects/b1be4c3476f04a79940569ca7d121e1e` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:13.958361 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5357732-bbef-4943-98a9-cde1580a810c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1be4c3476f04a79940569ca7d121e1e)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:13.960344 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5357732-bbef-4943-98a9-cde1580a810c admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:14.011158 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-c5357732-bbef-4943-98a9-cde1580a810c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1be4c3476f04a79940569ca7d121e1e', 'request_id': 'req-c5357732-bbef-4943-98a9-cde1580a810c'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:14.016990 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-c5357732-bbef-4943-98a9-cde1580a810c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1be4c3476f04a79940569ca7d121e1e', 'request_id': 'req-c5357732-bbef-4943-98a9-cde1580a810c'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:14.023642 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-c5357732-bbef-4943-98a9-cde1580a810c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1be4c3476f04a79940569ca7d121e1e', 'request_id': 'req-c5357732-bbef-4943-98a9-cde1580a810c'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:14.041947 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-c5357732-bbef-4943-98a9-cde1580a810c admin admin] The token cache is being invalidate because project b1be4c3476f04a79940569ca7d121e1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:37:14.042233 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-c5357732-bbef-4943-98a9-cde1580a810c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:14.042868 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-c5357732-bbef-4943-98a9-cde1580a810c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:14.044731 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1227/2427] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:37:13 2022] DELETE /identity/v3/projects/b1be4c3476f04a79940569ca7d121e1e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:37:14.048602 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b97503-0b33-43c4-bb6b-ca28feb4955a service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:14.058945 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b97503-0b33-43c4-bb6b-ca28feb4955a service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:14.077180 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:37:14.119849 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09df7a8-fb2e-4d11-8983-1d40578abc7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:14.120718 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09df7a8-fb2e-4d11-8983-1d40578abc7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:14.120989 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09df7a8-fb2e-4d11-8983-1d40578abc7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:14.121263 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09df7a8-fb2e-4d11-8983-1d40578abc7b admin admin] PATH_INFO: `/v3/users/60ce4b99ce9848719b72dcefc3655cfc` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:14.122456 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09df7a8-fb2e-4d11-8983-1d40578abc7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=60ce4b99ce9848719b72dcefc3655cfc)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:14.124441 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09df7a8-fb2e-4d11-8983-1d40578abc7b admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:14.170749 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a09df7a8-fb2e-4d11-8983-1d40578abc7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60ce4b99ce9848719b72dcefc3655cfc'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:14.171353 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a09df7a8-fb2e-4d11-8983-1d40578abc7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60ce4b99ce9848719b72dcefc3655cfc'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:14.171958 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a09df7a8-fb2e-4d11-8983-1d40578abc7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60ce4b99ce9848719b72dcefc3655cfc'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:14.183903 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a09df7a8-fb2e-4d11-8983-1d40578abc7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60ce4b99ce9848719b72dcefc3655cfc'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:14.191024 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a09df7a8-fb2e-4d11-8983-1d40578abc7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60ce4b99ce9848719b72dcefc3655cfc'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:14.204373 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1201/2428] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:37:14 2022] DELETE /identity/v3/users/60ce4b99ce9848719b72dcefc3655cfc => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:37:14.479773 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5357732-bbef-4943-98a9-cde1580a810c admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:14.481256 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-c5357732-bbef-4943-98a9-cde1580a810c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:37:14.494741 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5357732-bbef-4943-98a9-cde1580a810c admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:14.555952 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4826d24-d595-4a08-be76-e00062bedfae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:14.556823 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4826d24-d595-4a08-be76-e00062bedfae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:14.557130 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4826d24-d595-4a08-be76-e00062bedfae admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:14.557402 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4826d24-d595-4a08-be76-e00062bedfae admin admin] PATH_INFO: `/v3/projects/4f0be2ac740f4994addf74635b57e816` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:14.558649 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4826d24-d595-4a08-be76-e00062bedfae admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f0be2ac740f4994addf74635b57e816)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:14.560698 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4826d24-d595-4a08-be76-e00062bedfae admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:14.609042 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d4826d24-d595-4a08-be76-e00062bedfae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f0be2ac740f4994addf74635b57e816', 'request_id': 'req-d4826d24-d595-4a08-be76-e00062bedfae'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:14.614590 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d4826d24-d595-4a08-be76-e00062bedfae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f0be2ac740f4994addf74635b57e816', 'request_id': 'req-d4826d24-d595-4a08-be76-e00062bedfae'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:14.615690 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:37:14.622613 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d4826d24-d595-4a08-be76-e00062bedfae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f0be2ac740f4994addf74635b57e816', 'request_id': 'req-d4826d24-d595-4a08-be76-e00062bedfae'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:14.637742 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d4826d24-d595-4a08-be76-e00062bedfae admin admin] The token cache is being invalidate because project 4f0be2ac740f4994addf74635b57e816 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:37:14.638042 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d4826d24-d595-4a08-be76-e00062bedfae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:14.638665 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d4826d24-d595-4a08-be76-e00062bedfae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:14.640396 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1228/2429] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:37:14 2022] DELETE /identity/v3/projects/4f0be2ac740f4994addf74635b57e816 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:37:14.645534 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf504fd0-27fe-4d1d-a07d-911e6a028f30 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:14.646053 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf504fd0-27fe-4d1d-a07d-911e6a028f30 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:14.646271 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf504fd0-27fe-4d1d-a07d-911e6a028f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:14.665230 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-bf504fd0-27fe-4d1d-a07d-911e6a028f30 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:37:14.666584 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-bf504fd0-27fe-4d1d-a07d-911e6a028f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:37:14.726909 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1202/2430] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:37:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:37:14.736181 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c957fa2-97cf-4c42-b1b9-b93ad6901a00 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:14.736440 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c957fa2-97cf-4c42-b1b9-b93ad6901a00 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:14.736723 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c957fa2-97cf-4c42-b1b9-b93ad6901a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:14.756418 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-8c957fa2-97cf-4c42-b1b9-b93ad6901a00 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:37:14.757637 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-8c957fa2-97cf-4c42-b1b9-b93ad6901a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:37:14.766227 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1229/2431] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:37:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:37:14.770497 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf504fd0-27fe-4d1d-a07d-911e6a028f30 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:14.781373 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf504fd0-27fe-4d1d-a07d-911e6a028f30 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:14.787158 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c880e8-cd8f-4694-8f4c-621f21c6d831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:14.787827 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c880e8-cd8f-4694-8f4c-621f21c6d831 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:14.788108 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c880e8-cd8f-4694-8f4c-621f21c6d831 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:14.788382 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c880e8-cd8f-4694-8f4c-621f21c6d831 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:14.789143 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c880e8-cd8f-4694-8f4c-621f21c6d831 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:37:14.789452 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c880e8-cd8f-4694-8f4c-621f21c6d831 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:14.791283 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c880e8-cd8f-4694-8f4c-621f21c6d831 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:14.803194 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1203/2432] 10.222.0.60 () {58 vars in 1152 bytes} [Sat Jul 2 03:37:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:37:14.807621 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c957fa2-97cf-4c42-b1b9-b93ad6901a00 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:14.817081 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c957fa2-97cf-4c42-b1b9-b93ad6901a00 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:14.822088 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccc8ff7-f0c7-4b85-b200-b8e11a2137e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:14.822732 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccc8ff7-f0c7-4b85-b200-b8e11a2137e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:14.823009 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccc8ff7-f0c7-4b85-b200-b8e11a2137e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:14.823319 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccc8ff7-f0c7-4b85-b200-b8e11a2137e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:14.824012 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccc8ff7-f0c7-4b85-b200-b8e11a2137e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:14.825897 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccc8ff7-f0c7-4b85-b200-b8e11a2137e3 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:14.852254 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1230/2433] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:37:14 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 03:37:14.857622 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c880e8-cd8f-4694-8f4c-621f21c6d831 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:14.869726 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c880e8-cd8f-4694-8f4c-621f21c6d831 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:14.900287 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:37:14.934903 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8113298-1fb9-404a-9887-c1bf789a4a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:14.935593 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8113298-1fb9-404a-9887-c1bf789a4a44 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:14.935878 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8113298-1fb9-404a-9887-c1bf789a4a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:14.936173 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8113298-1fb9-404a-9887-c1bf789a4a44 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:14.936888 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8113298-1fb9-404a-9887-c1bf789a4a44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:14.938821 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8113298-1fb9-404a-9887-c1bf789a4a44 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:14.962825 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1204/2434] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:37:14 2022] POST /identity/v3/users => generated 288 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 03:37:14.968179 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccc8ff7-f0c7-4b85-b200-b8e11a2137e3 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:14.980648 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccc8ff7-f0c7-4b85-b200-b8e11a2137e3 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:14.986598 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8ab6d3-4cce-445b-8c43-71d0a635f9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:14.987318 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ab6d3-4cce-445b-8c43-71d0a635f9cf admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:14.987596 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ab6d3-4cce-445b-8c43-71d0a635f9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:14.987863 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ab6d3-4cce-445b-8c43-71d0a635f9cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:14.988608 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8ab6d3-4cce-445b-8c43-71d0a635f9cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:14.990226 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8ab6d3-4cce-445b-8c43-71d0a635f9cf admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:15.002506 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1231/2435] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:37:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:37:15.008666 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8113298-1fb9-404a-9887-c1bf789a4a44 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:15.020378 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8113298-1fb9-404a-9887-c1bf789a4a44 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:15.027714 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a224be42-8829-4450-82bf-fef43f7a708a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:15.028445 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224be42-8829-4450-82bf-fef43f7a708a admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:15.028712 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224be42-8829-4450-82bf-fef43f7a708a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:15.029003 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224be42-8829-4450-82bf-fef43f7a708a admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:15.029733 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a224be42-8829-4450-82bf-fef43f7a708a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:15.031534 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a224be42-8829-4450-82bf-fef43f7a708a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:15.042894 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1205/2436] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:37:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:37:15.048056 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8ab6d3-4cce-445b-8c43-71d0a635f9cf admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:15.061466 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8ab6d3-4cce-445b-8c43-71d0a635f9cf admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:15.067195 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2903c7d-ee7d-4cfa-8070-8f28383efd08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:15.068124 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2903c7d-ee7d-4cfa-8070-8f28383efd08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:15.068403 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2903c7d-ee7d-4cfa-8070-8f28383efd08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:15.068668 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2903c7d-ee7d-4cfa-8070-8f28383efd08 admin admin] PATH_INFO: `/v3/projects/3bcbeb2d6691427b8355fec23cf738ac/users/7fcde6ea8ced426b8de45f86008217e6/roles/c43aada0326446c4ade0ab1262918fa4` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:15.092784 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2903c7d-ee7d-4cfa-8070-8f28383efd08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bcbeb2d6691427b8355fec23cf738ac, user_id=7fcde6ea8ced426b8de45f86008217e6, role_id=c43aada0326446c4ade0ab1262918fa4)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:15.096283 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2903c7d-ee7d-4cfa-8070-8f28383efd08 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:15.123174 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1232/2437] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:37:15 2022] PUT /identity/v3/projects/3bcbeb2d6691427b8355fec23cf738ac/users/7fcde6ea8ced426b8de45f86008217e6/roles/c43aada0326446c4ade0ab1262918fa4 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:37:15.133817 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a732a-67b2-4ac0-ac6e-e3fd7461a688 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:15.134109 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a732a-67b2-4ac0-ac6e-e3fd7461a688 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:15.134382 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a732a-67b2-4ac0-ac6e-e3fd7461a688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:15.160882 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-df2a732a-67b2-4ac0-ac6e-e3fd7461a688 None None] MFA Rules not processed for user `7fcde6ea8ced426b8de45f86008217e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:37:15.162083 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-df2a732a-67b2-4ac0-ac6e-e3fd7461a688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:37:15.228137 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1206/2438] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:37:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:37:15.233051 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2903c7d-ee7d-4cfa-8070-8f28383efd08 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:15.295973 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2903c7d-ee7d-4cfa-8070-8f28383efd08 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:15.301177 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588bf472-b5a4-4e10-829c-1fd867b190a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:15.301828 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588bf472-b5a4-4e10-829c-1fd867b190a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:15.302111 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588bf472-b5a4-4e10-829c-1fd867b190a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:15.302379 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588bf472-b5a4-4e10-829c-1fd867b190a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:15.303075 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588bf472-b5a4-4e10-829c-1fd867b190a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:15.305080 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588bf472-b5a4-4e10-829c-1fd867b190a5 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:15.333743 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1233/2439] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:37:15 2022] POST /identity/v3/projects => generated 375 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:37:15.339342 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a732a-67b2-4ac0-ac6e-e3fd7461a688 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:15.350058 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a732a-67b2-4ac0-ac6e-e3fd7461a688 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:15.408055 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b560e6d-f8e8-4214-a5fe-0dfae770fca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:15.408716 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b560e6d-f8e8-4214-a5fe-0dfae770fca5 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:15.408998 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b560e6d-f8e8-4214-a5fe-0dfae770fca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:15.409269 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b560e6d-f8e8-4214-a5fe-0dfae770fca5 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:15.410270 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b560e6d-f8e8-4214-a5fe-0dfae770fca5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:15.412237 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b560e6d-f8e8-4214-a5fe-0dfae770fca5 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:15.433148 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1207/2440] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:37:15 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:37:15.437301 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588bf472-b5a4-4e10-829c-1fd867b190a5 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:15.447762 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588bf472-b5a4-4e10-829c-1fd867b190a5 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:15.452974 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77befb4-bc2e-4b6e-a87d-18f3e17ba339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:15.453634 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77befb4-bc2e-4b6e-a87d-18f3e17ba339 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:15.453912 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77befb4-bc2e-4b6e-a87d-18f3e17ba339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:15.454191 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77befb4-bc2e-4b6e-a87d-18f3e17ba339 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:15.454921 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77befb4-bc2e-4b6e-a87d-18f3e17ba339 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:15.456601 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77befb4-bc2e-4b6e-a87d-18f3e17ba339 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:15.468849 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1234/2441] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:37:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:37:15.472837 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b560e6d-f8e8-4214-a5fe-0dfae770fca5 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:15.483269 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b560e6d-f8e8-4214-a5fe-0dfae770fca5 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:15.488605 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e2e49-1eea-4721-9d2b-9e8784880831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:15.489336 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e2e49-1eea-4721-9d2b-9e8784880831 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:15.489621 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e2e49-1eea-4721-9d2b-9e8784880831 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:15.489936 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e2e49-1eea-4721-9d2b-9e8784880831 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:15.490671 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e2e49-1eea-4721-9d2b-9e8784880831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:15.492321 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e2e49-1eea-4721-9d2b-9e8784880831 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:15.503662 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1208/2442] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:37:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:37:15.508681 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77befb4-bc2e-4b6e-a87d-18f3e17ba339 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:15.524467 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77befb4-bc2e-4b6e-a87d-18f3e17ba339 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:15.532193 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d7fd2-629b-4294-a355-b8441f099ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:15.533443 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d7fd2-629b-4294-a355-b8441f099ce6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:15.533825 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d7fd2-629b-4294-a355-b8441f099ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:15.534220 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d7fd2-629b-4294-a355-b8441f099ce6 admin admin] PATH_INFO: `/v3/projects/896e521a4f184fe09b468cb4882e1f28/users/68cf4ca9b488449e98d5c0b36dca548f/roles/c43aada0326446c4ade0ab1262918fa4` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:15.551789 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607d7fd2-629b-4294-a355-b8441f099ce6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=896e521a4f184fe09b468cb4882e1f28, user_id=68cf4ca9b488449e98d5c0b36dca548f, role_id=c43aada0326446c4ade0ab1262918fa4)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:15.554498 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607d7fd2-629b-4294-a355-b8441f099ce6 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:15.569452 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1235/2443] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:37:15 2022] PUT /identity/v3/projects/896e521a4f184fe09b468cb4882e1f28/users/68cf4ca9b488449e98d5c0b36dca548f/roles/c43aada0326446c4ade0ab1262918fa4 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 03:37:15.585217 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1df5ce-4fc3-4ff5-bdf0-e299b0d0f0d3 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:15.585569 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1df5ce-4fc3-4ff5-bdf0-e299b0d0f0d3 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:15.585939 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1df5ce-4fc3-4ff5-bdf0-e299b0d0f0d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:15.614692 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:37:15.618333 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-fc1df5ce-4fc3-4ff5-bdf0-e299b0d0f0d3 None None] MFA Rules not processed for user `68cf4ca9b488449e98d5c0b36dca548f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:37:15.620532 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-fc1df5ce-4fc3-4ff5-bdf0-e299b0d0f0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:37:15.691385 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1209/2444] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:37:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:37:15.696145 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d7fd2-629b-4294-a355-b8441f099ce6 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:15.731370 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:37:15.760059 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d7fd2-629b-4294-a355-b8441f099ce6 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:15.764996 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36893334-f389-4d01-b648-f20d46a748eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:15.765653 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36893334-f389-4d01-b648-f20d46a748eb admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:15.765930 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36893334-f389-4d01-b648-f20d46a748eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:15.766203 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36893334-f389-4d01-b648-f20d46a748eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:15.766963 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36893334-f389-4d01-b648-f20d46a748eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:15.768902 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36893334-f389-4d01-b648-f20d46a748eb admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:15.800918 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1236/2445] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:37:15 2022] POST /identity/v3/projects => generated 377 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 03:37:15.805610 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1df5ce-4fc3-4ff5-bdf0-e299b0d0f0d3 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:15.817614 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1df5ce-4fc3-4ff5-bdf0-e299b0d0f0d3 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:15.882148 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf3ddc0-5ebe-45fb-b48e-8634d1b51ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:15.882824 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3ddc0-5ebe-45fb-b48e-8634d1b51ae0 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:15.883105 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3ddc0-5ebe-45fb-b48e-8634d1b51ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:15.883412 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3ddc0-5ebe-45fb-b48e-8634d1b51ae0 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:15.884128 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf3ddc0-5ebe-45fb-b48e-8634d1b51ae0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:15.886037 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf3ddc0-5ebe-45fb-b48e-8634d1b51ae0 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:15.909138 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1210/2446] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:37:15 2022] POST /identity/v3/users => generated 295 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:37:15.913618 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36893334-f389-4d01-b648-f20d46a748eb admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:15.924555 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36893334-f389-4d01-b648-f20d46a748eb admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:15.930681 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda78bb-6659-4308-bc07-b10e66a94223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:15.931233 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda78bb-6659-4308-bc07-b10e66a94223 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:15.931514 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda78bb-6659-4308-bc07-b10e66a94223 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:15.931810 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda78bb-6659-4308-bc07-b10e66a94223 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:15.932662 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fda78bb-6659-4308-bc07-b10e66a94223 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:15.934275 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fda78bb-6659-4308-bc07-b10e66a94223 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:15.945606 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1237/2447] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:37:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:37:15.950156 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf3ddc0-5ebe-45fb-b48e-8634d1b51ae0 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:15.961891 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf3ddc0-5ebe-45fb-b48e-8634d1b51ae0 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:15.968005 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c827ba0a-a246-4eee-929f-3598f876fa97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:15.968895 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827ba0a-a246-4eee-929f-3598f876fa97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:15.969163 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827ba0a-a246-4eee-929f-3598f876fa97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:15.969438 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827ba0a-a246-4eee-929f-3598f876fa97 admin admin] PATH_INFO: `/v3/projects/b591acc4c6724960b5fbf081a44b8bb1/users/1c21fe213570431ebb1141cdc5f013cf/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:15.985315 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c827ba0a-a246-4eee-929f-3598f876fa97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b591acc4c6724960b5fbf081a44b8bb1, user_id=1c21fe213570431ebb1141cdc5f013cf, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:15.988068 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c827ba0a-a246-4eee-929f-3598f876fa97 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:16.002612 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1211/2448] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:37:15 2022] PUT /identity/v3/projects/b591acc4c6724960b5fbf081a44b8bb1/users/1c21fe213570431ebb1141cdc5f013cf/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:37:16.006846 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda78bb-6659-4308-bc07-b10e66a94223 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:16.017250 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda78bb-6659-4308-bc07-b10e66a94223 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:16.075474 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a977aa44-3578-4839-97f0-965e78947865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:16.076187 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977aa44-3578-4839-97f0-965e78947865 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:16.076463 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977aa44-3578-4839-97f0-965e78947865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:16.076760 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977aa44-3578-4839-97f0-965e78947865 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:16.077487 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a977aa44-3578-4839-97f0-965e78947865 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:16.079071 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a977aa44-3578-4839-97f0-965e78947865 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:16.089722 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1238/2449] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:37:16.096521 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c827ba0a-a246-4eee-929f-3598f876fa97 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:16.113779 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c827ba0a-a246-4eee-929f-3598f876fa97 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:16.121315 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a68dfd-4151-41fe-aff8-0f020f31e163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:16.122211 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a68dfd-4151-41fe-aff8-0f020f31e163 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:16.122510 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a68dfd-4151-41fe-aff8-0f020f31e163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:16.122781 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a68dfd-4151-41fe-aff8-0f020f31e163 admin admin] PATH_INFO: `/v3/projects/b591acc4c6724960b5fbf081a44b8bb1/users/1c21fe213570431ebb1141cdc5f013cf/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:16.124860 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a68dfd-4151-41fe-aff8-0f020f31e163 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b591acc4c6724960b5fbf081a44b8bb1, user_id=1c21fe213570431ebb1141cdc5f013cf, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:16.127545 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a68dfd-4151-41fe-aff8-0f020f31e163 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:16.138067 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1212/2450] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:37:16 2022] PUT /identity/v3/projects/b591acc4c6724960b5fbf081a44b8bb1/users/1c21fe213570431ebb1141cdc5f013cf/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:37:16.149157 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8effd29e-df83-455f-a55d-b6fafe8ca3f2 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:16.149525 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8effd29e-df83-455f-a55d-b6fafe8ca3f2 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:16.149862 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8effd29e-df83-455f-a55d-b6fafe8ca3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:16.183305 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-8effd29e-df83-455f-a55d-b6fafe8ca3f2 None None] MFA Rules not processed for user `1c21fe213570431ebb1141cdc5f013cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:37:16.184531 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-8effd29e-df83-455f-a55d-b6fafe8ca3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:37:16.256791 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1239/2451] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:37:16 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:37:16.269009 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a68dfd-4151-41fe-aff8-0f020f31e163 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:16.270858 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-62a68dfd-4151-41fe-aff8-0f020f31e163 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:37:16.332452 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a68dfd-4151-41fe-aff8-0f020f31e163 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:16.344046 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be4a45-c4b4-4050-b13d-dff6fdf0e151 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:16.344907 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be4a45-c4b4-4050-b13d-dff6fdf0e151 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:16.345185 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be4a45-c4b4-4050-b13d-dff6fdf0e151 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:16.345468 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be4a45-c4b4-4050-b13d-dff6fdf0e151 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:16.355393 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:37:16.410034 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06be4a45-c4b4-4050-b13d-dff6fdf0e151 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:16.411559 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06be4a45-c4b4-4050-b13d-dff6fdf0e151 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:16.422375 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1213/2452] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:37:16 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:37:17.958208 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8effd29e-df83-455f-a55d-b6fafe8ca3f2 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:17.959990 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-8effd29e-df83-455f-a55d-b6fafe8ca3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:37:17.972776 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8effd29e-df83-455f-a55d-b6fafe8ca3f2 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:17.977128 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72165ad-d4b8-4eda-8e54-5866f067fd14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:17.977765 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72165ad-d4b8-4eda-8e54-5866f067fd14 service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:17.978045 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72165ad-d4b8-4eda-8e54-5866f067fd14 service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:17.978315 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72165ad-d4b8-4eda-8e54-5866f067fd14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:18.005079 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:37:18.038636 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72165ad-d4b8-4eda-8e54-5866f067fd14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:18.040098 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72165ad-d4b8-4eda-8e54-5866f067fd14 service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:18.049276 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1240/2453] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:37:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:37:18.634920 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be4a45-c4b4-4050-b13d-dff6fdf0e151 service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:18.644057 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be4a45-c4b4-4050-b13d-dff6fdf0e151 service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:18.648420 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3322ca4a-9c1e-4876-8a12-9f1486216eba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:18.649059 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322ca4a-9c1e-4876-8a12-9f1486216eba service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:18.649337 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322ca4a-9c1e-4876-8a12-9f1486216eba service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:18.649608 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322ca4a-9c1e-4876-8a12-9f1486216eba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:18.660042 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3322ca4a-9c1e-4876-8a12-9f1486216eba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:18.661504 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3322ca4a-9c1e-4876-8a12-9f1486216eba service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:18.671314 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1214/2454] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:37:18 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:37:23.633545 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72165ad-d4b8-4eda-8e54-5866f067fd14 service cinder] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:23.680303 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d59737-d2e1-46c7-aa7a-c175d6a3aa91 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:23.680891 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d59737-d2e1-46c7-aa7a-c175d6a3aa91 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:23.681098 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d59737-d2e1-46c7-aa7a-c175d6a3aa91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:23.701278 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-95d59737-d2e1-46c7-aa7a-c175d6a3aa91 None None] MFA Rules not processed for user `3333e7495b9546d882e2a2211ff8875c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:37:23.702501 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-95d59737-d2e1-46c7-aa7a-c175d6a3aa91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:37:23.702964 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72165ad-d4b8-4eda-8e54-5866f067fd14 service cinder] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:23.708088 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ba9fb-861c-4c7d-ae27-5411777ca92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:23.708957 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ba9fb-861c-4c7d-ae27-5411777ca92a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:23.709233 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ba9fb-861c-4c7d-ae27-5411777ca92a admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:23.709503 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ba9fb-861c-4c7d-ae27-5411777ca92a admin admin] PATH_INFO: `/v3/users/7fcde6ea8ced426b8de45f86008217e6` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:23.710692 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9ba9fb-861c-4c7d-ae27-5411777ca92a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fcde6ea8ced426b8de45f86008217e6)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:23.712716 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9ba9fb-861c-4c7d-ae27-5411777ca92a admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:23.760592 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1215/2455] 10.222.0.60 () {58 vars in 1009 bytes} [Sat Jul 2 03:37:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:37:23.764588 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-ee9ba9fb-861c-4c7d-ae27-5411777ca92a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fcde6ea8ced426b8de45f86008217e6'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:23.765310 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-ee9ba9fb-861c-4c7d-ae27-5411777ca92a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fcde6ea8ced426b8de45f86008217e6'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:23.774079 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-ee9ba9fb-861c-4c7d-ae27-5411777ca92a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fcde6ea8ced426b8de45f86008217e6'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:23.774775 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-ee9ba9fb-861c-4c7d-ae27-5411777ca92a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fcde6ea8ced426b8de45f86008217e6'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:23.787765 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-ee9ba9fb-861c-4c7d-ae27-5411777ca92a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fcde6ea8ced426b8de45f86008217e6'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:23.800811 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1241/2456] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:37:23 2022] DELETE /identity/v3/users/7fcde6ea8ced426b8de45f86008217e6 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:37:23.802388 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d59737-d2e1-46c7-aa7a-c175d6a3aa91 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:23.803818 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-95d59737-d2e1-46c7-aa7a-c175d6a3aa91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:37:23.805145 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f31f1-3f27-4efd-af95-6318451484dd None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:23.805436 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f31f1-3f27-4efd-af95-6318451484dd None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:23.805721 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f31f1-3f27-4efd-af95-6318451484dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:23.824424 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-f54f31f1-3f27-4efd-af95-6318451484dd None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:37:23.825664 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-f54f31f1-3f27-4efd-af95-6318451484dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:37:23.868776 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:37:23.877743 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d59737-d2e1-46c7-aa7a-c175d6a3aa91 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:23.888449 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1242/2457] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:37:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 03:37:23.898165 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f31f1-3f27-4efd-af95-6318451484dd None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:23.899642 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-f54f31f1-3f27-4efd-af95-6318451484dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:37:23.920313 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:37:23.938993 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf90fd-1c42-4bee-86b3-c587355754a6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '692ec343bf9f4339ba691440f55a6c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:23.939905 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf90fd-1c42-4bee-86b3-c587355754a6 service swift] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:23.940189 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf90fd-1c42-4bee-86b3-c587355754a6 service swift] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:23.940465 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf90fd-1c42-4bee-86b3-c587355754a6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:23.942319 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-6cdf90fd-1c42-4bee-86b3-c587355754a6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:37:23.960143 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f31f1-3f27-4efd-af95-6318451484dd None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:23.964308 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e66b67-c524-4f3d-8943-297a319913e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:23.964957 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e66b67-c524-4f3d-8943-297a319913e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:23.965238 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e66b67-c524-4f3d-8943-297a319913e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:23.965512 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e66b67-c524-4f3d-8943-297a319913e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:23.974919 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e66b67-c524-4f3d-8943-297a319913e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:23.976457 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e66b67-c524-4f3d-8943-297a319913e7 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:23.986110 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1243/2458] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:37:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:37:24.003913 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdf90fd-1c42-4bee-86b3-c587355754a6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:24.005543 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdf90fd-1c42-4bee-86b3-c587355754a6 service swift] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:24.014393 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1216/2459] 10.222.0.60 () {60 vars in 1384 bytes} [Sat Jul 2 03:37:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 03:37:24.355337 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e66b67-c524-4f3d-8943-297a319913e7 service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:24.356850 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-14e66b67-c524-4f3d-8943-297a319913e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:37:24.373524 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e66b67-c524-4f3d-8943-297a319913e7 service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:24.381226 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ad2888-992e-46ae-8719-a68a795487b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:24.382109 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad2888-992e-46ae-8719-a68a795487b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:24.382389 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad2888-992e-46ae-8719-a68a795487b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:24.382664 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad2888-992e-46ae-8719-a68a795487b2 admin admin] PATH_INFO: `/v3/projects/3bcbeb2d6691427b8355fec23cf738ac` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:24.384314 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ad2888-992e-46ae-8719-a68a795487b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bcbeb2d6691427b8355fec23cf738ac)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:24.393438 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ad2888-992e-46ae-8719-a68a795487b2 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:24.446444 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-a3ad2888-992e-46ae-8719-a68a795487b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bcbeb2d6691427b8355fec23cf738ac', 'request_id': 'req-a3ad2888-992e-46ae-8719-a68a795487b2'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:24.452841 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-a3ad2888-992e-46ae-8719-a68a795487b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bcbeb2d6691427b8355fec23cf738ac', 'request_id': 'req-a3ad2888-992e-46ae-8719-a68a795487b2'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:24.459424 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-a3ad2888-992e-46ae-8719-a68a795487b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bcbeb2d6691427b8355fec23cf738ac', 'request_id': 'req-a3ad2888-992e-46ae-8719-a68a795487b2'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:24.474617 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-a3ad2888-992e-46ae-8719-a68a795487b2 admin admin] The token cache is being invalidate because project 3bcbeb2d6691427b8355fec23cf738ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:37:24.474988 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-a3ad2888-992e-46ae-8719-a68a795487b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:24.475712 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-a3ad2888-992e-46ae-8719-a68a795487b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:24.477297 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1244/2460] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:37:24 2022] DELETE /identity/v3/projects/3bcbeb2d6691427b8355fec23cf738ac => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:37:24.481374 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf90fd-1c42-4bee-86b3-c587355754a6 service swift] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:24.492846 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf90fd-1c42-4bee-86b3-c587355754a6 service swift] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:24.558122 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4930c0f0-f507-455f-b307-ba7a1929c21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:24.559149 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930c0f0-f507-455f-b307-ba7a1929c21e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:24.559428 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930c0f0-f507-455f-b307-ba7a1929c21e admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:24.559693 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930c0f0-f507-455f-b307-ba7a1929c21e admin admin] PATH_INFO: `/v3/users/68cf4ca9b488449e98d5c0b36dca548f` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:24.561036 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4930c0f0-f507-455f-b307-ba7a1929c21e admin admin] RBAC: Authorizing `identity:delete_user(user_id=68cf4ca9b488449e98d5c0b36dca548f)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:24.563229 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4930c0f0-f507-455f-b307-ba7a1929c21e admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:24.614476 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4930c0f0-f507-455f-b307-ba7a1929c21e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68cf4ca9b488449e98d5c0b36dca548f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:24.615140 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4930c0f0-f507-455f-b307-ba7a1929c21e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68cf4ca9b488449e98d5c0b36dca548f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:24.615831 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4930c0f0-f507-455f-b307-ba7a1929c21e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68cf4ca9b488449e98d5c0b36dca548f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:24.629532 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4930c0f0-f507-455f-b307-ba7a1929c21e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68cf4ca9b488449e98d5c0b36dca548f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:24.638241 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4930c0f0-f507-455f-b307-ba7a1929c21e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68cf4ca9b488449e98d5c0b36dca548f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:24.683031 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1217/2461] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:37:24 2022] DELETE /identity/v3/users/68cf4ca9b488449e98d5c0b36dca548f => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:37:24.966244 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ad2888-992e-46ae-8719-a68a795487b2 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:24.967346 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-a3ad2888-992e-46ae-8719-a68a795487b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:37:25.008351 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ad2888-992e-46ae-8719-a68a795487b2 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:25.079060 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8888601-3401-49b6-b836-11a718da56a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:25.080405 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8888601-3401-49b6-b836-11a718da56a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:25.080405 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8888601-3401-49b6-b836-11a718da56a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:25.080694 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8888601-3401-49b6-b836-11a718da56a4 admin admin] PATH_INFO: `/v3/projects/896e521a4f184fe09b468cb4882e1f28` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:25.082940 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8888601-3401-49b6-b836-11a718da56a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=896e521a4f184fe09b468cb4882e1f28)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:25.085391 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8888601-3401-49b6-b836-11a718da56a4 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:25.107525 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:37:25.145005 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-b8888601-3401-49b6-b836-11a718da56a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '896e521a4f184fe09b468cb4882e1f28', 'request_id': 'req-b8888601-3401-49b6-b836-11a718da56a4'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:25.151018 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-b8888601-3401-49b6-b836-11a718da56a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '896e521a4f184fe09b468cb4882e1f28', 'request_id': 'req-b8888601-3401-49b6-b836-11a718da56a4'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:25.157940 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-b8888601-3401-49b6-b836-11a718da56a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '896e521a4f184fe09b468cb4882e1f28', 'request_id': 'req-b8888601-3401-49b6-b836-11a718da56a4'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:25.174363 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-b8888601-3401-49b6-b836-11a718da56a4 admin admin] The token cache is being invalidate because project 896e521a4f184fe09b468cb4882e1f28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:37:25.174641 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-b8888601-3401-49b6-b836-11a718da56a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:25.177233 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-b8888601-3401-49b6-b836-11a718da56a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:25.182030 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1245/2462] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:37:24 2022] DELETE /identity/v3/projects/896e521a4f184fe09b468cb4882e1f28 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:37:25.183185 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4930c0f0-f507-455f-b307-ba7a1929c21e admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:25.184935 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4930c0f0-f507-455f-b307-ba7a1929c21e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:37:25.194269 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:37:25.199742 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4930c0f0-f507-455f-b307-ba7a1929c21e admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:25.268806 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e2bb80-62f9-44c6-8678-fa61e4eb58e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:25.269817 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e2bb80-62f9-44c6-8678-fa61e4eb58e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:25.270100 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e2bb80-62f9-44c6-8678-fa61e4eb58e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:25.270377 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e2bb80-62f9-44c6-8678-fa61e4eb58e2 admin admin] PATH_INFO: `/v3/users/1c21fe213570431ebb1141cdc5f013cf` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:25.271777 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e2bb80-62f9-44c6-8678-fa61e4eb58e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c21fe213570431ebb1141cdc5f013cf)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:25.273757 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e2bb80-62f9-44c6-8678-fa61e4eb58e2 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:25.347462 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-37e2bb80-62f9-44c6-8678-fa61e4eb58e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c21fe213570431ebb1141cdc5f013cf'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:25.350694 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-37e2bb80-62f9-44c6-8678-fa61e4eb58e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c21fe213570431ebb1141cdc5f013cf'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:25.353338 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-37e2bb80-62f9-44c6-8678-fa61e4eb58e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c21fe213570431ebb1141cdc5f013cf'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:25.392499 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-37e2bb80-62f9-44c6-8678-fa61e4eb58e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c21fe213570431ebb1141cdc5f013cf'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:25.400289 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-37e2bb80-62f9-44c6-8678-fa61e4eb58e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c21fe213570431ebb1141cdc5f013cf'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:25.422122 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1218/2463] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:37:25 2022] DELETE /identity/v3/users/1c21fe213570431ebb1141cdc5f013cf => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 03:37:25.763338 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8888601-3401-49b6-b836-11a718da56a4 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:25.764758 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-b8888601-3401-49b6-b836-11a718da56a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:37:25.789909 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8888601-3401-49b6-b836-11a718da56a4 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:25.865470 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5272c8-300c-4dcb-9167-f7958113a264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:25.868093 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5272c8-300c-4dcb-9167-f7958113a264 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:25.868093 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5272c8-300c-4dcb-9167-f7958113a264 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:25.868093 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5272c8-300c-4dcb-9167-f7958113a264 admin admin] PATH_INFO: `/v3/projects/b591acc4c6724960b5fbf081a44b8bb1` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:25.869205 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5272c8-300c-4dcb-9167-f7958113a264 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b591acc4c6724960b5fbf081a44b8bb1)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:25.871259 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5272c8-300c-4dcb-9167-f7958113a264 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:25.928000 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-0e5272c8-300c-4dcb-9167-f7958113a264 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b591acc4c6724960b5fbf081a44b8bb1', 'request_id': 'req-0e5272c8-300c-4dcb-9167-f7958113a264'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:25.935251 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-0e5272c8-300c-4dcb-9167-f7958113a264 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b591acc4c6724960b5fbf081a44b8bb1', 'request_id': 'req-0e5272c8-300c-4dcb-9167-f7958113a264'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:25.941923 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-0e5272c8-300c-4dcb-9167-f7958113a264 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b591acc4c6724960b5fbf081a44b8bb1', 'request_id': 'req-0e5272c8-300c-4dcb-9167-f7958113a264'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:25.960561 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-0e5272c8-300c-4dcb-9167-f7958113a264 admin admin] The token cache is being invalidate because project b591acc4c6724960b5fbf081a44b8bb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:37:25.960876 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-0e5272c8-300c-4dcb-9167-f7958113a264 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:25.961478 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-0e5272c8-300c-4dcb-9167-f7958113a264 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:25.963171 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1246/2464] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:37:25 2022] DELETE /identity/v3/projects/b591acc4c6724960b5fbf081a44b8bb1 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:37:25.970650 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598dbd53-013c-4b73-b4c0-f9e7b7f46b17 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:25.971540 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598dbd53-013c-4b73-b4c0-f9e7b7f46b17 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:25.971540 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598dbd53-013c-4b73-b4c0-f9e7b7f46b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:25.990840 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-598dbd53-013c-4b73-b4c0-f9e7b7f46b17 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:37:25.992211 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-598dbd53-013c-4b73-b4c0-f9e7b7f46b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:37:26.067998 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1219/2465] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:37:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 03:37:26.075846 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e4df28-15bb-4411-b3a5-eef8c2174f26 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:26.076357 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e4df28-15bb-4411-b3a5-eef8c2174f26 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:26.076454 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e4df28-15bb-4411-b3a5-eef8c2174f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:26.098690 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-08e4df28-15bb-4411-b3a5-eef8c2174f26 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:37:26.099950 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-08e4df28-15bb-4411-b3a5-eef8c2174f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:37:26.113292 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1247/2466] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:37:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 03:37:26.117446 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598dbd53-013c-4b73-b4c0-f9e7b7f46b17 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:26.129481 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598dbd53-013c-4b73-b4c0-f9e7b7f46b17 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:26.134864 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e3966f-0fe9-4e82-8274-87da541c69d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:26.135550 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e3966f-0fe9-4e82-8274-87da541c69d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:26.135852 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e3966f-0fe9-4e82-8274-87da541c69d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:26.136120 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e3966f-0fe9-4e82-8274-87da541c69d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:26.136873 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e3966f-0fe9-4e82-8274-87da541c69d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:37:26.137176 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e3966f-0fe9-4e82-8274-87da541c69d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:26.138933 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e3966f-0fe9-4e82-8274-87da541c69d4 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:26.156393 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e4df28-15bb-4411-b3a5-eef8c2174f26 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:26.163259 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1220/2467] 10.222.0.60 () {58 vars in 1152 bytes} [Sat Jul 2 03:37:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:37:26.166780 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e4df28-15bb-4411-b3a5-eef8c2174f26 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:26.171821 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b863ece-72a7-4fe9-a150-ae402d1b98dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:26.172526 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b863ece-72a7-4fe9-a150-ae402d1b98dd admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:26.172784 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b863ece-72a7-4fe9-a150-ae402d1b98dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:26.173065 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b863ece-72a7-4fe9-a150-ae402d1b98dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:26.173766 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b863ece-72a7-4fe9-a150-ae402d1b98dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:26.175725 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b863ece-72a7-4fe9-a150-ae402d1b98dd admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:26.207046 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1248/2468] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:37:26 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 03:37:26.214009 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e3966f-0fe9-4e82-8274-87da541c69d4 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:26.229245 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e3966f-0fe9-4e82-8274-87da541c69d4 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:26.238106 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:37:26.293295 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b7bc41-aec1-4e9c-ad1d-eba785a0d416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:26.293982 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b7bc41-aec1-4e9c-ad1d-eba785a0d416 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:26.294270 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b7bc41-aec1-4e9c-ad1d-eba785a0d416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:26.294547 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b7bc41-aec1-4e9c-ad1d-eba785a0d416 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:26.295291 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b7bc41-aec1-4e9c-ad1d-eba785a0d416 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:26.297253 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b7bc41-aec1-4e9c-ad1d-eba785a0d416 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:26.323576 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1221/2469] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:37:26 2022] POST /identity/v3/users => generated 292 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:37:26.324749 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b863ece-72a7-4fe9-a150-ae402d1b98dd admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:26.331962 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:37:26.336145 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b863ece-72a7-4fe9-a150-ae402d1b98dd admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:26.342356 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca48faaf-56b4-475b-88eb-5cddbfa57e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:26.343184 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca48faaf-56b4-475b-88eb-5cddbfa57e03 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:26.343744 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca48faaf-56b4-475b-88eb-5cddbfa57e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:26.344085 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca48faaf-56b4-475b-88eb-5cddbfa57e03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:26.344886 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca48faaf-56b4-475b-88eb-5cddbfa57e03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:26.347026 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca48faaf-56b4-475b-88eb-5cddbfa57e03 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:26.361649 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1249/2470] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:37:26.362858 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b7bc41-aec1-4e9c-ad1d-eba785a0d416 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:26.374627 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b7bc41-aec1-4e9c-ad1d-eba785a0d416 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:26.385314 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c3a2fa-3c6b-430b-baea-8eb1b84ccdea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:26.386007 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3a2fa-3c6b-430b-baea-8eb1b84ccdea admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:26.386386 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3a2fa-3c6b-430b-baea-8eb1b84ccdea admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:26.386593 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3a2fa-3c6b-430b-baea-8eb1b84ccdea admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:26.387493 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c3a2fa-3c6b-430b-baea-8eb1b84ccdea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:26.389164 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c3a2fa-3c6b-430b-baea-8eb1b84ccdea admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:26.402025 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1222/2471] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:37:26.406278 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca48faaf-56b4-475b-88eb-5cddbfa57e03 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:26.418475 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca48faaf-56b4-475b-88eb-5cddbfa57e03 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:26.424577 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c49621f-cf5b-4288-b693-5c0b9ddff2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:26.425632 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49621f-cf5b-4288-b693-5c0b9ddff2c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:26.425919 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49621f-cf5b-4288-b693-5c0b9ddff2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:26.426209 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49621f-cf5b-4288-b693-5c0b9ddff2c0 admin admin] PATH_INFO: `/v3/projects/643082738b1c45448c775ee6b5bf9f95/users/bb9315f2f5ca4578824314f187dff28e/roles/c43aada0326446c4ade0ab1262918fa4` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:26.442704 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c49621f-cf5b-4288-b693-5c0b9ddff2c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=643082738b1c45448c775ee6b5bf9f95, user_id=bb9315f2f5ca4578824314f187dff28e, role_id=c43aada0326446c4ade0ab1262918fa4)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:26.445488 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c49621f-cf5b-4288-b693-5c0b9ddff2c0 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:26.466885 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1250/2472] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:37:26 2022] PUT /identity/v3/projects/643082738b1c45448c775ee6b5bf9f95/users/bb9315f2f5ca4578824314f187dff28e/roles/c43aada0326446c4ade0ab1262918fa4 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:37:26.478272 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f151e-a03e-4b72-8247-750168da6dce None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:26.478670 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f151e-a03e-4b72-8247-750168da6dce None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:26.478949 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f151e-a03e-4b72-8247-750168da6dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:26.511647 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-ab5f151e-a03e-4b72-8247-750168da6dce None None] MFA Rules not processed for user `bb9315f2f5ca4578824314f187dff28e`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:37:26.513128 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ab5f151e-a03e-4b72-8247-750168da6dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:37:26.590617 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1223/2473] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:37:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:37:26.603251 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c49621f-cf5b-4288-b693-5c0b9ddff2c0 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:26.605022 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-6c49621f-cf5b-4288-b693-5c0b9ddff2c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:37:26.674022 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c49621f-cf5b-4288-b693-5c0b9ddff2c0 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:26.678234 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5ebd8f-bd14-4ff9-8fc9-4e9a8ce866c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:26.678958 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ebd8f-bd14-4ff9-8fc9-4e9a8ce866c9 service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:26.679272 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ebd8f-bd14-4ff9-8fc9-4e9a8ce866c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:26.679546 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ebd8f-bd14-4ff9-8fc9-4e9a8ce866c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:26.690953 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5ebd8f-bd14-4ff9-8fc9-4e9a8ce866c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:26.692555 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5ebd8f-bd14-4ff9-8fc9-4e9a8ce866c9 service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:26.704015 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1251/2474] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:37:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:37:29.366104 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f151e-a03e-4b72-8247-750168da6dce None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:29.438840 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f151e-a03e-4b72-8247-750168da6dce None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:29.444016 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b9542-83b7-49ab-9259-d0121192b9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:29.444875 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b9542-83b7-49ab-9259-d0121192b9d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:29.445150 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b9542-83b7-49ab-9259-d0121192b9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:29.445417 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b9542-83b7-49ab-9259-d0121192b9d7 admin admin] PATH_INFO: `/v3/users/bb9315f2f5ca4578824314f187dff28e` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:29.446767 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661b9542-83b7-49ab-9259-d0121192b9d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb9315f2f5ca4578824314f187dff28e)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:29.448973 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661b9542-83b7-49ab-9259-d0121192b9d7 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:29.471957 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:37:29.503206 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-661b9542-83b7-49ab-9259-d0121192b9d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb9315f2f5ca4578824314f187dff28e'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:29.504242 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-661b9542-83b7-49ab-9259-d0121192b9d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb9315f2f5ca4578824314f187dff28e'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:29.504844 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-661b9542-83b7-49ab-9259-d0121192b9d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb9315f2f5ca4578824314f187dff28e'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:29.517624 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-661b9542-83b7-49ab-9259-d0121192b9d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb9315f2f5ca4578824314f187dff28e'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:29.525490 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-661b9542-83b7-49ab-9259-d0121192b9d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb9315f2f5ca4578824314f187dff28e'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:29.541753 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1224/2475] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:37:29 2022] DELETE /identity/v3/users/bb9315f2f5ca4578824314f187dff28e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:37:29.545989 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccba59e-b05c-4097-b95a-683e282195f9 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:29.546788 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccba59e-b05c-4097-b95a-683e282195f9 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:29.546788 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccba59e-b05c-4097-b95a-683e282195f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:29.565712 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-1ccba59e-b05c-4097-b95a-683e282195f9 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:37:29.567006 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-1ccba59e-b05c-4097-b95a-683e282195f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:37:29.630933 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1252/2476] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:37:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:37:29.640832 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b9542-83b7-49ab-9259-d0121192b9d7 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:29.642299 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-661b9542-83b7-49ab-9259-d0121192b9d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:37:29.702665 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b9542-83b7-49ab-9259-d0121192b9d7 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:29.707511 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8515027e-058e-4ae2-ba38-5632a3c626a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:29.708163 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515027e-058e-4ae2-ba38-5632a3c626a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:29.708448 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515027e-058e-4ae2-ba38-5632a3c626a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:29.708721 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515027e-058e-4ae2-ba38-5632a3c626a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:29.720530 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8515027e-058e-4ae2-ba38-5632a3c626a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:29.721967 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8515027e-058e-4ae2-ba38-5632a3c626a9 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:29.732851 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1225/2477] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:37:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:37:30.025955 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccba59e-b05c-4097-b95a-683e282195f9 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:30.027419 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-1ccba59e-b05c-4097-b95a-683e282195f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:37:30.044015 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccba59e-b05c-4097-b95a-683e282195f9 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:30.051017 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a567464-0394-43bc-bdba-ebf4d86941af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:30.051977 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a567464-0394-43bc-bdba-ebf4d86941af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:30.052224 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a567464-0394-43bc-bdba-ebf4d86941af admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:30.052501 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a567464-0394-43bc-bdba-ebf4d86941af admin admin] PATH_INFO: `/v3/projects/643082738b1c45448c775ee6b5bf9f95` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:30.053824 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a567464-0394-43bc-bdba-ebf4d86941af admin admin] RBAC: Authorizing `identity:delete_project(project_id=643082738b1c45448c775ee6b5bf9f95)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:30.057194 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a567464-0394-43bc-bdba-ebf4d86941af admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:30.108812 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-2a567464-0394-43bc-bdba-ebf4d86941af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '643082738b1c45448c775ee6b5bf9f95', 'request_id': 'req-2a567464-0394-43bc-bdba-ebf4d86941af'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:30.115000 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-2a567464-0394-43bc-bdba-ebf4d86941af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '643082738b1c45448c775ee6b5bf9f95', 'request_id': 'req-2a567464-0394-43bc-bdba-ebf4d86941af'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:30.121576 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-2a567464-0394-43bc-bdba-ebf4d86941af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '643082738b1c45448c775ee6b5bf9f95', 'request_id': 'req-2a567464-0394-43bc-bdba-ebf4d86941af'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:30.125275 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:37:30.139038 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-2a567464-0394-43bc-bdba-ebf4d86941af admin admin] The token cache is being invalidate because project 643082738b1c45448c775ee6b5bf9f95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:37:30.139433 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-2a567464-0394-43bc-bdba-ebf4d86941af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:30.140066 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-2a567464-0394-43bc-bdba-ebf4d86941af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:37:30.141762 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1253/2478] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:37:30 2022] DELETE /identity/v3/projects/643082738b1c45448c775ee6b5bf9f95 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:37:39.727719 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:DELETE=7,keystone:SELECT=46,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:37:40.138515 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=2 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:37:41.788207 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ffd9b-96a6-4388-8168-26f09acdf823 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:41.788701 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ffd9b-96a6-4388-8168-26f09acdf823 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:41.788805 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ffd9b-96a6-4388-8168-26f09acdf823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:41.806308 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-697ffd9b-96a6-4388-8168-26f09acdf823 None None] MFA Rules not processed for user `3333e7495b9546d882e2a2211ff8875c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:37:41.807540 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-697ffd9b-96a6-4388-8168-26f09acdf823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:37:41.862723 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1226/2479] 10.222.0.60 () {58 vars in 1009 bytes} [Sat Jul 2 03:37:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:37:41.880593 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a567464-0394-43bc-bdba-ebf4d86941af admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:37:41.882226 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-2a567464-0394-43bc-bdba-ebf4d86941af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:37:41.958977 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a567464-0394-43bc-bdba-ebf4d86941af admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:37:41.965252 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e58c9-5143-48bc-8de5-53b4ae8d8cda service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '692ec343bf9f4339ba691440f55a6c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:37:41.965890 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e58c9-5143-48bc-8de5-53b4ae8d8cda service swift] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:37:41.966171 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e58c9-5143-48bc-8de5-53b4ae8d8cda service swift] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:37:41.966445 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e58c9-5143-48bc-8de5-53b4ae8d8cda service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:37:41.975440 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424e58c9-5143-48bc-8de5-53b4ae8d8cda service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:37:41.977013 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424e58c9-5143-48bc-8de5-53b4ae8d8cda service swift] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:37:41.985671 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1254/2480] 10.222.0.60 () {60 vars in 1384 bytes} [Sat Jul 2 03:37:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 03:37:51.855261 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=25 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:37:51.982000 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=32 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:38:04.774193 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b4f8f-ff5a-4d19-8262-0ee09c74cf64 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:04.774740 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b4f8f-ff5a-4d19-8262-0ee09c74cf64 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:04.774740 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b4f8f-ff5a-4d19-8262-0ee09c74cf64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:04.795901 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-0d9b4f8f-ff5a-4d19-8262-0ee09c74cf64 None None] MFA Rules not processed for user `3333e7495b9546d882e2a2211ff8875c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:38:04.797578 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0d9b4f8f-ff5a-4d19-8262-0ee09c74cf64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:38:04.805717 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1227/2481] 10.222.0.60 () {58 vars in 967 bytes} [Sat Jul 2 03:38:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:38:04.819313 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e58c9-5143-48bc-8de5-53b4ae8d8cda service swift] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:04.830670 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e58c9-5143-48bc-8de5-53b4ae8d8cda service swift] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:04.836943 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19fd860-65ce-410b-bf16-9b83082c3d2c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '692ec343bf9f4339ba691440f55a6c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:04.837672 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19fd860-65ce-410b-bf16-9b83082c3d2c service swift] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:04.838024 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19fd860-65ce-410b-bf16-9b83082c3d2c service swift] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:04.838376 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19fd860-65ce-410b-bf16-9b83082c3d2c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:04.847439 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19fd860-65ce-410b-bf16-9b83082c3d2c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:04.849027 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19fd860-65ce-410b-bf16-9b83082c3d2c service swift] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:04.857252 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1255/2482] 10.222.0.60 () {60 vars in 1384 bytes} [Sat Jul 2 03:38:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 03:38:10.445020 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b4f8f-ff5a-4d19-8262-0ee09c74cf64 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:10.446835 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0d9b4f8f-ff5a-4d19-8262-0ee09c74cf64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:38:10.535684 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b4f8f-ff5a-4d19-8262-0ee09c74cf64 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:10.542104 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78cdf00-a95f-4336-a195-47f34b2e5af7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dafc9be75a64db095fe08b9cbb04cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:10.542760 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78cdf00-a95f-4336-a195-47f34b2e5af7 service placement] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:10.543023 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78cdf00-a95f-4336-a195-47f34b2e5af7 service placement] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:10.543363 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78cdf00-a95f-4336-a195-47f34b2e5af7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:10.545235 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f78cdf00-a95f-4336-a195-47f34b2e5af7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:38:10.557318 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78cdf00-a95f-4336-a195-47f34b2e5af7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:10.558927 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78cdf00-a95f-4336-a195-47f34b2e5af7 service placement] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:10.569313 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1228/2483] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:38:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:38:13.135893 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe13be-c6f3-4c10-bae7-8651ff922be8 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:13.136529 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe13be-c6f3-4c10-bae7-8651ff922be8 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:13.136529 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe13be-c6f3-4c10-bae7-8651ff922be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:13.161227 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-31fe13be-c6f3-4c10-bae7-8651ff922be8 None None] MFA Rules not processed for user `c42a4b22cda34bb68980388f63e822cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:38:13.162673 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-31fe13be-c6f3-4c10-bae7-8651ff922be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:38:13.228772 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1256/2484] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:38:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:38:20.565610 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=35 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:38:23.221559 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=31 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:38:25.010727 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78cdf00-a95f-4336-a195-47f34b2e5af7 service placement] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:25.012765 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f78cdf00-a95f-4336-a195-47f34b2e5af7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:38:25.077364 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78cdf00-a95f-4336-a195-47f34b2e5af7 service placement] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:25.081677 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f5d95f-1d18-492f-a73b-c5996cdb887c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:25.082358 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f5d95f-1d18-492f-a73b-c5996cdb887c service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:25.082639 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f5d95f-1d18-492f-a73b-c5996cdb887c service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:25.082911 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f5d95f-1d18-492f-a73b-c5996cdb887c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:25.084935 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f8f5d95f-1d18-492f-a73b-c5996cdb887c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:38:25.148028 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f5d95f-1d18-492f-a73b-c5996cdb887c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:25.149614 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f5d95f-1d18-492f-a73b-c5996cdb887c service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:25.160464 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1229/2485] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:38:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:38:26.973561 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea477b-6679-4eb4-a7a7-69ea52923e5e None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:26.974062 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea477b-6679-4eb4-a7a7-69ea52923e5e None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:26.974278 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea477b-6679-4eb4-a7a7-69ea52923e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:26.996064 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-28ea477b-6679-4eb4-a7a7-69ea52923e5e None None] MFA Rules not processed for user `3333e7495b9546d882e2a2211ff8875c`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:38:26.998166 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-28ea477b-6679-4eb4-a7a7-69ea52923e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:38:27.009519 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1257/2486] 10.222.0.60 () {58 vars in 967 bytes} [Sat Jul 2 03:38:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:38:27.037526 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f5d95f-1d18-492f-a73b-c5996cdb887c service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:27.050517 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f5d95f-1d18-492f-a73b-c5996cdb887c service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:27.055959 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ea5721-160f-47e2-ba8c-899d02112328 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '692ec343bf9f4339ba691440f55a6c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:27.056788 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea5721-160f-47e2-ba8c-899d02112328 service swift] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:27.057229 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea5721-160f-47e2-ba8c-899d02112328 service swift] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:27.057686 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea5721-160f-47e2-ba8c-899d02112328 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:27.067708 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ea5721-160f-47e2-ba8c-899d02112328 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:27.070313 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ea5721-160f-47e2-ba8c-899d02112328 service swift] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:27.081242 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1230/2487] 10.222.0.60 () {60 vars in 1384 bytes} [Sat Jul 2 03:38:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 03:38:28.799001 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea477b-6679-4eb4-a7a7-69ea52923e5e None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:28.800649 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-28ea477b-6679-4eb4-a7a7-69ea52923e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:38:28.815803 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea477b-6679-4eb4-a7a7-69ea52923e5e None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:28.821240 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b896fe-9434-4aea-a5de-c4751063e93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:28.822199 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b896fe-9434-4aea-a5de-c4751063e93e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:28.822546 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b896fe-9434-4aea-a5de-c4751063e93e admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:28.822874 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b896fe-9434-4aea-a5de-c4751063e93e admin admin] PATH_INFO: `/v3/users/5caffa5bd8804abd96e411fb45383c5b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:28.824317 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b896fe-9434-4aea-a5de-c4751063e93e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5caffa5bd8804abd96e411fb45383c5b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:28.826373 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b896fe-9434-4aea-a5de-c4751063e93e admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:28.876339 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-a5b896fe-9434-4aea-a5de-c4751063e93e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5caffa5bd8804abd96e411fb45383c5b'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:28.877131 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-a5b896fe-9434-4aea-a5de-c4751063e93e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5caffa5bd8804abd96e411fb45383c5b'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:28.886508 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-a5b896fe-9434-4aea-a5de-c4751063e93e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5caffa5bd8804abd96e411fb45383c5b'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:28.887267 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-a5b896fe-9434-4aea-a5de-c4751063e93e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5caffa5bd8804abd96e411fb45383c5b'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:28.899870 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-a5b896fe-9434-4aea-a5de-c4751063e93e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5caffa5bd8804abd96e411fb45383c5b'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:28.912667 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1258/2488] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:38:28 2022] DELETE /identity/v3/users/5caffa5bd8804abd96e411fb45383c5b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:38:29.103219 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ea5721-160f-47e2-ba8c-899d02112328 service swift] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:29.116579 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ea5721-160f-47e2-ba8c-899d02112328 service swift] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:29.197620 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164208fd-0f30-47bd-b696-57a9c381ee50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:29.198567 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164208fd-0f30-47bd-b696-57a9c381ee50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:29.198902 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164208fd-0f30-47bd-b696-57a9c381ee50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:29.199262 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164208fd-0f30-47bd-b696-57a9c381ee50 admin admin] PATH_INFO: `/v3/projects/21d62ee1bec34176af71d872c20e5b8a` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:29.205871 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164208fd-0f30-47bd-b696-57a9c381ee50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21d62ee1bec34176af71d872c20e5b8a)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:29.208151 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164208fd-0f30-47bd-b696-57a9c381ee50 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:29.261474 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:38:29.273821 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-164208fd-0f30-47bd-b696-57a9c381ee50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21d62ee1bec34176af71d872c20e5b8a', 'request_id': 'req-164208fd-0f30-47bd-b696-57a9c381ee50'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:29.281946 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-164208fd-0f30-47bd-b696-57a9c381ee50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21d62ee1bec34176af71d872c20e5b8a', 'request_id': 'req-164208fd-0f30-47bd-b696-57a9c381ee50'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:29.290847 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-164208fd-0f30-47bd-b696-57a9c381ee50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21d62ee1bec34176af71d872c20e5b8a', 'request_id': 'req-164208fd-0f30-47bd-b696-57a9c381ee50'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:29.305020 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-164208fd-0f30-47bd-b696-57a9c381ee50 admin admin] The token cache is being invalidate because project 21d62ee1bec34176af71d872c20e5b8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:38:29.305392 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-164208fd-0f30-47bd-b696-57a9c381ee50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:29.305972 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-164208fd-0f30-47bd-b696-57a9c381ee50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:29.311072 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1231/2489] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:38:29 2022] DELETE /identity/v3/projects/21d62ee1bec34176af71d872c20e5b8a => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:38:29.312825 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a574225-6d75-40aa-b2ad-2abd1c518925 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:29.313241 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a574225-6d75-40aa-b2ad-2abd1c518925 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:29.313587 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a574225-6d75-40aa-b2ad-2abd1c518925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:29.339168 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-6a574225-6d75-40aa-b2ad-2abd1c518925 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:38:29.341353 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-6a574225-6d75-40aa-b2ad-2abd1c518925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:38:29.448746 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1259/2490] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:38:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 03:38:29.450895 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6db07-9f84-4a63-80b7-e7ada9727b03 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:29.451240 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6db07-9f84-4a63-80b7-e7ada9727b03 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:29.451524 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6db07-9f84-4a63-80b7-e7ada9727b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:29.471258 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-7be6db07-9f84-4a63-80b7-e7ada9727b03 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:38:29.472530 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7be6db07-9f84-4a63-80b7-e7ada9727b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:38:29.480552 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1232/2491] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:38:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:38:29.484902 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a574225-6d75-40aa-b2ad-2abd1c518925 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:29.495094 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a574225-6d75-40aa-b2ad-2abd1c518925 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:29.500062 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e9f9b-e405-4c8c-93ff-24d0181397e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:29.500848 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e9f9b-e405-4c8c-93ff-24d0181397e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:29.501230 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e9f9b-e405-4c8c-93ff-24d0181397e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:29.501604 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e9f9b-e405-4c8c-93ff-24d0181397e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:29.502450 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0e9f9b-e405-4c8c-93ff-24d0181397e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:38:29.502991 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0e9f9b-e405-4c8c-93ff-24d0181397e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:29.504867 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0e9f9b-e405-4c8c-93ff-24d0181397e4 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:29.520523 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1260/2492] 10.222.0.60 () {58 vars in 1152 bytes} [Sat Jul 2 03:38:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:38:29.522014 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be6db07-9f84-4a63-80b7-e7ada9727b03 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:29.531989 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be6db07-9f84-4a63-80b7-e7ada9727b03 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:29.537021 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8423471e-e1cd-4e65-b584-35079b32fd94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:29.537683 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8423471e-e1cd-4e65-b584-35079b32fd94 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:29.537958 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8423471e-e1cd-4e65-b584-35079b32fd94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:29.538301 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8423471e-e1cd-4e65-b584-35079b32fd94 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:29.539011 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8423471e-e1cd-4e65-b584-35079b32fd94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:29.540966 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8423471e-e1cd-4e65-b584-35079b32fd94 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:29.570813 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1233/2493] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:38:29 2022] POST /identity/v3/projects => generated 369 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:38:29.575551 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e9f9b-e405-4c8c-93ff-24d0181397e4 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:29.586465 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e9f9b-e405-4c8c-93ff-24d0181397e4 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:29.638975 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:38:29.650349 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f73da21-d7f7-4f2a-9a0c-9be3ab752451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:29.651345 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73da21-d7f7-4f2a-9a0c-9be3ab752451 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:29.651708 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73da21-d7f7-4f2a-9a0c-9be3ab752451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:29.652064 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73da21-d7f7-4f2a-9a0c-9be3ab752451 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:29.653737 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f73da21-d7f7-4f2a-9a0c-9be3ab752451 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:29.655893 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f73da21-d7f7-4f2a-9a0c-9be3ab752451 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:29.685401 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1261/2494] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:38:29 2022] POST /identity/v3/users => generated 285 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:38:29.686852 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8423471e-e1cd-4e65-b584-35079b32fd94 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:29.698488 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8423471e-e1cd-4e65-b584-35079b32fd94 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:29.705701 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d191cf72-fe46-477d-a444-7681058f3d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:29.706430 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d191cf72-fe46-477d-a444-7681058f3d94 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:29.706724 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d191cf72-fe46-477d-a444-7681058f3d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:29.707091 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d191cf72-fe46-477d-a444-7681058f3d94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:29.707886 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d191cf72-fe46-477d-a444-7681058f3d94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:29.709534 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d191cf72-fe46-477d-a444-7681058f3d94 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:29.722965 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1234/2495] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:38:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:38:29.727158 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f73da21-d7f7-4f2a-9a0c-9be3ab752451 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:29.739256 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f73da21-d7f7-4f2a-9a0c-9be3ab752451 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:29.744040 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b5cab7-2c1a-421b-8755-c6c67615e00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:29.744717 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5cab7-2c1a-421b-8755-c6c67615e00e admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:29.744994 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5cab7-2c1a-421b-8755-c6c67615e00e admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:29.745266 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5cab7-2c1a-421b-8755-c6c67615e00e admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:29.746007 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b5cab7-2c1a-421b-8755-c6c67615e00e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:29.748304 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b5cab7-2c1a-421b-8755-c6c67615e00e admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:29.762259 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1262/2496] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:38:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:38:29.766140 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d191cf72-fe46-477d-a444-7681058f3d94 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:29.777506 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d191cf72-fe46-477d-a444-7681058f3d94 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:29.782335 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a837a-2837-4f07-8204-a74b4deb9bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:29.783299 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a837a-2837-4f07-8204-a74b4deb9bdb admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:29.783953 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a837a-2837-4f07-8204-a74b4deb9bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:29.784232 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a837a-2837-4f07-8204-a74b4deb9bdb admin admin] PATH_INFO: `/v3/projects/fa0517eb4a924c5f8e739a76df56d2c4/users/2a82c7c1f65b4385911fa2aa2d32d5ff/roles/c43aada0326446c4ade0ab1262918fa4` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:29.799826 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572a837a-2837-4f07-8204-a74b4deb9bdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa0517eb4a924c5f8e739a76df56d2c4, user_id=2a82c7c1f65b4385911fa2aa2d32d5ff, role_id=c43aada0326446c4ade0ab1262918fa4)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:29.802538 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572a837a-2837-4f07-8204-a74b4deb9bdb admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:29.817573 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1235/2497] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:38:29 2022] PUT /identity/v3/projects/fa0517eb4a924c5f8e739a76df56d2c4/users/2a82c7c1f65b4385911fa2aa2d32d5ff/roles/c43aada0326446c4ade0ab1262918fa4 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:38:29.828152 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5394cad-0f08-41db-b29d-c5dba0ab1a22 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:29.828695 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5394cad-0f08-41db-b29d-c5dba0ab1a22 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:29.828695 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5394cad-0f08-41db-b29d-c5dba0ab1a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:29.858493 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-b5394cad-0f08-41db-b29d-c5dba0ab1a22 None None] MFA Rules not processed for user `2a82c7c1f65b4385911fa2aa2d32d5ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:38:29.859765 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-b5394cad-0f08-41db-b29d-c5dba0ab1a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:38:29.934826 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1263/2498] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:38:29 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:38:29.939541 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a837a-2837-4f07-8204-a74b4deb9bdb admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:30.009056 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a837a-2837-4f07-8204-a74b4deb9bdb admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:30.014983 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d00bba-2956-4280-b2b1-acc6e04df0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:30.015758 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d00bba-2956-4280-b2b1-acc6e04df0ea admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:30.016119 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d00bba-2956-4280-b2b1-acc6e04df0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:30.016462 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d00bba-2956-4280-b2b1-acc6e04df0ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:30.017237 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d00bba-2956-4280-b2b1-acc6e04df0ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:30.019358 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d00bba-2956-4280-b2b1-acc6e04df0ea admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:30.056217 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1236/2499] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:38:29 2022] POST /identity/v3/projects => generated 369 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:38:30.057385 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5394cad-0f08-41db-b29d-c5dba0ab1a22 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:30.068954 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5394cad-0f08-41db-b29d-c5dba0ab1a22 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:30.139971 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52e49e-1659-4728-90ec-9fe0dd71f859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:30.140789 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52e49e-1659-4728-90ec-9fe0dd71f859 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:30.141069 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52e49e-1659-4728-90ec-9fe0dd71f859 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:30.141616 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52e49e-1659-4728-90ec-9fe0dd71f859 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:30.142505 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f52e49e-1659-4728-90ec-9fe0dd71f859 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:30.145382 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f52e49e-1659-4728-90ec-9fe0dd71f859 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:30.173865 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1264/2500] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:38:30 2022] POST /identity/v3/users => generated 291 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 03:38:30.176146 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d00bba-2956-4280-b2b1-acc6e04df0ea admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:30.190611 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d00bba-2956-4280-b2b1-acc6e04df0ea admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:30.198049 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71130c0-bf2e-403f-876b-229d612174df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:30.198753 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71130c0-bf2e-403f-876b-229d612174df admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:30.199153 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71130c0-bf2e-403f-876b-229d612174df admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:30.199546 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71130c0-bf2e-403f-876b-229d612174df admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:30.200480 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71130c0-bf2e-403f-876b-229d612174df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:30.202460 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71130c0-bf2e-403f-876b-229d612174df admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:30.215040 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1237/2501] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:38:30 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:38:30.219789 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52e49e-1659-4728-90ec-9fe0dd71f859 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:30.235381 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52e49e-1659-4728-90ec-9fe0dd71f859 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:30.241881 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c17e3fa-a4d4-4167-b287-e7d8fa41c2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:30.242337 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17e3fa-a4d4-4167-b287-e7d8fa41c2f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:30.242619 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17e3fa-a4d4-4167-b287-e7d8fa41c2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:30.242892 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17e3fa-a4d4-4167-b287-e7d8fa41c2f6 admin admin] PATH_INFO: `/v3/projects/0efe71b44e214d98a4c28b217877d9e7/users/6dd4d62471284309a8a6b3b7c8e44a87/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:30.260690 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c17e3fa-a4d4-4167-b287-e7d8fa41c2f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0efe71b44e214d98a4c28b217877d9e7, user_id=6dd4d62471284309a8a6b3b7c8e44a87, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:30.263674 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c17e3fa-a4d4-4167-b287-e7d8fa41c2f6 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:30.279798 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1265/2502] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:38:30 2022] PUT /identity/v3/projects/0efe71b44e214d98a4c28b217877d9e7/users/6dd4d62471284309a8a6b3b7c8e44a87/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:38:30.284593 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71130c0-bf2e-403f-876b-229d612174df admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:30.295336 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71130c0-bf2e-403f-876b-229d612174df admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:30.335679 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:38:30.365150 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c0209-9b94-4bb0-8b9d-0dc9d3f098f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:30.366144 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c0209-9b94-4bb0-8b9d-0dc9d3f098f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:30.366625 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c0209-9b94-4bb0-8b9d-0dc9d3f098f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:30.366903 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c0209-9b94-4bb0-8b9d-0dc9d3f098f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:30.367705 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88c0209-9b94-4bb0-8b9d-0dc9d3f098f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:30.369338 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88c0209-9b94-4bb0-8b9d-0dc9d3f098f6 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:30.382589 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1238/2503] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:38:30 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 03:38:30.388891 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c17e3fa-a4d4-4167-b287-e7d8fa41c2f6 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:30.408490 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c17e3fa-a4d4-4167-b287-e7d8fa41c2f6 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:30.413654 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a694f-a8de-4549-abc8-31703a048241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:30.414540 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a694f-a8de-4549-abc8-31703a048241 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:30.414819 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a694f-a8de-4549-abc8-31703a048241 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:30.415094 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a694f-a8de-4549-abc8-31703a048241 admin admin] PATH_INFO: `/v3/projects/0efe71b44e214d98a4c28b217877d9e7/users/6dd4d62471284309a8a6b3b7c8e44a87/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:30.417179 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32a694f-a8de-4549-abc8-31703a048241 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0efe71b44e214d98a4c28b217877d9e7, user_id=6dd4d62471284309a8a6b3b7c8e44a87, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:30.420706 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32a694f-a8de-4549-abc8-31703a048241 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:30.434816 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1266/2504] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:38:30 2022] PUT /identity/v3/projects/0efe71b44e214d98a4c28b217877d9e7/users/6dd4d62471284309a8a6b3b7c8e44a87/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:38:30.445756 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0882cac7-60d8-4767-b4a3-35c2e89c8a59 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:30.445894 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0882cac7-60d8-4767-b4a3-35c2e89c8a59 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:30.446268 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0882cac7-60d8-4767-b4a3-35c2e89c8a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:30.473752 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-0882cac7-60d8-4767-b4a3-35c2e89c8a59 None None] MFA Rules not processed for user `6dd4d62471284309a8a6b3b7c8e44a87`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:38:30.475001 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0882cac7-60d8-4767-b4a3-35c2e89c8a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:38:30.545969 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1239/2505] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:38:30 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:38:30.558711 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a694f-a8de-4549-abc8-31703a048241 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:30.560604 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-d32a694f-a8de-4549-abc8-31703a048241 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:38:30.576043 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:38:30.624255 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a694f-a8de-4549-abc8-31703a048241 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:30.628813 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb282ba-5e38-47f0-8252-fec0fbd1cbf7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:30.629451 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb282ba-5e38-47f0-8252-fec0fbd1cbf7 service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:30.629745 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb282ba-5e38-47f0-8252-fec0fbd1cbf7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:30.630007 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb282ba-5e38-47f0-8252-fec0fbd1cbf7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:30.640999 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb282ba-5e38-47f0-8252-fec0fbd1cbf7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:30.642443 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb282ba-5e38-47f0-8252-fec0fbd1cbf7 service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:30.652445 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1267/2506] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:38:30 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:38:31.848140 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0882cac7-60d8-4767-b4a3-35c2e89c8a59 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:31.850288 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0882cac7-60d8-4767-b4a3-35c2e89c8a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:38:31.951114 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0882cac7-60d8-4767-b4a3-35c2e89c8a59 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:31.956390 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deb9ef0-f2b3-4cb3-a265-84a61a674dd6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dafc9be75a64db095fe08b9cbb04cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:31.957234 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb9ef0-f2b3-4cb3-a265-84a61a674dd6 service placement] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:31.957514 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb9ef0-f2b3-4cb3-a265-84a61a674dd6 service placement] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:31.957785 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb9ef0-f2b3-4cb3-a265-84a61a674dd6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:31.959694 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5deb9ef0-f2b3-4cb3-a265-84a61a674dd6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:38:31.980751 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deb9ef0-f2b3-4cb3-a265-84a61a674dd6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:31.982451 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deb9ef0-f2b3-4cb3-a265-84a61a674dd6 service placement] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:31.994158 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1240/2507] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:38:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:38:32.373139 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb282ba-5e38-47f0-8252-fec0fbd1cbf7 service cinder] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:32.442592 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb282ba-5e38-47f0-8252-fec0fbd1cbf7 service cinder] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:32.447234 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ca379d-4ff5-473f-8307-9da4376d2d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:32.448099 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ca379d-4ff5-473f-8307-9da4376d2d15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:32.448506 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ca379d-4ff5-473f-8307-9da4376d2d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:32.448776 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ca379d-4ff5-473f-8307-9da4376d2d15 admin admin] PATH_INFO: `/v3/users/2a82c7c1f65b4385911fa2aa2d32d5ff` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:32.449974 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ca379d-4ff5-473f-8307-9da4376d2d15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a82c7c1f65b4385911fa2aa2d32d5ff)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:32.451997 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ca379d-4ff5-473f-8307-9da4376d2d15 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:32.502467 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d1ca379d-4ff5-473f-8307-9da4376d2d15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a82c7c1f65b4385911fa2aa2d32d5ff'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:32.503323 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d1ca379d-4ff5-473f-8307-9da4376d2d15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a82c7c1f65b4385911fa2aa2d32d5ff'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:32.512815 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d1ca379d-4ff5-473f-8307-9da4376d2d15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a82c7c1f65b4385911fa2aa2d32d5ff'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:32.513181 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d1ca379d-4ff5-473f-8307-9da4376d2d15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a82c7c1f65b4385911fa2aa2d32d5ff'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:32.525915 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d1ca379d-4ff5-473f-8307-9da4376d2d15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a82c7c1f65b4385911fa2aa2d32d5ff'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:32.538573 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1268/2508] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:38:32 2022] DELETE /identity/v3/users/2a82c7c1f65b4385911fa2aa2d32d5ff => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:38:32.543446 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1339e-0eb4-412a-b90f-c52c4141f5d2 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:32.543738 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1339e-0eb4-412a-b90f-c52c4141f5d2 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:32.544015 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1339e-0eb4-412a-b90f-c52c4141f5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:32.562943 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-fbc1339e-0eb4-412a-b90f-c52c4141f5d2 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:38:32.564211 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-fbc1339e-0eb4-412a-b90f-c52c4141f5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:38:32.607957 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:38:32.625000 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1241/2509] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:38:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:38:32.634950 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ca379d-4ff5-473f-8307-9da4376d2d15 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:32.636574 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-d1ca379d-4ff5-473f-8307-9da4376d2d15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:38:32.678974 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:38:32.700402 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ca379d-4ff5-473f-8307-9da4376d2d15 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:32.704715 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f632add-02bb-4cee-b367-8c4a84d2cce0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:32.705423 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f632add-02bb-4cee-b367-8c4a84d2cce0 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:32.705699 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f632add-02bb-4cee-b367-8c4a84d2cce0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:32.705965 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f632add-02bb-4cee-b367-8c4a84d2cce0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:32.716708 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f632add-02bb-4cee-b367-8c4a84d2cce0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:32.718156 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f632add-02bb-4cee-b367-8c4a84d2cce0 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:32.728992 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1269/2510] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:38:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:38:33.020890 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1339e-0eb4-412a-b90f-c52c4141f5d2 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:33.022365 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-fbc1339e-0eb4-412a-b90f-c52c4141f5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:38:33.036565 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1339e-0eb4-412a-b90f-c52c4141f5d2 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:33.042100 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02213591-1c2c-49ec-8282-a86aeb5d56c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:33.042969 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02213591-1c2c-49ec-8282-a86aeb5d56c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:33.043283 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02213591-1c2c-49ec-8282-a86aeb5d56c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:33.043563 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02213591-1c2c-49ec-8282-a86aeb5d56c5 admin admin] PATH_INFO: `/v3/projects/fa0517eb4a924c5f8e739a76df56d2c4` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:33.044754 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02213591-1c2c-49ec-8282-a86aeb5d56c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa0517eb4a924c5f8e739a76df56d2c4)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:33.046649 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02213591-1c2c-49ec-8282-a86aeb5d56c5 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:33.104359 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-02213591-1c2c-49ec-8282-a86aeb5d56c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa0517eb4a924c5f8e739a76df56d2c4', 'request_id': 'req-02213591-1c2c-49ec-8282-a86aeb5d56c5'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:33.110002 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-02213591-1c2c-49ec-8282-a86aeb5d56c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa0517eb4a924c5f8e739a76df56d2c4', 'request_id': 'req-02213591-1c2c-49ec-8282-a86aeb5d56c5'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:33.118912 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-02213591-1c2c-49ec-8282-a86aeb5d56c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa0517eb4a924c5f8e739a76df56d2c4', 'request_id': 'req-02213591-1c2c-49ec-8282-a86aeb5d56c5'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:33.134600 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-02213591-1c2c-49ec-8282-a86aeb5d56c5 admin admin] The token cache is being invalidate because project fa0517eb4a924c5f8e739a76df56d2c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:38:33.135276 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-02213591-1c2c-49ec-8282-a86aeb5d56c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:33.136416 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-02213591-1c2c-49ec-8282-a86aeb5d56c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:33.138589 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1242/2511] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:38:33 2022] DELETE /identity/v3/projects/fa0517eb4a924c5f8e739a76df56d2c4 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:38:33.142452 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f632add-02bb-4cee-b367-8c4a84d2cce0 service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:33.154732 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f632add-02bb-4cee-b367-8c4a84d2cce0 service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:33.230537 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24794bd4-77fe-4170-836b-f2a91151cd7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:33.231775 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24794bd4-77fe-4170-836b-f2a91151cd7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:33.232310 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24794bd4-77fe-4170-836b-f2a91151cd7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:33.233537 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24794bd4-77fe-4170-836b-f2a91151cd7b admin admin] PATH_INFO: `/v3/users/6dd4d62471284309a8a6b3b7c8e44a87` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:33.236231 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24794bd4-77fe-4170-836b-f2a91151cd7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dd4d62471284309a8a6b3b7c8e44a87)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:33.238440 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24794bd4-77fe-4170-836b-f2a91151cd7b admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:33.295622 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-24794bd4-77fe-4170-836b-f2a91151cd7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dd4d62471284309a8a6b3b7c8e44a87'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:33.296351 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-24794bd4-77fe-4170-836b-f2a91151cd7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dd4d62471284309a8a6b3b7c8e44a87'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:33.308343 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-24794bd4-77fe-4170-836b-f2a91151cd7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dd4d62471284309a8a6b3b7c8e44a87'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:33.309052 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-24794bd4-77fe-4170-836b-f2a91151cd7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dd4d62471284309a8a6b3b7c8e44a87'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:33.324546 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-24794bd4-77fe-4170-836b-f2a91151cd7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dd4d62471284309a8a6b3b7c8e44a87'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:33.340116 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1270/2512] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:38:33 2022] DELETE /identity/v3/users/6dd4d62471284309a8a6b3b7c8e44a87 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 03:38:33.628269 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02213591-1c2c-49ec-8282-a86aeb5d56c5 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:33.629958 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-02213591-1c2c-49ec-8282-a86aeb5d56c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:38:33.645587 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02213591-1c2c-49ec-8282-a86aeb5d56c5 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:33.714770 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d7ec7e-f439-43bf-a18c-e4240abbff02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:33.715938 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7ec7e-f439-43bf-a18c-e4240abbff02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:33.716303 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7ec7e-f439-43bf-a18c-e4240abbff02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:33.716781 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7ec7e-f439-43bf-a18c-e4240abbff02 admin admin] PATH_INFO: `/v3/projects/0efe71b44e214d98a4c28b217877d9e7` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:33.719770 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d7ec7e-f439-43bf-a18c-e4240abbff02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0efe71b44e214d98a4c28b217877d9e7)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:33.723361 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d7ec7e-f439-43bf-a18c-e4240abbff02 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:33.777333 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-47d7ec7e-f439-43bf-a18c-e4240abbff02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0efe71b44e214d98a4c28b217877d9e7', 'request_id': 'req-47d7ec7e-f439-43bf-a18c-e4240abbff02'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:33.783907 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-47d7ec7e-f439-43bf-a18c-e4240abbff02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0efe71b44e214d98a4c28b217877d9e7', 'request_id': 'req-47d7ec7e-f439-43bf-a18c-e4240abbff02'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:33.794853 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-47d7ec7e-f439-43bf-a18c-e4240abbff02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0efe71b44e214d98a4c28b217877d9e7', 'request_id': 'req-47d7ec7e-f439-43bf-a18c-e4240abbff02'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:33.811466 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-47d7ec7e-f439-43bf-a18c-e4240abbff02 admin admin] The token cache is being invalidate because project 0efe71b44e214d98a4c28b217877d9e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:38:33.811821 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-47d7ec7e-f439-43bf-a18c-e4240abbff02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:33.812542 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-47d7ec7e-f439-43bf-a18c-e4240abbff02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:33.814220 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1243/2513] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:38:33 2022] DELETE /identity/v3/projects/0efe71b44e214d98a4c28b217877d9e7 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:38:33.820015 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b7513-c350-4fd3-a80b-b33185992008 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:33.821404 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b7513-c350-4fd3-a80b-b33185992008 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:33.821677 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b7513-c350-4fd3-a80b-b33185992008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:33.848274 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-ef2b7513-c350-4fd3-a80b-b33185992008 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:38:33.849535 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-ef2b7513-c350-4fd3-a80b-b33185992008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:38:33.921241 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:38:33.955557 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1271/2514] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:38:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:38:33.956350 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4ab4e-268a-4947-ab6c-0960fcc09c89 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:33.956767 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4ab4e-268a-4947-ab6c-0960fcc09c89 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:33.957045 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4ab4e-268a-4947-ab6c-0960fcc09c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:33.963941 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:38:33.980890 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-f4b4ab4e-268a-4947-ab6c-0960fcc09c89 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:38:33.982892 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f4b4ab4e-268a-4947-ab6c-0960fcc09c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:38:34.000119 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1244/2515] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:38:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 03:38:34.001101 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b7513-c350-4fd3-a80b-b33185992008 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:34.013745 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b7513-c350-4fd3-a80b-b33185992008 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:34.019448 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decfd3be-4fb5-4f0b-9644-55c16fa86b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:34.020865 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decfd3be-4fb5-4f0b-9644-55c16fa86b75 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:34.021361 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decfd3be-4fb5-4f0b-9644-55c16fa86b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:34.021848 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decfd3be-4fb5-4f0b-9644-55c16fa86b75 admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:34.022820 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decfd3be-4fb5-4f0b-9644-55c16fa86b75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:38:34.023388 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decfd3be-4fb5-4f0b-9644-55c16fa86b75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:34.025247 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decfd3be-4fb5-4f0b-9644-55c16fa86b75 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:34.046765 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1272/2516] 10.222.0.60 () {58 vars in 1152 bytes} [Sat Jul 2 03:38:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:38:34.047968 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b4ab4e-268a-4947-ab6c-0960fcc09c89 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:34.062330 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b4ab4e-268a-4947-ab6c-0960fcc09c89 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:34.067330 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86afd3b-50b5-48af-9abc-dccc59ae6537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:34.068169 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86afd3b-50b5-48af-9abc-dccc59ae6537 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:34.068461 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86afd3b-50b5-48af-9abc-dccc59ae6537 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:34.068735 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86afd3b-50b5-48af-9abc-dccc59ae6537 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:34.069445 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86afd3b-50b5-48af-9abc-dccc59ae6537 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:34.076164 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86afd3b-50b5-48af-9abc-dccc59ae6537 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:34.112757 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1245/2517] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:38:34 2022] POST /identity/v3/projects => generated 381 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:38:34.113827 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decfd3be-4fb5-4f0b-9644-55c16fa86b75 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:34.126277 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decfd3be-4fb5-4f0b-9644-55c16fa86b75 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:34.190159 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b063f3-acbe-4e47-bc5c-59a5d3363ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:34.191220 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b063f3-acbe-4e47-bc5c-59a5d3363ce6 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:34.191731 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b063f3-acbe-4e47-bc5c-59a5d3363ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:34.191731 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b063f3-acbe-4e47-bc5c-59a5d3363ce6 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:34.192440 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b063f3-acbe-4e47-bc5c-59a5d3363ce6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:34.194666 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b063f3-acbe-4e47-bc5c-59a5d3363ce6 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:34.219193 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1273/2518] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:38:34 2022] POST /identity/v3/users => generated 291 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:38:34.222881 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86afd3b-50b5-48af-9abc-dccc59ae6537 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:34.236165 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86afd3b-50b5-48af-9abc-dccc59ae6537 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:34.241320 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d84385-1ddc-4dd2-be87-b2ad3eac279d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:34.241997 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d84385-1ddc-4dd2-be87-b2ad3eac279d admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:34.242274 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d84385-1ddc-4dd2-be87-b2ad3eac279d admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:34.242547 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d84385-1ddc-4dd2-be87-b2ad3eac279d admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:34.243569 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d84385-1ddc-4dd2-be87-b2ad3eac279d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:34.244926 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d84385-1ddc-4dd2-be87-b2ad3eac279d admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:34.258745 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1246/2519] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:38:34 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:38:34.262518 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b063f3-acbe-4e47-bc5c-59a5d3363ce6 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:34.273396 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b063f3-acbe-4e47-bc5c-59a5d3363ce6 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:34.278666 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a2d27d-31a0-478c-8b9c-81596cfceb21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:34.279415 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a2d27d-31a0-478c-8b9c-81596cfceb21 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:34.279695 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a2d27d-31a0-478c-8b9c-81596cfceb21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:34.280127 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a2d27d-31a0-478c-8b9c-81596cfceb21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:34.280864 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a2d27d-31a0-478c-8b9c-81596cfceb21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:34.282445 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a2d27d-31a0-478c-8b9c-81596cfceb21 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:34.295368 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1274/2520] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:38:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 03:38:34.299676 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d84385-1ddc-4dd2-be87-b2ad3eac279d admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:34.310243 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d84385-1ddc-4dd2-be87-b2ad3eac279d admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:34.314992 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec6ba91-90c4-40a9-ab7b-6e627f33d47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:34.316162 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec6ba91-90c4-40a9-ab7b-6e627f33d47f admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:34.316593 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec6ba91-90c4-40a9-ab7b-6e627f33d47f admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:34.316868 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec6ba91-90c4-40a9-ab7b-6e627f33d47f admin admin] PATH_INFO: `/v3/projects/ee5c5b6ca58d46e7b2ebc67b14a2bdf1/users/6f5ffc2656ad4aafac1611c209e1e324/roles/c43aada0326446c4ade0ab1262918fa4` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:34.334597 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec6ba91-90c4-40a9-ab7b-6e627f33d47f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee5c5b6ca58d46e7b2ebc67b14a2bdf1, user_id=6f5ffc2656ad4aafac1611c209e1e324, role_id=c43aada0326446c4ade0ab1262918fa4)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:34.337571 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec6ba91-90c4-40a9-ab7b-6e627f33d47f admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:34.356672 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1247/2521] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:38:34 2022] PUT /identity/v3/projects/ee5c5b6ca58d46e7b2ebc67b14a2bdf1/users/6f5ffc2656ad4aafac1611c209e1e324/roles/c43aada0326446c4ade0ab1262918fa4 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 03:38:34.368565 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e7029f-fcd2-4fdc-b053-ea869b05d89a None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:34.368852 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e7029f-fcd2-4fdc-b053-ea869b05d89a None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:34.369125 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e7029f-fcd2-4fdc-b053-ea869b05d89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:34.402674 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-06e7029f-fcd2-4fdc-b053-ea869b05d89a None None] MFA Rules not processed for user `6f5ffc2656ad4aafac1611c209e1e324`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:38:34.404469 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-06e7029f-fcd2-4fdc-b053-ea869b05d89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:38:34.483918 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1275/2522] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:38:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:38:34.488434 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec6ba91-90c4-40a9-ab7b-6e627f33d47f admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:34.558403 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec6ba91-90c4-40a9-ab7b-6e627f33d47f admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:34.565331 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50da19-aac9-45c6-b5ab-1590a8f19a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:34.566240 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50da19-aac9-45c6-b5ab-1590a8f19a29 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:34.566738 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50da19-aac9-45c6-b5ab-1590a8f19a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:34.567134 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50da19-aac9-45c6-b5ab-1590a8f19a29 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:34.567947 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d50da19-aac9-45c6-b5ab-1590a8f19a29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:34.570029 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d50da19-aac9-45c6-b5ab-1590a8f19a29 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:34.608973 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1248/2523] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:38:34 2022] POST /identity/v3/projects => generated 383 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:38:34.613913 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e7029f-fcd2-4fdc-b053-ea869b05d89a None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:34.625538 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e7029f-fcd2-4fdc-b053-ea869b05d89a None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:34.689631 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:38:34.705494 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47888c3a-c498-462a-81f9-a39aae5f8f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:34.706359 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47888c3a-c498-462a-81f9-a39aae5f8f46 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:34.706856 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47888c3a-c498-462a-81f9-a39aae5f8f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:34.707276 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47888c3a-c498-462a-81f9-a39aae5f8f46 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:34.708109 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47888c3a-c498-462a-81f9-a39aae5f8f46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:34.710225 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47888c3a-c498-462a-81f9-a39aae5f8f46 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:34.736783 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1276/2524] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:38:34 2022] POST /identity/v3/users => generated 298 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:38:34.740993 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50da19-aac9-45c6-b5ab-1590a8f19a29 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:34.755311 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50da19-aac9-45c6-b5ab-1590a8f19a29 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:34.760392 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a836b648-3f77-4657-9734-8d724e46a79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:34.761172 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a836b648-3f77-4657-9734-8d724e46a79a admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:34.761524 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a836b648-3f77-4657-9734-8d724e46a79a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:34.761870 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a836b648-3f77-4657-9734-8d724e46a79a admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:34.762913 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a836b648-3f77-4657-9734-8d724e46a79a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:34.764804 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a836b648-3f77-4657-9734-8d724e46a79a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:34.781823 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1249/2525] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:38:34 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:38:34.783434 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47888c3a-c498-462a-81f9-a39aae5f8f46 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:34.794366 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47888c3a-c498-462a-81f9-a39aae5f8f46 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:34.799157 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b305245-76d6-469c-8117-4ff5c66ada2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:34.800129 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b305245-76d6-469c-8117-4ff5c66ada2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:34.800641 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b305245-76d6-469c-8117-4ff5c66ada2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:34.800968 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b305245-76d6-469c-8117-4ff5c66ada2e admin admin] PATH_INFO: `/v3/projects/e1e775e2f78f492fbc1512280f6e56af/users/3b04be28d3474c7ab72bfbfc5edc5ad0/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:34.818155 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b305245-76d6-469c-8117-4ff5c66ada2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1e775e2f78f492fbc1512280f6e56af, user_id=3b04be28d3474c7ab72bfbfc5edc5ad0, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:34.821124 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b305245-76d6-469c-8117-4ff5c66ada2e admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:34.836911 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1277/2526] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:38:34 2022] PUT /identity/v3/projects/e1e775e2f78f492fbc1512280f6e56af/users/3b04be28d3474c7ab72bfbfc5edc5ad0/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 03:38:34.841100 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a836b648-3f77-4657-9734-8d724e46a79a admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:34.851508 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a836b648-3f77-4657-9734-8d724e46a79a admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:34.912454 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6f4084-6b11-4bbe-ad92-c14f22a12b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:34.913258 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f4084-6b11-4bbe-ad92-c14f22a12b37 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:34.913982 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f4084-6b11-4bbe-ad92-c14f22a12b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:34.913982 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f4084-6b11-4bbe-ad92-c14f22a12b37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:34.914856 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6f4084-6b11-4bbe-ad92-c14f22a12b37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:34.916611 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6f4084-6b11-4bbe-ad92-c14f22a12b37 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:34.927263 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1250/2527] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:38:34 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:38:34.931167 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b305245-76d6-469c-8117-4ff5c66ada2e admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:34.941950 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b305245-76d6-469c-8117-4ff5c66ada2e admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:34.947358 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81dcf2f-6a6f-4b81-a776-4fc06d0074fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:34.948253 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81dcf2f-6a6f-4b81-a776-4fc06d0074fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:34.948531 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81dcf2f-6a6f-4b81-a776-4fc06d0074fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:34.949072 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81dcf2f-6a6f-4b81-a776-4fc06d0074fd admin admin] PATH_INFO: `/v3/projects/e1e775e2f78f492fbc1512280f6e56af/users/3b04be28d3474c7ab72bfbfc5edc5ad0/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:34.950762 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81dcf2f-6a6f-4b81-a776-4fc06d0074fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1e775e2f78f492fbc1512280f6e56af, user_id=3b04be28d3474c7ab72bfbfc5edc5ad0, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:34.953463 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81dcf2f-6a6f-4b81-a776-4fc06d0074fd admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:34.971262 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1278/2528] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:38:34 2022] PUT /identity/v3/projects/e1e775e2f78f492fbc1512280f6e56af/users/3b04be28d3474c7ab72bfbfc5edc5ad0/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 03:38:34.976116 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e51f9-6141-436d-9501-76938f6a7847 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:34.976407 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e51f9-6141-436d-9501-76938f6a7847 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:34.976687 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e51f9-6141-436d-9501-76938f6a7847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:34.996110 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:38:35.007486 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-b72e51f9-6141-436d-9501-76938f6a7847 None None] MFA Rules not processed for user `3b04be28d3474c7ab72bfbfc5edc5ad0`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:38:35.009449 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b72e51f9-6141-436d-9501-76938f6a7847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:38:35.096053 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1251/2529] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:38:34 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:38:35.111336 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81dcf2f-6a6f-4b81-a776-4fc06d0074fd admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:35.113102 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-d81dcf2f-6a6f-4b81-a776-4fc06d0074fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:38:35.172115 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81dcf2f-6a6f-4b81-a776-4fc06d0074fd admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:35.175940 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6142ec-d9b8-45a3-a49d-39b8da5cd464 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:35.176588 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6142ec-d9b8-45a3-a49d-39b8da5cd464 service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:35.176852 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6142ec-d9b8-45a3-a49d-39b8da5cd464 service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:35.177141 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6142ec-d9b8-45a3-a49d-39b8da5cd464 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:35.186445 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6142ec-d9b8-45a3-a49d-39b8da5cd464 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:35.187929 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6142ec-d9b8-45a3-a49d-39b8da5cd464 service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:35.197587 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1279/2530] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:38:35 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:38:35.273188 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e51f9-6141-436d-9501-76938f6a7847 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:35.283474 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e51f9-6141-436d-9501-76938f6a7847 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:35.287642 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f87bf-13f7-49cb-ba84-38b7a7d66f7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:35.288285 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f87bf-13f7-49cb-ba84-38b7a7d66f7f service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:35.288561 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f87bf-13f7-49cb-ba84-38b7a7d66f7f service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:35.288830 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f87bf-13f7-49cb-ba84-38b7a7d66f7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:35.362473 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3f87bf-13f7-49cb-ba84-38b7a7d66f7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:35.364503 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3f87bf-13f7-49cb-ba84-38b7a7d66f7f service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:35.395326 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1252/2531] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:38:35 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:38:35.720446 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6142ec-d9b8-45a3-a49d-39b8da5cd464 service cinder] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:35.815070 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6142ec-d9b8-45a3-a49d-39b8da5cd464 service cinder] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:35.820136 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e114a00-a3af-4f68-a400-16dbb5e5143c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:35.821019 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e114a00-a3af-4f68-a400-16dbb5e5143c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:35.821294 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e114a00-a3af-4f68-a400-16dbb5e5143c admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:35.821863 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e114a00-a3af-4f68-a400-16dbb5e5143c admin admin] PATH_INFO: `/v3/users/6f5ffc2656ad4aafac1611c209e1e324` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:35.822798 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e114a00-a3af-4f68-a400-16dbb5e5143c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f5ffc2656ad4aafac1611c209e1e324)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:35.824819 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e114a00-a3af-4f68-a400-16dbb5e5143c admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:35.905307 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-7e114a00-a3af-4f68-a400-16dbb5e5143c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f5ffc2656ad4aafac1611c209e1e324'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:35.906073 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-7e114a00-a3af-4f68-a400-16dbb5e5143c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f5ffc2656ad4aafac1611c209e1e324'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:35.909557 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:38:35.917825 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-7e114a00-a3af-4f68-a400-16dbb5e5143c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f5ffc2656ad4aafac1611c209e1e324'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:35.919000 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-7e114a00-a3af-4f68-a400-16dbb5e5143c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f5ffc2656ad4aafac1611c209e1e324'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:35.936794 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-7e114a00-a3af-4f68-a400-16dbb5e5143c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f5ffc2656ad4aafac1611c209e1e324'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:35.955575 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1280/2532] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:38:35 2022] DELETE /identity/v3/users/6f5ffc2656ad4aafac1611c209e1e324 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:38:35.960570 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82e738-2cf9-4b92-a718-a6a42a40c174 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:35.960830 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82e738-2cf9-4b92-a718-a6a42a40c174 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:35.961106 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82e738-2cf9-4b92-a718-a6a42a40c174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:35.980232 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-9f82e738-2cf9-4b92-a718-a6a42a40c174 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:38:35.981544 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9f82e738-2cf9-4b92-a718-a6a42a40c174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:38:36.080442 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1253/2533] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:38:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:38:36.094463 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e114a00-a3af-4f68-a400-16dbb5e5143c admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:36.096327 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-7e114a00-a3af-4f68-a400-16dbb5e5143c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:38:36.181712 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e114a00-a3af-4f68-a400-16dbb5e5143c admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:36.186102 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a3b22b-6f69-4f7c-96dc-f5d0767a668b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:36.186767 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3b22b-6f69-4f7c-96dc-f5d0767a668b service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:36.187046 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3b22b-6f69-4f7c-96dc-f5d0767a668b service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:36.187406 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3b22b-6f69-4f7c-96dc-f5d0767a668b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:36.197959 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a3b22b-6f69-4f7c-96dc-f5d0767a668b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:36.199469 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a3b22b-6f69-4f7c-96dc-f5d0767a668b service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:36.211783 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1281/2534] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:38:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:38:36.244556 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f82e738-2cf9-4b92-a718-a6a42a40c174 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:36.247009 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9f82e738-2cf9-4b92-a718-a6a42a40c174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:38:36.264087 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f82e738-2cf9-4b92-a718-a6a42a40c174 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:36.272472 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85062ca-db57-43e2-8a56-0583b2a645be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:36.273722 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85062ca-db57-43e2-8a56-0583b2a645be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:36.273984 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85062ca-db57-43e2-8a56-0583b2a645be admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:36.274335 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85062ca-db57-43e2-8a56-0583b2a645be admin admin] PATH_INFO: `/v3/users/4790ced1b60d4936a186c3fd80f9476e` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:36.275597 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85062ca-db57-43e2-8a56-0583b2a645be admin admin] RBAC: Authorizing `identity:delete_user(user_id=4790ced1b60d4936a186c3fd80f9476e)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:36.277627 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85062ca-db57-43e2-8a56-0583b2a645be admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:36.311792 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:38:36.331548 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-c85062ca-db57-43e2-8a56-0583b2a645be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4790ced1b60d4936a186c3fd80f9476e'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:36.332292 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-c85062ca-db57-43e2-8a56-0583b2a645be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4790ced1b60d4936a186c3fd80f9476e'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:36.332907 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-c85062ca-db57-43e2-8a56-0583b2a645be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4790ced1b60d4936a186c3fd80f9476e'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:36.345809 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-c85062ca-db57-43e2-8a56-0583b2a645be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4790ced1b60d4936a186c3fd80f9476e'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:36.353319 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-c85062ca-db57-43e2-8a56-0583b2a645be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4790ced1b60d4936a186c3fd80f9476e'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:36.366906 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1254/2535] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:38:36 2022] DELETE /identity/v3/users/4790ced1b60d4936a186c3fd80f9476e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:38:36.504665 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a3b22b-6f69-4f7c-96dc-f5d0767a668b service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:36.506363 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-78a3b22b-6f69-4f7c-96dc-f5d0767a668b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:38:36.522935 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a3b22b-6f69-4f7c-96dc-f5d0767a668b service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:36.561638 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85062ca-db57-43e2-8a56-0583b2a645be admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:36.563366 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c85062ca-db57-43e2-8a56-0583b2a645be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:38:36.600427 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be6a83b-59e0-47a8-86bb-b1736d62f5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:36.601320 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6a83b-59e0-47a8-86bb-b1736d62f5b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:36.601608 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6a83b-59e0-47a8-86bb-b1736d62f5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:36.601870 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6a83b-59e0-47a8-86bb-b1736d62f5b9 admin admin] PATH_INFO: `/v3/projects/ee5c5b6ca58d46e7b2ebc67b14a2bdf1` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:36.603058 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be6a83b-59e0-47a8-86bb-b1736d62f5b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee5c5b6ca58d46e7b2ebc67b14a2bdf1)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:36.605142 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be6a83b-59e0-47a8-86bb-b1736d62f5b9 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:36.640987 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85062ca-db57-43e2-8a56-0583b2a645be admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:36.650478 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-5be6a83b-59e0-47a8-86bb-b1736d62f5b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee5c5b6ca58d46e7b2ebc67b14a2bdf1', 'request_id': 'req-5be6a83b-59e0-47a8-86bb-b1736d62f5b9'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:36.655966 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-5be6a83b-59e0-47a8-86bb-b1736d62f5b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee5c5b6ca58d46e7b2ebc67b14a2bdf1', 'request_id': 'req-5be6a83b-59e0-47a8-86bb-b1736d62f5b9'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:36.662598 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-5be6a83b-59e0-47a8-86bb-b1736d62f5b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee5c5b6ca58d46e7b2ebc67b14a2bdf1', 'request_id': 'req-5be6a83b-59e0-47a8-86bb-b1736d62f5b9'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:36.672807 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:38:36.677172 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-5be6a83b-59e0-47a8-86bb-b1736d62f5b9 admin admin] The token cache is being invalidate because project ee5c5b6ca58d46e7b2ebc67b14a2bdf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:38:36.677559 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-5be6a83b-59e0-47a8-86bb-b1736d62f5b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:36.678705 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-5be6a83b-59e0-47a8-86bb-b1736d62f5b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:36.680567 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1282/2536] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:38:36 2022] DELETE /identity/v3/projects/ee5c5b6ca58d46e7b2ebc67b14a2bdf1 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:38:36.684568 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be6a83b-59e0-47a8-86bb-b1736d62f5b9 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:36.685974 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-5be6a83b-59e0-47a8-86bb-b1736d62f5b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:38:36.702257 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15427192-f84d-4e55-88ee-bc446c0d204c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:36.703163 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15427192-f84d-4e55-88ee-bc446c0d204c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:36.703454 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15427192-f84d-4e55-88ee-bc446c0d204c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:36.703731 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15427192-f84d-4e55-88ee-bc446c0d204c admin admin] PATH_INFO: `/v3/projects/30ab2b5c51184c4298a4e98a1562e407` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:36.705027 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15427192-f84d-4e55-88ee-bc446c0d204c admin admin] RBAC: Authorizing `identity:delete_project(project_id=30ab2b5c51184c4298a4e98a1562e407)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:36.706999 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15427192-f84d-4e55-88ee-bc446c0d204c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:36.749152 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be6a83b-59e0-47a8-86bb-b1736d62f5b9 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:36.753018 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-15427192-f84d-4e55-88ee-bc446c0d204c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30ab2b5c51184c4298a4e98a1562e407', 'request_id': 'req-15427192-f84d-4e55-88ee-bc446c0d204c'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:36.758005 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:38:36.760240 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-15427192-f84d-4e55-88ee-bc446c0d204c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30ab2b5c51184c4298a4e98a1562e407', 'request_id': 'req-15427192-f84d-4e55-88ee-bc446c0d204c'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:36.769303 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-15427192-f84d-4e55-88ee-bc446c0d204c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30ab2b5c51184c4298a4e98a1562e407', 'request_id': 'req-15427192-f84d-4e55-88ee-bc446c0d204c'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:36.780872 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-15427192-f84d-4e55-88ee-bc446c0d204c admin admin] The token cache is being invalidate because project 30ab2b5c51184c4298a4e98a1562e407 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:38:36.781160 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-15427192-f84d-4e55-88ee-bc446c0d204c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:36.781786 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-15427192-f84d-4e55-88ee-bc446c0d204c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:36.783601 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1255/2537] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:38:36 2022] DELETE /identity/v3/projects/30ab2b5c51184c4298a4e98a1562e407 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 03:38:36.787873 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15427192-f84d-4e55-88ee-bc446c0d204c admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:36.789237 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-15427192-f84d-4e55-88ee-bc446c0d204c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:38:36.812507 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45359dd7-7ec3-45d4-8de9-9f62498cf462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:36.813552 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45359dd7-7ec3-45d4-8de9-9f62498cf462 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:36.813895 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45359dd7-7ec3-45d4-8de9-9f62498cf462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:36.814314 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45359dd7-7ec3-45d4-8de9-9f62498cf462 admin admin] PATH_INFO: `/v3/users/3b04be28d3474c7ab72bfbfc5edc5ad0` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:36.815680 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45359dd7-7ec3-45d4-8de9-9f62498cf462 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b04be28d3474c7ab72bfbfc5edc5ad0)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:36.818433 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45359dd7-7ec3-45d4-8de9-9f62498cf462 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:36.858956 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15427192-f84d-4e55-88ee-bc446c0d204c admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:36.863810 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f51923-e67a-44fc-a6c6-3dec6a6bbc28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:36.864726 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f51923-e67a-44fc-a6c6-3dec6a6bbc28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:36.865000 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f51923-e67a-44fc-a6c6-3dec6a6bbc28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:36.865299 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f51923-e67a-44fc-a6c6-3dec6a6bbc28 admin admin] PATH_INFO: `/v3/users/dd386d02e1f0442d843817a11bfcd44a` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:36.866505 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f51923-e67a-44fc-a6c6-3dec6a6bbc28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd386d02e1f0442d843817a11bfcd44a)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:36.868756 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f51923-e67a-44fc-a6c6-3dec6a6bbc28 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:36.871153 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-45359dd7-7ec3-45d4-8de9-9f62498cf462 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b04be28d3474c7ab72bfbfc5edc5ad0'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:36.871958 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-45359dd7-7ec3-45d4-8de9-9f62498cf462 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b04be28d3474c7ab72bfbfc5edc5ad0'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:36.880592 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-45359dd7-7ec3-45d4-8de9-9f62498cf462 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b04be28d3474c7ab72bfbfc5edc5ad0'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:36.881296 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-45359dd7-7ec3-45d4-8de9-9f62498cf462 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b04be28d3474c7ab72bfbfc5edc5ad0'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:36.895336 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-45359dd7-7ec3-45d4-8de9-9f62498cf462 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b04be28d3474c7ab72bfbfc5edc5ad0'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:36.909766 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1283/2538] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:38:36 2022] DELETE /identity/v3/users/3b04be28d3474c7ab72bfbfc5edc5ad0 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:38:36.916716 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-b4f51923-e67a-44fc-a6c6-3dec6a6bbc28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd386d02e1f0442d843817a11bfcd44a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:36.917368 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-b4f51923-e67a-44fc-a6c6-3dec6a6bbc28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd386d02e1f0442d843817a11bfcd44a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:36.917970 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-b4f51923-e67a-44fc-a6c6-3dec6a6bbc28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd386d02e1f0442d843817a11bfcd44a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:36.930409 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-b4f51923-e67a-44fc-a6c6-3dec6a6bbc28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd386d02e1f0442d843817a11bfcd44a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:36.937308 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-b4f51923-e67a-44fc-a6c6-3dec6a6bbc28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd386d02e1f0442d843817a11bfcd44a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:36.951775 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1256/2539] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:38:36 2022] DELETE /identity/v3/users/dd386d02e1f0442d843817a11bfcd44a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 03:38:37.141749 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45359dd7-7ec3-45d4-8de9-9f62498cf462 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:37.143532 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-45359dd7-7ec3-45d4-8de9-9f62498cf462 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:38:37.179828 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:38:37.212187 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f51923-e67a-44fc-a6c6-3dec6a6bbc28 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:37.213921 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b4f51923-e67a-44fc-a6c6-3dec6a6bbc28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:38:37.221048 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45359dd7-7ec3-45d4-8de9-9f62498cf462 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:37.295941 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f51923-e67a-44fc-a6c6-3dec6a6bbc28 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:37.300828 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3305f80-c7af-4a8b-bbc1-abe9509aa18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:37.301698 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3305f80-c7af-4a8b-bbc1-abe9509aa18a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:37.301974 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3305f80-c7af-4a8b-bbc1-abe9509aa18a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:37.302383 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3305f80-c7af-4a8b-bbc1-abe9509aa18a admin admin] PATH_INFO: `/v3/projects/e1e775e2f78f492fbc1512280f6e56af` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:37.303732 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3305f80-c7af-4a8b-bbc1-abe9509aa18a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1e775e2f78f492fbc1512280f6e56af)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:37.305277 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee85233-7a7c-473c-946f-00a25f3ffc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:37.305682 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3305f80-c7af-4a8b-bbc1-abe9509aa18a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:37.306361 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee85233-7a7c-473c-946f-00a25f3ffc73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:37.306737 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee85233-7a7c-473c-946f-00a25f3ffc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:37.307255 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee85233-7a7c-473c-946f-00a25f3ffc73 admin admin] PATH_INFO: `/v3/projects/55f46c91b05d45b0951f958309c2a179` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:37.308484 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee85233-7a7c-473c-946f-00a25f3ffc73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55f46c91b05d45b0951f958309c2a179)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:37.308858 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:38:37.310497 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee85233-7a7c-473c-946f-00a25f3ffc73 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:37.367168 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-eee85233-7a7c-473c-946f-00a25f3ffc73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55f46c91b05d45b0951f958309c2a179', 'request_id': 'req-eee85233-7a7c-473c-946f-00a25f3ffc73'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:37.371173 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f3305f80-c7af-4a8b-bbc1-abe9509aa18a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1e775e2f78f492fbc1512280f6e56af', 'request_id': 'req-f3305f80-c7af-4a8b-bbc1-abe9509aa18a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:37.374562 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-eee85233-7a7c-473c-946f-00a25f3ffc73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55f46c91b05d45b0951f958309c2a179', 'request_id': 'req-eee85233-7a7c-473c-946f-00a25f3ffc73'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:37.376232 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f3305f80-c7af-4a8b-bbc1-abe9509aa18a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1e775e2f78f492fbc1512280f6e56af', 'request_id': 'req-f3305f80-c7af-4a8b-bbc1-abe9509aa18a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:37.381586 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-eee85233-7a7c-473c-946f-00a25f3ffc73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55f46c91b05d45b0951f958309c2a179', 'request_id': 'req-eee85233-7a7c-473c-946f-00a25f3ffc73'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:37.388586 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f3305f80-c7af-4a8b-bbc1-abe9509aa18a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1e775e2f78f492fbc1512280f6e56af', 'request_id': 'req-f3305f80-c7af-4a8b-bbc1-abe9509aa18a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:37.397752 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-eee85233-7a7c-473c-946f-00a25f3ffc73 admin admin] The token cache is being invalidate because project 55f46c91b05d45b0951f958309c2a179 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:38:37.398050 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-eee85233-7a7c-473c-946f-00a25f3ffc73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:37.398639 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-eee85233-7a7c-473c-946f-00a25f3ffc73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:37.400308 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1284/2540] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:38:37 2022] DELETE /identity/v3/projects/55f46c91b05d45b0951f958309c2a179 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:38:37.400732 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f3305f80-c7af-4a8b-bbc1-abe9509aa18a admin admin] The token cache is being invalidate because project e1e775e2f78f492fbc1512280f6e56af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:38:37.401018 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f3305f80-c7af-4a8b-bbc1-abe9509aa18a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:37.401633 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f3305f80-c7af-4a8b-bbc1-abe9509aa18a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:37.403346 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1257/2541] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:38:37 2022] DELETE /identity/v3/projects/e1e775e2f78f492fbc1512280f6e56af => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 03:38:37.412837 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2f616-86f1-4116-bb2d-f33066900056 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:37.413123 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2f616-86f1-4116-bb2d-f33066900056 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:37.413408 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2f616-86f1-4116-bb2d-f33066900056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:37.435305 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-41c2f616-86f1-4116-bb2d-f33066900056 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:38:37.436650 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-41c2f616-86f1-4116-bb2d-f33066900056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:38:37.508719 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1285/2542] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:38:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:38:37.516834 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b88e4-f1f8-44f6-9d2d-83b325c68dcc None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:37.517262 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b88e4-f1f8-44f6-9d2d-83b325c68dcc None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:37.517582 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b88e4-f1f8-44f6-9d2d-83b325c68dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:37.538276 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-b94b88e4-f1f8-44f6-9d2d-83b325c68dcc None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:38:37.539578 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b94b88e4-f1f8-44f6-9d2d-83b325c68dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:38:37.548428 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1258/2543] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:38:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:38:37.552924 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c2f616-86f1-4116-bb2d-f33066900056 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:37.560136 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:38:37.564021 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c2f616-86f1-4116-bb2d-f33066900056 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:37.569973 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6637e7-d9ba-4001-bafd-8f23fd2861cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:37.570757 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6637e7-d9ba-4001-bafd-8f23fd2861cf admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:37.571112 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6637e7-d9ba-4001-bafd-8f23fd2861cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:37.571492 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6637e7-d9ba-4001-bafd-8f23fd2861cf admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:37.572327 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6637e7-d9ba-4001-bafd-8f23fd2861cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:38:37.572870 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6637e7-d9ba-4001-bafd-8f23fd2861cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:37.575411 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6637e7-d9ba-4001-bafd-8f23fd2861cf admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:37.589067 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1286/2544] 10.222.0.60 () {58 vars in 1152 bytes} [Sat Jul 2 03:38:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:38:37.593618 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b88e4-f1f8-44f6-9d2d-83b325c68dcc None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:37.603519 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b88e4-f1f8-44f6-9d2d-83b325c68dcc None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:37.609224 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be948011-27ef-46c8-b454-7a4a85167822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:37.609885 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be948011-27ef-46c8-b454-7a4a85167822 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:37.610170 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be948011-27ef-46c8-b454-7a4a85167822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:37.610473 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be948011-27ef-46c8-b454-7a4a85167822 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:37.611227 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be948011-27ef-46c8-b454-7a4a85167822 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:37.613360 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be948011-27ef-46c8-b454-7a4a85167822 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:37.642716 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1259/2545] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:38:37 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:38:37.647903 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6637e7-d9ba-4001-bafd-8f23fd2861cf admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:37.659680 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6637e7-d9ba-4001-bafd-8f23fd2861cf admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:37.725168 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bd62ec-a9ba-4792-af72-e3e7e701cafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:37.726050 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd62ec-a9ba-4792-af72-e3e7e701cafa admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:37.726334 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd62ec-a9ba-4792-af72-e3e7e701cafa admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:37.726771 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd62ec-a9ba-4792-af72-e3e7e701cafa admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:37.727892 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bd62ec-a9ba-4792-af72-e3e7e701cafa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:37.730050 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bd62ec-a9ba-4792-af72-e3e7e701cafa admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:37.751737 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1287/2546] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:38:37 2022] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 03:38:37.762432 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be948011-27ef-46c8-b454-7a4a85167822 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:37.777582 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be948011-27ef-46c8-b454-7a4a85167822 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:37.783497 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69585e97-2e40-4bae-a39f-257306582ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:37.784482 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69585e97-2e40-4bae-a39f-257306582ebd admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:37.784803 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69585e97-2e40-4bae-a39f-257306582ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:37.785069 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69585e97-2e40-4bae-a39f-257306582ebd admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:37.785792 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69585e97-2e40-4bae-a39f-257306582ebd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:37.787427 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69585e97-2e40-4bae-a39f-257306582ebd admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:37.799367 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1260/2547] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:38:37 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:38:37.804392 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bd62ec-a9ba-4792-af72-e3e7e701cafa admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:37.814977 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bd62ec-a9ba-4792-af72-e3e7e701cafa admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:37.823396 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5fd7cd-a776-4fdc-8318-bf70dac3dc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:37.824036 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5fd7cd-a776-4fdc-8318-bf70dac3dc40 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:37.824314 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5fd7cd-a776-4fdc-8318-bf70dac3dc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:37.824584 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5fd7cd-a776-4fdc-8318-bf70dac3dc40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:37.825328 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5fd7cd-a776-4fdc-8318-bf70dac3dc40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:37.826957 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5fd7cd-a776-4fdc-8318-bf70dac3dc40 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:37.837410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1288/2548] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:38:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:38:37.841812 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69585e97-2e40-4bae-a39f-257306582ebd admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:37.852146 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69585e97-2e40-4bae-a39f-257306582ebd admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:37.857196 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdece075-f9d7-40ce-963e-9ed8bac24afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:37.858121 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdece075-f9d7-40ce-963e-9ed8bac24afb admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:37.858396 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdece075-f9d7-40ce-963e-9ed8bac24afb admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:37.858696 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdece075-f9d7-40ce-963e-9ed8bac24afb admin admin] PATH_INFO: `/v3/projects/cab79d26b70340bbb348b9e8e9ee3ff0/users/6af01501c6014c529d6b4eaaa95cf539/roles/c43aada0326446c4ade0ab1262918fa4` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:37.873334 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdece075-f9d7-40ce-963e-9ed8bac24afb admin admin] RBAC: Authorizing `identity:create_grant(project_id=cab79d26b70340bbb348b9e8e9ee3ff0, user_id=6af01501c6014c529d6b4eaaa95cf539, role_id=c43aada0326446c4ade0ab1262918fa4)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:37.876048 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdece075-f9d7-40ce-963e-9ed8bac24afb admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:37.890476 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1261/2549] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:38:37 2022] PUT /identity/v3/projects/cab79d26b70340bbb348b9e8e9ee3ff0/users/6af01501c6014c529d6b4eaaa95cf539/roles/c43aada0326446c4ade0ab1262918fa4 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 03:38:37.901170 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce15fda8-0c4e-4d28-b2cb-a5713341dc16 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:37.901738 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce15fda8-0c4e-4d28-b2cb-a5713341dc16 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:37.901738 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce15fda8-0c4e-4d28-b2cb-a5713341dc16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:37.930856 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-ce15fda8-0c4e-4d28-b2cb-a5713341dc16 None None] MFA Rules not processed for user `6af01501c6014c529d6b4eaaa95cf539`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:38:37.932115 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-ce15fda8-0c4e-4d28-b2cb-a5713341dc16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:38:37.999915 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1289/2550] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:38:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 03:38:38.004776 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdece075-f9d7-40ce-963e-9ed8bac24afb admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:38.069279 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdece075-f9d7-40ce-963e-9ed8bac24afb admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:38.074654 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59417f4a-1b87-4c58-bce9-0c71f6f99ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:38.075270 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59417f4a-1b87-4c58-bce9-0c71f6f99ee2 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:38.075551 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59417f4a-1b87-4c58-bce9-0c71f6f99ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:38.075825 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59417f4a-1b87-4c58-bce9-0c71f6f99ee2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:38.076511 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59417f4a-1b87-4c58-bce9-0c71f6f99ee2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:38.078438 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59417f4a-1b87-4c58-bce9-0c71f6f99ee2 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:38.109991 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1262/2551] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:38:38 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:38:38.114431 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce15fda8-0c4e-4d28-b2cb-a5713341dc16 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:38.125765 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce15fda8-0c4e-4d28-b2cb-a5713341dc16 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:38.186106 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff1d72-d31c-4fc0-b1a2-56d94d009ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:38.186784 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff1d72-d31c-4fc0-b1a2-56d94d009ee0 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:38.187065 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff1d72-d31c-4fc0-b1a2-56d94d009ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:38.187365 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff1d72-d31c-4fc0-b1a2-56d94d009ee0 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:38.188356 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccff1d72-d31c-4fc0-b1a2-56d94d009ee0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:38.190419 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccff1d72-d31c-4fc0-b1a2-56d94d009ee0 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:38.197257 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:38:38.215337 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1290/2552] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:38:38 2022] POST /identity/v3/users => generated 298 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:38:38.219603 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59417f4a-1b87-4c58-bce9-0c71f6f99ee2 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:38.231718 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59417f4a-1b87-4c58-bce9-0c71f6f99ee2 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:38.236631 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9da2a5-aba3-41d1-9871-631ddfd674f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:38.237310 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9da2a5-aba3-41d1-9871-631ddfd674f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:38.237593 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9da2a5-aba3-41d1-9871-631ddfd674f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:38.237870 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9da2a5-aba3-41d1-9871-631ddfd674f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:38.238691 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9da2a5-aba3-41d1-9871-631ddfd674f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:38.240341 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9da2a5-aba3-41d1-9871-631ddfd674f0 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:38.251220 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1263/2553] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:38:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:38:38.255828 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff1d72-d31c-4fc0-b1a2-56d94d009ee0 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:38.265936 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff1d72-d31c-4fc0-b1a2-56d94d009ee0 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:38.271181 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed13cdb0-98d1-4a91-802d-9fe03960cab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:38.272056 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13cdb0-98d1-4a91-802d-9fe03960cab1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:38.272329 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13cdb0-98d1-4a91-802d-9fe03960cab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:38.272596 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13cdb0-98d1-4a91-802d-9fe03960cab1 admin admin] PATH_INFO: `/v3/projects/636fae5018a14deeb915d8c3acd8efdc/users/3d5ebcbb659b4cde93569196ae912617/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:38.288071 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed13cdb0-98d1-4a91-802d-9fe03960cab1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=636fae5018a14deeb915d8c3acd8efdc, user_id=3d5ebcbb659b4cde93569196ae912617, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:38.290724 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed13cdb0-98d1-4a91-802d-9fe03960cab1 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:38.305063 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1291/2554] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:38:38 2022] PUT /identity/v3/projects/636fae5018a14deeb915d8c3acd8efdc/users/3d5ebcbb659b4cde93569196ae912617/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:38:38.309166 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9da2a5-aba3-41d1-9871-631ddfd674f0 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:38.314468 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:38:38.320849 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9da2a5-aba3-41d1-9871-631ddfd674f0 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:38.384024 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c40c26-f477-4f34-9c0f-b58b92e1a9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:38.384700 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c40c26-f477-4f34-9c0f-b58b92e1a9ba admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:38.384978 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c40c26-f477-4f34-9c0f-b58b92e1a9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:38.385245 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c40c26-f477-4f34-9c0f-b58b92e1a9ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:38.385982 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c40c26-f477-4f34-9c0f-b58b92e1a9ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:38.387627 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c40c26-f477-4f34-9c0f-b58b92e1a9ba admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:38.398449 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1264/2555] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:38:38 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:38:38.402714 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed13cdb0-98d1-4a91-802d-9fe03960cab1 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:38.414121 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed13cdb0-98d1-4a91-802d-9fe03960cab1 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:38.418988 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b41ff6-7abb-406f-9b90-3dc7d75f2145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:38.419919 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b41ff6-7abb-406f-9b90-3dc7d75f2145 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:38.420311 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b41ff6-7abb-406f-9b90-3dc7d75f2145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:38.420589 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b41ff6-7abb-406f-9b90-3dc7d75f2145 admin admin] PATH_INFO: `/v3/projects/636fae5018a14deeb915d8c3acd8efdc/users/3d5ebcbb659b4cde93569196ae912617/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:38.422619 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b41ff6-7abb-406f-9b90-3dc7d75f2145 admin admin] RBAC: Authorizing `identity:create_grant(project_id=636fae5018a14deeb915d8c3acd8efdc, user_id=3d5ebcbb659b4cde93569196ae912617, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:38.425339 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b41ff6-7abb-406f-9b90-3dc7d75f2145 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:38.435922 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1292/2556] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:38:38 2022] PUT /identity/v3/projects/636fae5018a14deeb915d8c3acd8efdc/users/3d5ebcbb659b4cde93569196ae912617/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:38:38.447814 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef53130-a758-4fed-9e5e-dd1d634b6a34 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:38.448275 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef53130-a758-4fed-9e5e-dd1d634b6a34 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:38.448527 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef53130-a758-4fed-9e5e-dd1d634b6a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:38.479279 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-eef53130-a758-4fed-9e5e-dd1d634b6a34 None None] MFA Rules not processed for user `3d5ebcbb659b4cde93569196ae912617`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:38:38.480540 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-eef53130-a758-4fed-9e5e-dd1d634b6a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:38:38.551904 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1265/2557] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:38:38 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:38:38.563069 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b41ff6-7abb-406f-9b90-3dc7d75f2145 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:38.564896 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-e0b41ff6-7abb-406f-9b90-3dc7d75f2145 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:38:38.626305 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b41ff6-7abb-406f-9b90-3dc7d75f2145 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:38.630523 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e7467-af1a-4866-bf7c-6a5350d97db8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:38.631178 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e7467-af1a-4866-bf7c-6a5350d97db8 service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:38.631485 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e7467-af1a-4866-bf7c-6a5350d97db8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:38.631777 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e7467-af1a-4866-bf7c-6a5350d97db8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:38.694192 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1e7467-af1a-4866-bf7c-6a5350d97db8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:38.695694 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1e7467-af1a-4866-bf7c-6a5350d97db8 service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:38.705154 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1293/2558] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:38:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:38:42.934075 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef53130-a758-4fed-9e5e-dd1d634b6a34 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:42.935665 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-eef53130-a758-4fed-9e5e-dd1d634b6a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:38:42.948722 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef53130-a758-4fed-9e5e-dd1d634b6a34 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:42.953704 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b46a0e-e471-4215-92ba-7e0826372be8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:42.954359 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b46a0e-e471-4215-92ba-7e0826372be8 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:42.954645 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b46a0e-e471-4215-92ba-7e0826372be8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:42.954935 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b46a0e-e471-4215-92ba-7e0826372be8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:42.965226 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b46a0e-e471-4215-92ba-7e0826372be8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:42.966695 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b46a0e-e471-4215-92ba-7e0826372be8 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:42.976231 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1266/2559] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:38:42 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:38:47.902874 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e7467-af1a-4866-bf7c-6a5350d97db8 service cinder] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:47.973146 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e7467-af1a-4866-bf7c-6a5350d97db8 service cinder] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:47.978308 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e0a2ae-51c1-4f29-99f3-847114b5adcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:47.979164 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e0a2ae-51c1-4f29-99f3-847114b5adcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:47.979481 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e0a2ae-51c1-4f29-99f3-847114b5adcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:47.979768 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e0a2ae-51c1-4f29-99f3-847114b5adcd admin admin] PATH_INFO: `/v3/users/6af01501c6014c529d6b4eaaa95cf539` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:47.981002 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e0a2ae-51c1-4f29-99f3-847114b5adcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=6af01501c6014c529d6b4eaaa95cf539)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:47.982954 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e0a2ae-51c1-4f29-99f3-847114b5adcd admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:47.989368 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:38:48.034279 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-53e0a2ae-51c1-4f29-99f3-847114b5adcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6af01501c6014c529d6b4eaaa95cf539'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:48.034933 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-53e0a2ae-51c1-4f29-99f3-847114b5adcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6af01501c6014c529d6b4eaaa95cf539'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:48.045088 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-53e0a2ae-51c1-4f29-99f3-847114b5adcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6af01501c6014c529d6b4eaaa95cf539'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:48.045883 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-53e0a2ae-51c1-4f29-99f3-847114b5adcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6af01501c6014c529d6b4eaaa95cf539'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:48.061429 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-53e0a2ae-51c1-4f29-99f3-847114b5adcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6af01501c6014c529d6b4eaaa95cf539'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:48.073734 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1294/2560] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:38:47 2022] DELETE /identity/v3/users/6af01501c6014c529d6b4eaaa95cf539 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:38:48.078561 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f0439f-cb97-486a-bb41-db3e1c2554dd None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:48.079031 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f0439f-cb97-486a-bb41-db3e1c2554dd None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:48.079159 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f0439f-cb97-486a-bb41-db3e1c2554dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:48.097363 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-f3f0439f-cb97-486a-bb41-db3e1c2554dd None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:38:48.098633 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f3f0439f-cb97-486a-bb41-db3e1c2554dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:38:48.156348 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1267/2561] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:38:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:38:48.166633 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e0a2ae-51c1-4f29-99f3-847114b5adcd admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:48.168150 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-53e0a2ae-51c1-4f29-99f3-847114b5adcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:38:48.228728 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e0a2ae-51c1-4f29-99f3-847114b5adcd admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:48.232865 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbdbded-6307-430d-8fcc-e145a69b0003 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:48.233490 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbdbded-6307-430d-8fcc-e145a69b0003 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:48.233780 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbdbded-6307-430d-8fcc-e145a69b0003 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:48.234047 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbdbded-6307-430d-8fcc-e145a69b0003 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:48.244158 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbdbded-6307-430d-8fcc-e145a69b0003 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:48.245592 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbdbded-6307-430d-8fcc-e145a69b0003 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:48.255191 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1295/2562] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:38:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:38:48.533657 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f0439f-cb97-486a-bb41-db3e1c2554dd None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:48.535574 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f3f0439f-cb97-486a-bb41-db3e1c2554dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:38:48.548201 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f0439f-cb97-486a-bb41-db3e1c2554dd None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:48.553110 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f8d93-febc-4a96-8e62-97db4d713c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:48.554001 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f8d93-febc-4a96-8e62-97db4d713c17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:48.554281 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f8d93-febc-4a96-8e62-97db4d713c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:48.554554 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f8d93-febc-4a96-8e62-97db4d713c17 admin admin] PATH_INFO: `/v3/projects/cab79d26b70340bbb348b9e8e9ee3ff0` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:48.555807 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539f8d93-febc-4a96-8e62-97db4d713c17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cab79d26b70340bbb348b9e8e9ee3ff0)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:48.557775 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539f8d93-febc-4a96-8e62-97db4d713c17 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:48.564734 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:38:48.613827 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-539f8d93-febc-4a96-8e62-97db4d713c17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cab79d26b70340bbb348b9e8e9ee3ff0', 'request_id': 'req-539f8d93-febc-4a96-8e62-97db4d713c17'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:48.623854 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-539f8d93-febc-4a96-8e62-97db4d713c17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cab79d26b70340bbb348b9e8e9ee3ff0', 'request_id': 'req-539f8d93-febc-4a96-8e62-97db4d713c17'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:48.634185 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-539f8d93-febc-4a96-8e62-97db4d713c17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cab79d26b70340bbb348b9e8e9ee3ff0', 'request_id': 'req-539f8d93-febc-4a96-8e62-97db4d713c17'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:48.645559 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-539f8d93-febc-4a96-8e62-97db4d713c17 admin admin] The token cache is being invalidate because project cab79d26b70340bbb348b9e8e9ee3ff0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:38:48.645855 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-539f8d93-febc-4a96-8e62-97db4d713c17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:48.646437 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-539f8d93-febc-4a96-8e62-97db4d713c17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:48.648018 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1268/2563] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:38:48 2022] DELETE /identity/v3/projects/cab79d26b70340bbb348b9e8e9ee3ff0 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:38:48.652149 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbdbded-6307-430d-8fcc-e145a69b0003 service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:48.662444 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbdbded-6307-430d-8fcc-e145a69b0003 service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:48.724661 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ac60f3-8b2e-4289-b45e-02f1cdce4e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:48.725524 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac60f3-8b2e-4289-b45e-02f1cdce4e24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:48.725828 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac60f3-8b2e-4289-b45e-02f1cdce4e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:48.726096 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac60f3-8b2e-4289-b45e-02f1cdce4e24 admin admin] PATH_INFO: `/v3/users/3d5ebcbb659b4cde93569196ae912617` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:48.727526 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ac60f3-8b2e-4289-b45e-02f1cdce4e24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d5ebcbb659b4cde93569196ae912617)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:48.729908 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ac60f3-8b2e-4289-b45e-02f1cdce4e24 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:48.770801 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:38:48.786630 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-96ac60f3-8b2e-4289-b45e-02f1cdce4e24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d5ebcbb659b4cde93569196ae912617'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:48.787310 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-96ac60f3-8b2e-4289-b45e-02f1cdce4e24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d5ebcbb659b4cde93569196ae912617'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:48.797444 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-96ac60f3-8b2e-4289-b45e-02f1cdce4e24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d5ebcbb659b4cde93569196ae912617'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:48.798122 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-96ac60f3-8b2e-4289-b45e-02f1cdce4e24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d5ebcbb659b4cde93569196ae912617'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:48.810787 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-96ac60f3-8b2e-4289-b45e-02f1cdce4e24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d5ebcbb659b4cde93569196ae912617'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:48.823776 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1296/2564] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:38:48 2022] DELETE /identity/v3/users/3d5ebcbb659b4cde93569196ae912617 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:38:49.104363 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f8d93-febc-4a96-8e62-97db4d713c17 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:49.105905 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-539f8d93-febc-4a96-8e62-97db4d713c17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:38:49.118944 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f8d93-febc-4a96-8e62-97db4d713c17 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:49.176213 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb2ba3b-87bc-4391-afff-73c4ce2944ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:49.176995 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb2ba3b-87bc-4391-afff-73c4ce2944ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:49.177275 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb2ba3b-87bc-4391-afff-73c4ce2944ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:49.177548 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb2ba3b-87bc-4391-afff-73c4ce2944ba admin admin] PATH_INFO: `/v3/projects/636fae5018a14deeb915d8c3acd8efdc` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:49.178728 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb2ba3b-87bc-4391-afff-73c4ce2944ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=636fae5018a14deeb915d8c3acd8efdc)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:49.180690 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb2ba3b-87bc-4391-afff-73c4ce2944ba admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:49.230279 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4cb2ba3b-87bc-4391-afff-73c4ce2944ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '636fae5018a14deeb915d8c3acd8efdc', 'request_id': 'req-4cb2ba3b-87bc-4391-afff-73c4ce2944ba'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:49.237970 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4cb2ba3b-87bc-4391-afff-73c4ce2944ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '636fae5018a14deeb915d8c3acd8efdc', 'request_id': 'req-4cb2ba3b-87bc-4391-afff-73c4ce2944ba'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:49.249086 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4cb2ba3b-87bc-4391-afff-73c4ce2944ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '636fae5018a14deeb915d8c3acd8efdc', 'request_id': 'req-4cb2ba3b-87bc-4391-afff-73c4ce2944ba'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:49.261290 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4cb2ba3b-87bc-4391-afff-73c4ce2944ba admin admin] The token cache is being invalidate because project 636fae5018a14deeb915d8c3acd8efdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:38:49.261606 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4cb2ba3b-87bc-4391-afff-73c4ce2944ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:49.262466 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4cb2ba3b-87bc-4391-afff-73c4ce2944ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:49.264090 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1269/2565] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:38:49 2022] DELETE /identity/v3/projects/636fae5018a14deeb915d8c3acd8efdc => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:38:49.270468 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a281e7-a754-46b8-861d-61fedd606800 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:49.271019 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a281e7-a754-46b8-861d-61fedd606800 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:49.271019 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a281e7-a754-46b8-861d-61fedd606800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:49.290460 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-28a281e7-a754-46b8-861d-61fedd606800 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:38:49.291873 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-28a281e7-a754-46b8-861d-61fedd606800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:38:49.361598 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1297/2566] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:38:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:38:49.372169 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c9d9a7-8bf2-4c22-9aa4-93b4fecf55e1 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:49.372455 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c9d9a7-8bf2-4c22-9aa4-93b4fecf55e1 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:49.372724 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c9d9a7-8bf2-4c22-9aa4-93b4fecf55e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:49.393366 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-77c9d9a7-8bf2-4c22-9aa4-93b4fecf55e1 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:38:49.394564 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-77c9d9a7-8bf2-4c22-9aa4-93b4fecf55e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:38:49.404079 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1270/2567] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:38:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:38:49.408468 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a281e7-a754-46b8-861d-61fedd606800 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:49.419412 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a281e7-a754-46b8-861d-61fedd606800 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:49.426157 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4cc562-2c1a-4a65-8bd8-31e7e661a06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:49.427190 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4cc562-2c1a-4a65-8bd8-31e7e661a06b admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:49.427465 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4cc562-2c1a-4a65-8bd8-31e7e661a06b admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:49.427842 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4cc562-2c1a-4a65-8bd8-31e7e661a06b admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:49.428799 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4cc562-2c1a-4a65-8bd8-31e7e661a06b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:38:49.429102 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4cc562-2c1a-4a65-8bd8-31e7e661a06b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:49.431659 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4cc562-2c1a-4a65-8bd8-31e7e661a06b admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:49.448684 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1298/2568] 10.222.0.60 () {58 vars in 1152 bytes} [Sat Jul 2 03:38:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:38:49.455052 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c9d9a7-8bf2-4c22-9aa4-93b4fecf55e1 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:49.466995 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c9d9a7-8bf2-4c22-9aa4-93b4fecf55e1 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:49.472107 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1daf4f-2f69-4263-8b0e-6a61affeeb95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:49.472742 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1daf4f-2f69-4263-8b0e-6a61affeeb95 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:49.473018 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1daf4f-2f69-4263-8b0e-6a61affeeb95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:49.473283 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1daf4f-2f69-4263-8b0e-6a61affeeb95 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:49.473975 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1daf4f-2f69-4263-8b0e-6a61affeeb95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:49.475871 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1daf4f-2f69-4263-8b0e-6a61affeeb95 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:49.489919 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:38:49.506363 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1271/2569] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:38:49 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:38:49.511054 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4cc562-2c1a-4a65-8bd8-31e7e661a06b admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:49.526706 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4cc562-2c1a-4a65-8bd8-31e7e661a06b admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:49.591790 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa56b511-e365-4397-b032-07aee1426346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:49.592691 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56b511-e365-4397-b032-07aee1426346 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:49.592974 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56b511-e365-4397-b032-07aee1426346 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:49.593257 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56b511-e365-4397-b032-07aee1426346 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:49.593989 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa56b511-e365-4397-b032-07aee1426346 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:49.597022 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa56b511-e365-4397-b032-07aee1426346 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:49.621290 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1299/2570] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:38:49 2022] POST /identity/v3/users => generated 292 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:38:49.626144 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1daf4f-2f69-4263-8b0e-6a61affeeb95 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:49.638733 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1daf4f-2f69-4263-8b0e-6a61affeeb95 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:49.645098 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abbdcf1-0e76-4fa5-a5c4-41189d665448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:49.645755 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abbdcf1-0e76-4fa5-a5c4-41189d665448 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:49.646035 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abbdcf1-0e76-4fa5-a5c4-41189d665448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:49.646273 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abbdcf1-0e76-4fa5-a5c4-41189d665448 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:49.647034 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abbdcf1-0e76-4fa5-a5c4-41189d665448 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:49.648679 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abbdcf1-0e76-4fa5-a5c4-41189d665448 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:49.660034 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1272/2571] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:38:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:38:49.664181 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa56b511-e365-4397-b032-07aee1426346 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:49.674777 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa56b511-e365-4397-b032-07aee1426346 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:49.680543 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db1cf1a-9bed-477b-b32d-3a1795abdd3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:49.681146 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db1cf1a-9bed-477b-b32d-3a1795abdd3b admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:49.681700 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db1cf1a-9bed-477b-b32d-3a1795abdd3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:49.682021 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db1cf1a-9bed-477b-b32d-3a1795abdd3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:49.682748 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db1cf1a-9bed-477b-b32d-3a1795abdd3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:49.684408 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db1cf1a-9bed-477b-b32d-3a1795abdd3b admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:49.694693 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1300/2572] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:38:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:38:49.699096 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abbdcf1-0e76-4fa5-a5c4-41189d665448 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:49.709856 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abbdcf1-0e76-4fa5-a5c4-41189d665448 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:49.715436 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6796cc5c-0712-44ff-a02f-362b0130cfca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:49.716319 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6796cc5c-0712-44ff-a02f-362b0130cfca admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:49.716597 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6796cc5c-0712-44ff-a02f-362b0130cfca admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:49.716874 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6796cc5c-0712-44ff-a02f-362b0130cfca admin admin] PATH_INFO: `/v3/projects/ec1510721560495c9c9dae5077c21901/users/7879b3997d044783904b228471eea5a2/roles/c43aada0326446c4ade0ab1262918fa4` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:49.731720 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6796cc5c-0712-44ff-a02f-362b0130cfca admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec1510721560495c9c9dae5077c21901, user_id=7879b3997d044783904b228471eea5a2, role_id=c43aada0326446c4ade0ab1262918fa4)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:49.734361 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6796cc5c-0712-44ff-a02f-362b0130cfca admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:49.749777 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1273/2573] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:38:49 2022] PUT /identity/v3/projects/ec1510721560495c9c9dae5077c21901/users/7879b3997d044783904b228471eea5a2/roles/c43aada0326446c4ade0ab1262918fa4 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 03:38:49.768668 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a80506-6f47-4d9d-a1c5-973c75b98212 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:49.769066 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a80506-6f47-4d9d-a1c5-973c75b98212 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:49.769396 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a80506-6f47-4d9d-a1c5-973c75b98212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:49.796473 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:38:49.800266 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-e5a80506-6f47-4d9d-a1c5-973c75b98212 None None] MFA Rules not processed for user `7879b3997d044783904b228471eea5a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:38:49.802178 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-e5a80506-6f47-4d9d-a1c5-973c75b98212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:38:49.870128 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1301/2574] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:38:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:38:49.882538 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6796cc5c-0712-44ff-a02f-362b0130cfca admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:49.884795 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-6796cc5c-0712-44ff-a02f-362b0130cfca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:38:49.955232 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6796cc5c-0712-44ff-a02f-362b0130cfca admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:49.959591 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e89c220-1265-4003-8aa5-6e531be57c05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:49.960237 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89c220-1265-4003-8aa5-6e531be57c05 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:49.960512 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89c220-1265-4003-8aa5-6e531be57c05 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:49.960783 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89c220-1265-4003-8aa5-6e531be57c05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:49.969692 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e89c220-1265-4003-8aa5-6e531be57c05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:49.971150 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e89c220-1265-4003-8aa5-6e531be57c05 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:49.980072 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1274/2575] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:38:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:38:49.999712 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a80506-6f47-4d9d-a1c5-973c75b98212 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:50.062936 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a80506-6f47-4d9d-a1c5-973c75b98212 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:50.068325 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fbe9e1-56e2-4346-82db-09f223e34169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:50.069230 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fbe9e1-56e2-4346-82db-09f223e34169 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:50.069510 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fbe9e1-56e2-4346-82db-09f223e34169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:50.069785 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fbe9e1-56e2-4346-82db-09f223e34169 admin admin] PATH_INFO: `/v3/users/7879b3997d044783904b228471eea5a2` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:50.071154 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fbe9e1-56e2-4346-82db-09f223e34169 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7879b3997d044783904b228471eea5a2)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:50.073182 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fbe9e1-56e2-4346-82db-09f223e34169 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:50.125588 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e9fbe9e1-56e2-4346-82db-09f223e34169 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7879b3997d044783904b228471eea5a2'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:50.126243 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e9fbe9e1-56e2-4346-82db-09f223e34169 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7879b3997d044783904b228471eea5a2'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:50.135189 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e9fbe9e1-56e2-4346-82db-09f223e34169 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7879b3997d044783904b228471eea5a2'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:50.135855 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e9fbe9e1-56e2-4346-82db-09f223e34169 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7879b3997d044783904b228471eea5a2'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:50.148273 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e9fbe9e1-56e2-4346-82db-09f223e34169 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7879b3997d044783904b228471eea5a2'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:50.162314 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1302/2576] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:38:49 2022] DELETE /identity/v3/users/7879b3997d044783904b228471eea5a2 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:38:50.166915 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c797ae-a133-47dd-9763-d36fee093590 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:50.167455 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c797ae-a133-47dd-9763-d36fee093590 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:50.167579 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c797ae-a133-47dd-9763-d36fee093590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:50.185768 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-41c797ae-a133-47dd-9763-d36fee093590 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:38:50.187011 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-41c797ae-a133-47dd-9763-d36fee093590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:38:50.250308 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1275/2577] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:38:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:38:50.260534 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fbe9e1-56e2-4346-82db-09f223e34169 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:50.262154 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-e9fbe9e1-56e2-4346-82db-09f223e34169 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:38:50.290192 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:38:50.324104 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fbe9e1-56e2-4346-82db-09f223e34169 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:50.328369 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def0e069-1243-47cf-b33b-77657b3132fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:50.329063 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def0e069-1243-47cf-b33b-77657b3132fe service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:50.329336 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def0e069-1243-47cf-b33b-77657b3132fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:50.329609 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def0e069-1243-47cf-b33b-77657b3132fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:50.339058 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def0e069-1243-47cf-b33b-77657b3132fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:50.340513 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def0e069-1243-47cf-b33b-77657b3132fe service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:50.350130 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1303/2578] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:38:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:38:50.650009 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c797ae-a133-47dd-9763-d36fee093590 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:50.651634 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-41c797ae-a133-47dd-9763-d36fee093590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:38:50.666443 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c797ae-a133-47dd-9763-d36fee093590 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:50.671479 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a412b22-d073-4ee1-89b0-d465c069867c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:50.672343 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a412b22-d073-4ee1-89b0-d465c069867c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:50.672619 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a412b22-d073-4ee1-89b0-d465c069867c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:50.672906 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a412b22-d073-4ee1-89b0-d465c069867c admin admin] PATH_INFO: `/v3/projects/ec1510721560495c9c9dae5077c21901` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:50.674103 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a412b22-d073-4ee1-89b0-d465c069867c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec1510721560495c9c9dae5077c21901)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:50.676097 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a412b22-d073-4ee1-89b0-d465c069867c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:50.724272 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6a412b22-d073-4ee1-89b0-d465c069867c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec1510721560495c9c9dae5077c21901', 'request_id': 'req-6a412b22-d073-4ee1-89b0-d465c069867c'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:50.729798 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6a412b22-d073-4ee1-89b0-d465c069867c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec1510721560495c9c9dae5077c21901', 'request_id': 'req-6a412b22-d073-4ee1-89b0-d465c069867c'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:50.731493 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:38:50.739780 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6a412b22-d073-4ee1-89b0-d465c069867c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec1510721560495c9c9dae5077c21901', 'request_id': 'req-6a412b22-d073-4ee1-89b0-d465c069867c'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:50.752068 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6a412b22-d073-4ee1-89b0-d465c069867c admin admin] The token cache is being invalidate because project ec1510721560495c9c9dae5077c21901 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:38:50.752297 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6a412b22-d073-4ee1-89b0-d465c069867c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:50.752918 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6a412b22-d073-4ee1-89b0-d465c069867c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:38:50.754538 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1276/2579] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:38:50 2022] DELETE /identity/v3/projects/ec1510721560495c9c9dae5077c21901 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:38:50.759743 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa41aa-909f-4a46-bdd8-fa65e10a6735 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:50.760053 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa41aa-909f-4a46-bdd8-fa65e10a6735 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:50.760421 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa41aa-909f-4a46-bdd8-fa65e10a6735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:50.779499 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-e4fa41aa-909f-4a46-bdd8-fa65e10a6735 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:38:50.780821 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-e4fa41aa-909f-4a46-bdd8-fa65e10a6735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:38:50.846444 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1304/2580] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:38:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:38:50.854429 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc9f593-bd78-460f-a55e-dfe983d45972 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:50.854724 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc9f593-bd78-460f-a55e-dfe983d45972 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:50.855002 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc9f593-bd78-460f-a55e-dfe983d45972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:50.874824 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-5fc9f593-bd78-460f-a55e-dfe983d45972 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:38:50.876084 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5fc9f593-bd78-460f-a55e-dfe983d45972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:38:50.885088 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1277/2581] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:38:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:38:50.890246 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fa41aa-909f-4a46-bdd8-fa65e10a6735 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:50.903031 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fa41aa-909f-4a46-bdd8-fa65e10a6735 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:50.908962 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20749d3-65ac-47d9-825e-19562e420d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:50.909983 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20749d3-65ac-47d9-825e-19562e420d79 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:50.910255 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20749d3-65ac-47d9-825e-19562e420d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:50.910518 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20749d3-65ac-47d9-825e-19562e420d79 admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:50.911278 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20749d3-65ac-47d9-825e-19562e420d79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:38:50.911556 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20749d3-65ac-47d9-825e-19562e420d79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:50.913196 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20749d3-65ac-47d9-825e-19562e420d79 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:50.926624 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1305/2582] 10.222.0.60 () {58 vars in 1152 bytes} [Sat Jul 2 03:38:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:38:50.931365 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc9f593-bd78-460f-a55e-dfe983d45972 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:50.941485 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc9f593-bd78-460f-a55e-dfe983d45972 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:50.948341 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cbc486-5f16-4a95-a853-5e029e207c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:50.949022 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cbc486-5f16-4a95-a853-5e029e207c2c admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:50.949317 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cbc486-5f16-4a95-a853-5e029e207c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:50.949570 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cbc486-5f16-4a95-a853-5e029e207c2c admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:50.950259 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cbc486-5f16-4a95-a853-5e029e207c2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:50.952252 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cbc486-5f16-4a95-a853-5e029e207c2c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:50.980395 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1278/2583] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:38:50 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:38:50.984602 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20749d3-65ac-47d9-825e-19562e420d79 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:50.994765 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20749d3-65ac-47d9-825e-19562e420d79 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:51.052762 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27598694-4197-44ab-9680-b11f1be990f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:51.053347 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27598694-4197-44ab-9680-b11f1be990f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:51.053619 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27598694-4197-44ab-9680-b11f1be990f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:51.053887 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27598694-4197-44ab-9680-b11f1be990f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:51.054576 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27598694-4197-44ab-9680-b11f1be990f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:51.056504 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27598694-4197-44ab-9680-b11f1be990f5 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:51.079364 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1306/2584] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:38:50 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:38:51.083525 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cbc486-5f16-4a95-a853-5e029e207c2c admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:51.093788 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cbc486-5f16-4a95-a853-5e029e207c2c admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:51.098675 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f9c23-e7ae-4d77-aca2-7a9cad9b24f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:51.099419 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f9c23-e7ae-4d77-aca2-7a9cad9b24f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:51.099634 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f9c23-e7ae-4d77-aca2-7a9cad9b24f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:51.099917 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f9c23-e7ae-4d77-aca2-7a9cad9b24f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:51.100643 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6f9c23-e7ae-4d77-aca2-7a9cad9b24f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:51.102287 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6f9c23-e7ae-4d77-aca2-7a9cad9b24f4 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:51.112634 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1279/2585] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:38:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:38:51.116792 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27598694-4197-44ab-9680-b11f1be990f5 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:51.127204 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27598694-4197-44ab-9680-b11f1be990f5 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:51.132384 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b15d2b4-8204-4e30-857a-b053e764ad08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:51.133042 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b15d2b4-8204-4e30-857a-b053e764ad08 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:51.133321 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b15d2b4-8204-4e30-857a-b053e764ad08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:51.133592 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b15d2b4-8204-4e30-857a-b053e764ad08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:51.134332 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b15d2b4-8204-4e30-857a-b053e764ad08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:51.135960 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b15d2b4-8204-4e30-857a-b053e764ad08 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:51.145869 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1307/2586] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:38:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:38:51.150012 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f9c23-e7ae-4d77-aca2-7a9cad9b24f4 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:51.160722 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f9c23-e7ae-4d77-aca2-7a9cad9b24f4 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:51.165800 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c64201-656c-4aa1-82da-740c33ebeaf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:51.166812 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c64201-656c-4aa1-82da-740c33ebeaf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:51.167085 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c64201-656c-4aa1-82da-740c33ebeaf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:51.167711 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c64201-656c-4aa1-82da-740c33ebeaf1 admin admin] PATH_INFO: `/v3/projects/14bc4fcb7d0f4eeeaa241a8e72c85427/users/3fb378f233464cc29cd934425e45487e/roles/c43aada0326446c4ade0ab1262918fa4` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:51.183401 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c64201-656c-4aa1-82da-740c33ebeaf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14bc4fcb7d0f4eeeaa241a8e72c85427, user_id=3fb378f233464cc29cd934425e45487e, role_id=c43aada0326446c4ade0ab1262918fa4)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:51.186099 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c64201-656c-4aa1-82da-740c33ebeaf1 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:51.205572 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1280/2587] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:38:51 2022] PUT /identity/v3/projects/14bc4fcb7d0f4eeeaa241a8e72c85427/users/3fb378f233464cc29cd934425e45487e/roles/c43aada0326446c4ade0ab1262918fa4 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:38:51.216080 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3992dd-ffec-4999-b1bb-60550239ad24 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:51.216391 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3992dd-ffec-4999-b1bb-60550239ad24 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:51.216691 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3992dd-ffec-4999-b1bb-60550239ad24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:51.248483 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-ba3992dd-ffec-4999-b1bb-60550239ad24 None None] MFA Rules not processed for user `3fb378f233464cc29cd934425e45487e`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:38:51.249696 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-ba3992dd-ffec-4999-b1bb-60550239ad24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:38:51.269324 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:38:51.327453 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1308/2588] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:38:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:38:51.341109 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c64201-656c-4aa1-82da-740c33ebeaf1 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:38:51.343275 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-35c64201-656c-4aa1-82da-740c33ebeaf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:38:51.403586 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c64201-656c-4aa1-82da-740c33ebeaf1 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:38:51.407617 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb4789-3971-47dc-9dd2-bb25276bcd0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:38:51.408254 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb4789-3971-47dc-9dd2-bb25276bcd0b service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:38:51.408535 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb4789-3971-47dc-9dd2-bb25276bcd0b service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:38:51.408809 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb4789-3971-47dc-9dd2-bb25276bcd0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:38:51.417874 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fb4789-3971-47dc-9dd2-bb25276bcd0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:38:51.419341 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fb4789-3971-47dc-9dd2-bb25276bcd0b service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:38:51.428475 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1281/2589] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:38:51 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:39:01.324404 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=18 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:39:01.424309 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:INSERT=3,keystone:DELETE=1,keystone:SELECT=57 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:39:05.048435 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3992dd-ffec-4999-b1bb-60550239ad24 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:05.116667 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3992dd-ffec-4999-b1bb-60550239ad24 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:05.121688 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6194e601-2117-4dca-a399-b25ac5e400c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:05.122746 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6194e601-2117-4dca-a399-b25ac5e400c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:05.123031 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6194e601-2117-4dca-a399-b25ac5e400c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:05.123339 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6194e601-2117-4dca-a399-b25ac5e400c0 admin admin] PATH_INFO: `/v3/users/3fb378f233464cc29cd934425e45487e` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:05.124738 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6194e601-2117-4dca-a399-b25ac5e400c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fb378f233464cc29cd934425e45487e)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:05.126687 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6194e601-2117-4dca-a399-b25ac5e400c0 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:05.187181 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6194e601-2117-4dca-a399-b25ac5e400c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fb378f233464cc29cd934425e45487e'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:05.187807 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6194e601-2117-4dca-a399-b25ac5e400c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fb378f233464cc29cd934425e45487e'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:05.196792 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6194e601-2117-4dca-a399-b25ac5e400c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fb378f233464cc29cd934425e45487e'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:05.197427 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6194e601-2117-4dca-a399-b25ac5e400c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fb378f233464cc29cd934425e45487e'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:05.212575 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6194e601-2117-4dca-a399-b25ac5e400c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fb378f233464cc29cd934425e45487e'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:05.228125 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1309/2590] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:39:05 2022] DELETE /identity/v3/users/3fb378f233464cc29cd934425e45487e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:39:05.233125 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695cfc1c-bba9-48ec-b743-202a3316d26d None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:05.233648 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695cfc1c-bba9-48ec-b743-202a3316d26d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:05.233759 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695cfc1c-bba9-48ec-b743-202a3316d26d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:05.253437 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-695cfc1c-bba9-48ec-b743-202a3316d26d None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:39:05.254660 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-695cfc1c-bba9-48ec-b743-202a3316d26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:39:05.316298 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1282/2591] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:39:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:39:05.326078 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6194e601-2117-4dca-a399-b25ac5e400c0 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:05.327549 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-6194e601-2117-4dca-a399-b25ac5e400c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:39:05.401169 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6194e601-2117-4dca-a399-b25ac5e400c0 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:05.409179 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41df9834-c41d-42ee-9559-4aa558670abb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:05.410306 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df9834-c41d-42ee-9559-4aa558670abb service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:05.410581 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df9834-c41d-42ee-9559-4aa558670abb service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:05.410855 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df9834-c41d-42ee-9559-4aa558670abb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:05.421281 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41df9834-c41d-42ee-9559-4aa558670abb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:05.422950 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41df9834-c41d-42ee-9559-4aa558670abb service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:05.434298 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1310/2592] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:39:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:39:05.751804 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695cfc1c-bba9-48ec-b743-202a3316d26d None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:05.753117 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-695cfc1c-bba9-48ec-b743-202a3316d26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:39:05.771756 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695cfc1c-bba9-48ec-b743-202a3316d26d None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:05.777544 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a70d67-6016-40e9-89b6-c3d65aa0141d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:05.778666 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a70d67-6016-40e9-89b6-c3d65aa0141d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:05.779103 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a70d67-6016-40e9-89b6-c3d65aa0141d admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:05.779500 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a70d67-6016-40e9-89b6-c3d65aa0141d admin admin] PATH_INFO: `/v3/projects/14bc4fcb7d0f4eeeaa241a8e72c85427` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:05.782206 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a70d67-6016-40e9-89b6-c3d65aa0141d admin admin] RBAC: Authorizing `identity:delete_project(project_id=14bc4fcb7d0f4eeeaa241a8e72c85427)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:05.784847 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a70d67-6016-40e9-89b6-c3d65aa0141d admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:05.839337 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-54a70d67-6016-40e9-89b6-c3d65aa0141d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14bc4fcb7d0f4eeeaa241a8e72c85427', 'request_id': 'req-54a70d67-6016-40e9-89b6-c3d65aa0141d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:05.847365 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-54a70d67-6016-40e9-89b6-c3d65aa0141d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14bc4fcb7d0f4eeeaa241a8e72c85427', 'request_id': 'req-54a70d67-6016-40e9-89b6-c3d65aa0141d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:05.859467 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-54a70d67-6016-40e9-89b6-c3d65aa0141d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14bc4fcb7d0f4eeeaa241a8e72c85427', 'request_id': 'req-54a70d67-6016-40e9-89b6-c3d65aa0141d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:05.879402 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-54a70d67-6016-40e9-89b6-c3d65aa0141d admin admin] The token cache is being invalidate because project 14bc4fcb7d0f4eeeaa241a8e72c85427 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:39:05.879738 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-54a70d67-6016-40e9-89b6-c3d65aa0141d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:05.885870 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-54a70d67-6016-40e9-89b6-c3d65aa0141d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:05.888158 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1283/2593] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:39:05 2022] DELETE /identity/v3/projects/14bc4fcb7d0f4eeeaa241a8e72c85427 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:39:05.892962 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e85ee-ee36-4643-8d6d-152147c558b2 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:05.893287 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e85ee-ee36-4643-8d6d-152147c558b2 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:05.893562 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e85ee-ee36-4643-8d6d-152147c558b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:05.911738 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-8f3e85ee-ee36-4643-8d6d-152147c558b2 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:39:05.912977 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-8f3e85ee-ee36-4643-8d6d-152147c558b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:39:05.932962 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:39:05.979481 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1311/2594] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:39:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:39:05.988084 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3266465b-84ff-46a4-b2ed-3ab41221b749 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:05.988391 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3266465b-84ff-46a4-b2ed-3ab41221b749 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:05.989132 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3266465b-84ff-46a4-b2ed-3ab41221b749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:06.006795 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-3266465b-84ff-46a4-b2ed-3ab41221b749 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:39:06.008030 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3266465b-84ff-46a4-b2ed-3ab41221b749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:39:06.016105 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1284/2595] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:39:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:39:06.020609 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3e85ee-ee36-4643-8d6d-152147c558b2 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:06.030966 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3e85ee-ee36-4643-8d6d-152147c558b2 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:06.041158 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497143dd-4fc4-46aa-859f-2d4c11118bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:06.041835 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497143dd-4fc4-46aa-859f-2d4c11118bef admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:06.042112 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497143dd-4fc4-46aa-859f-2d4c11118bef admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:06.042384 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497143dd-4fc4-46aa-859f-2d4c11118bef admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:06.043189 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497143dd-4fc4-46aa-859f-2d4c11118bef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:39:06.043442 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497143dd-4fc4-46aa-859f-2d4c11118bef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:06.045136 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497143dd-4fc4-46aa-859f-2d4c11118bef admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:06.058697 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1312/2596] 10.222.0.60 () {58 vars in 1152 bytes} [Sat Jul 2 03:39:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:39:06.063072 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3266465b-84ff-46a4-b2ed-3ab41221b749 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:06.072606 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3266465b-84ff-46a4-b2ed-3ab41221b749 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:06.077627 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45292b64-2968-459a-a293-3fb8f56e4d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:06.078321 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45292b64-2968-459a-a293-3fb8f56e4d04 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:06.078596 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45292b64-2968-459a-a293-3fb8f56e4d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:06.078856 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45292b64-2968-459a-a293-3fb8f56e4d04 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:06.079592 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45292b64-2968-459a-a293-3fb8f56e4d04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:06.081637 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45292b64-2968-459a-a293-3fb8f56e4d04 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:06.114425 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1285/2597] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:39:06 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:39:06.114613 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497143dd-4fc4-46aa-859f-2d4c11118bef admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:06.125356 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497143dd-4fc4-46aa-859f-2d4c11118bef admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:06.188143 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262dc5c2-0828-4cb3-b78b-d030506f75fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:06.188857 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262dc5c2-0828-4cb3-b78b-d030506f75fb admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:06.189138 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262dc5c2-0828-4cb3-b78b-d030506f75fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:06.189411 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262dc5c2-0828-4cb3-b78b-d030506f75fb admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:06.190097 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262dc5c2-0828-4cb3-b78b-d030506f75fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:06.192345 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262dc5c2-0828-4cb3-b78b-d030506f75fb admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:06.217175 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1313/2598] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:39:06 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:39:06.218518 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45292b64-2968-459a-a293-3fb8f56e4d04 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:06.230400 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45292b64-2968-459a-a293-3fb8f56e4d04 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:06.236241 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c48bb9-9323-4753-8b67-6ff5cb002208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:06.236938 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c48bb9-9323-4753-8b67-6ff5cb002208 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:06.237215 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c48bb9-9323-4753-8b67-6ff5cb002208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:06.237483 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c48bb9-9323-4753-8b67-6ff5cb002208 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:06.238215 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c48bb9-9323-4753-8b67-6ff5cb002208 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:06.239894 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c48bb9-9323-4753-8b67-6ff5cb002208 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:06.251499 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1286/2599] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:39:06.255732 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262dc5c2-0828-4cb3-b78b-d030506f75fb admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:06.266210 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262dc5c2-0828-4cb3-b78b-d030506f75fb admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:06.270937 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ac72e-ce07-4702-aecf-e06b1adcc598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:06.271674 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ac72e-ce07-4702-aecf-e06b1adcc598 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:06.271949 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ac72e-ce07-4702-aecf-e06b1adcc598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:06.272225 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ac72e-ce07-4702-aecf-e06b1adcc598 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:06.272976 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011ac72e-ce07-4702-aecf-e06b1adcc598 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:06.274668 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011ac72e-ce07-4702-aecf-e06b1adcc598 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:06.285302 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1314/2600] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 03:39:06.290240 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c48bb9-9323-4753-8b67-6ff5cb002208 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:06.306203 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c48bb9-9323-4753-8b67-6ff5cb002208 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:06.313180 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a7b8f-999a-4ea0-b2b3-7550ad1a3819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:06.314057 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a7b8f-999a-4ea0-b2b3-7550ad1a3819 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:06.314330 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a7b8f-999a-4ea0-b2b3-7550ad1a3819 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:06.314598 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a7b8f-999a-4ea0-b2b3-7550ad1a3819 admin admin] PATH_INFO: `/v3/projects/ff4049db62594f6b8e06244bc8cd2904/users/b91517acac474118a85b8d202850ba4d/roles/c43aada0326446c4ade0ab1262918fa4` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:06.330483 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3a7b8f-999a-4ea0-b2b3-7550ad1a3819 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff4049db62594f6b8e06244bc8cd2904, user_id=b91517acac474118a85b8d202850ba4d, role_id=c43aada0326446c4ade0ab1262918fa4)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:06.333230 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3a7b8f-999a-4ea0-b2b3-7550ad1a3819 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:06.348568 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1287/2601] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:39:06 2022] PUT /identity/v3/projects/ff4049db62594f6b8e06244bc8cd2904/users/b91517acac474118a85b8d202850ba4d/roles/c43aada0326446c4ade0ab1262918fa4 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:39:06.359327 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64308b-23bb-40c8-8d89-1fd383a55356 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:06.359557 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64308b-23bb-40c8-8d89-1fd383a55356 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:06.359835 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64308b-23bb-40c8-8d89-1fd383a55356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:06.388750 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-7d64308b-23bb-40c8-8d89-1fd383a55356 None None] MFA Rules not processed for user `b91517acac474118a85b8d202850ba4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:39:06.389985 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-7d64308b-23bb-40c8-8d89-1fd383a55356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:39:06.461384 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1315/2602] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:39:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:39:06.467729 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a7b8f-999a-4ea0-b2b3-7550ad1a3819 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:06.490338 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:39:06.533127 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a7b8f-999a-4ea0-b2b3-7550ad1a3819 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:06.538421 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158bfef-0c65-4949-ab3e-d91f79ec37bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:06.539049 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158bfef-0c65-4949-ab3e-d91f79ec37bd admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:06.539385 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158bfef-0c65-4949-ab3e-d91f79ec37bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:06.539664 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158bfef-0c65-4949-ab3e-d91f79ec37bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:06.540353 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f158bfef-0c65-4949-ab3e-d91f79ec37bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:06.542283 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f158bfef-0c65-4949-ab3e-d91f79ec37bd admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:06.572533 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1288/2603] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:39:06 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:39:06.576956 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d64308b-23bb-40c8-8d89-1fd383a55356 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:06.588880 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d64308b-23bb-40c8-8d89-1fd383a55356 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:06.607946 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:39:06.663281 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef344c-0b9d-4383-a240-9e531e8e9727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:06.663972 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef344c-0b9d-4383-a240-9e531e8e9727 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:06.664282 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef344c-0b9d-4383-a240-9e531e8e9727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:06.664583 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef344c-0b9d-4383-a240-9e531e8e9727 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:06.665617 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fef344c-0b9d-4383-a240-9e531e8e9727 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:06.668397 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fef344c-0b9d-4383-a240-9e531e8e9727 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:06.690785 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1316/2604] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:39:06 2022] POST /identity/v3/users => generated 293 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 03:39:06.694976 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158bfef-0c65-4949-ab3e-d91f79ec37bd admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:06.705740 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158bfef-0c65-4949-ab3e-d91f79ec37bd admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:06.710717 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd31aa3a-5b7f-4219-9c6a-aa7c9aec33e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:06.711388 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd31aa3a-5b7f-4219-9c6a-aa7c9aec33e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:06.711664 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd31aa3a-5b7f-4219-9c6a-aa7c9aec33e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:06.711934 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd31aa3a-5b7f-4219-9c6a-aa7c9aec33e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:06.712651 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd31aa3a-5b7f-4219-9c6a-aa7c9aec33e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:06.714206 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd31aa3a-5b7f-4219-9c6a-aa7c9aec33e2 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:06.724816 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1289/2605] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:39:06.728813 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef344c-0b9d-4383-a240-9e531e8e9727 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:06.739841 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef344c-0b9d-4383-a240-9e531e8e9727 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:06.745427 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce129c9-4b0e-4332-a6d9-10d9ef7ba454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:06.746076 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce129c9-4b0e-4332-a6d9-10d9ef7ba454 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:06.746358 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce129c9-4b0e-4332-a6d9-10d9ef7ba454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:06.746631 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce129c9-4b0e-4332-a6d9-10d9ef7ba454 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:06.747391 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce129c9-4b0e-4332-a6d9-10d9ef7ba454 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:06.749079 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce129c9-4b0e-4332-a6d9-10d9ef7ba454 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:06.760482 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1317/2606] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:39:06.764954 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd31aa3a-5b7f-4219-9c6a-aa7c9aec33e2 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:06.776084 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd31aa3a-5b7f-4219-9c6a-aa7c9aec33e2 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:06.782108 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69692351-ed9d-42a1-90d5-a2333588f5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:06.783000 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69692351-ed9d-42a1-90d5-a2333588f5d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:06.783311 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69692351-ed9d-42a1-90d5-a2333588f5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:06.783600 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69692351-ed9d-42a1-90d5-a2333588f5d0 admin admin] PATH_INFO: `/v3/projects/1732fc3b14fe469499cfe093d50a232e/users/3d6b5fe65ab24485be5b86f78edde63a/roles/c43aada0326446c4ade0ab1262918fa4` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:06.799573 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69692351-ed9d-42a1-90d5-a2333588f5d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1732fc3b14fe469499cfe093d50a232e, user_id=3d6b5fe65ab24485be5b86f78edde63a, role_id=c43aada0326446c4ade0ab1262918fa4)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:06.802228 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69692351-ed9d-42a1-90d5-a2333588f5d0 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:06.820132 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1290/2607] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:39:06 2022] PUT /identity/v3/projects/1732fc3b14fe469499cfe093d50a232e/users/3d6b5fe65ab24485be5b86f78edde63a/roles/c43aada0326446c4ade0ab1262918fa4 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:39:06.831646 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188bde4-54cd-40c1-902a-2e0760a8ea10 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:06.832022 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188bde4-54cd-40c1-902a-2e0760a8ea10 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:06.832402 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188bde4-54cd-40c1-902a-2e0760a8ea10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:06.867314 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-4188bde4-54cd-40c1-902a-2e0760a8ea10 None None] MFA Rules not processed for user `3d6b5fe65ab24485be5b86f78edde63a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:39:06.868525 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-4188bde4-54cd-40c1-902a-2e0760a8ea10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:39:06.941981 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1318/2608] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:39:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:39:06.948030 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69692351-ed9d-42a1-90d5-a2333588f5d0 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:07.020790 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69692351-ed9d-42a1-90d5-a2333588f5d0 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:07.026175 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5934c46c-817c-421c-baca-2c3e328afe73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:07.026832 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934c46c-817c-421c-baca-2c3e328afe73 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:07.027110 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934c46c-817c-421c-baca-2c3e328afe73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:07.027413 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934c46c-817c-421c-baca-2c3e328afe73 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:07.028105 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5934c46c-817c-421c-baca-2c3e328afe73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:07.030092 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5934c46c-817c-421c-baca-2c3e328afe73 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:07.058500 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1291/2609] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:39:06 2022] POST /identity/v3/projects => generated 383 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:39:07.062804 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4188bde4-54cd-40c1-902a-2e0760a8ea10 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:07.074032 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4188bde4-54cd-40c1-902a-2e0760a8ea10 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:07.161299 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22443fd5-1186-4cb1-b5fa-382cc2672eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:07.161967 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22443fd5-1186-4cb1-b5fa-382cc2672eeb admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:07.162244 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22443fd5-1186-4cb1-b5fa-382cc2672eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:07.162512 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22443fd5-1186-4cb1-b5fa-382cc2672eeb admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:07.163237 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22443fd5-1186-4cb1-b5fa-382cc2672eeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:07.165146 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22443fd5-1186-4cb1-b5fa-382cc2672eeb admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:07.189553 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1319/2610] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:39:07 2022] POST /identity/v3/users => generated 298 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:39:07.193902 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5934c46c-817c-421c-baca-2c3e328afe73 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:07.204395 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5934c46c-817c-421c-baca-2c3e328afe73 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:07.211191 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06b48d7-07fc-4578-8f21-3745a2288e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:07.212192 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b48d7-07fc-4578-8f21-3745a2288e5c admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:07.212605 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b48d7-07fc-4578-8f21-3745a2288e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:07.212987 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b48d7-07fc-4578-8f21-3745a2288e5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:07.214124 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06b48d7-07fc-4578-8f21-3745a2288e5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:07.216664 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06b48d7-07fc-4578-8f21-3745a2288e5c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:07.227783 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1292/2611] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:39:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:39:07.232801 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22443fd5-1186-4cb1-b5fa-382cc2672eeb admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:07.244003 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22443fd5-1186-4cb1-b5fa-382cc2672eeb admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:07.249705 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905071c6-c7dc-4ace-ab7e-19d5bd19fda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:07.250603 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905071c6-c7dc-4ace-ab7e-19d5bd19fda3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:07.250888 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905071c6-c7dc-4ace-ab7e-19d5bd19fda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:07.251200 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905071c6-c7dc-4ace-ab7e-19d5bd19fda3 admin admin] PATH_INFO: `/v3/projects/97c7369983c94c96afa89fea33b1dfb2/users/67b1d3f250db4dcf830011972c770467/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:07.271405 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:39:07.275761 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905071c6-c7dc-4ace-ab7e-19d5bd19fda3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97c7369983c94c96afa89fea33b1dfb2, user_id=67b1d3f250db4dcf830011972c770467, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:07.278990 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905071c6-c7dc-4ace-ab7e-19d5bd19fda3 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:07.302692 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1320/2612] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:39:07 2022] PUT /identity/v3/projects/97c7369983c94c96afa89fea33b1dfb2/users/67b1d3f250db4dcf830011972c770467/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:39:07.307262 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06b48d7-07fc-4578-8f21-3745a2288e5c admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:07.318034 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06b48d7-07fc-4578-8f21-3745a2288e5c admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:07.361567 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:39:07.378922 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998d83c1-5f70-4ab7-8821-c5904805a6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:07.379659 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d83c1-5f70-4ab7-8821-c5904805a6be admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:07.379946 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d83c1-5f70-4ab7-8821-c5904805a6be admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:07.380223 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d83c1-5f70-4ab7-8821-c5904805a6be admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:07.380971 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998d83c1-5f70-4ab7-8821-c5904805a6be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:07.382741 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998d83c1-5f70-4ab7-8821-c5904805a6be admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:07.393891 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1293/2613] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:39:07 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:39:07.398224 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905071c6-c7dc-4ace-ab7e-19d5bd19fda3 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:07.410649 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905071c6-c7dc-4ace-ab7e-19d5bd19fda3 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:07.415755 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab14005-46da-48fb-a6db-c852a84060a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:07.416817 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab14005-46da-48fb-a6db-c852a84060a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:07.417096 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab14005-46da-48fb-a6db-c852a84060a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:07.417369 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab14005-46da-48fb-a6db-c852a84060a6 admin admin] PATH_INFO: `/v3/projects/97c7369983c94c96afa89fea33b1dfb2/users/67b1d3f250db4dcf830011972c770467/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:07.419663 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab14005-46da-48fb-a6db-c852a84060a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97c7369983c94c96afa89fea33b1dfb2, user_id=67b1d3f250db4dcf830011972c770467, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:07.422091 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab14005-46da-48fb-a6db-c852a84060a6 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:07.433504 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1321/2614] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:39:07 2022] PUT /identity/v3/projects/97c7369983c94c96afa89fea33b1dfb2/users/67b1d3f250db4dcf830011972c770467/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 03:39:07.500623 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1450ab-deb7-4197-ae1a-0d5d0f3dcc5b None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:07.501147 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1450ab-deb7-4197-ae1a-0d5d0f3dcc5b None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:07.501553 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1450ab-deb7-4197-ae1a-0d5d0f3dcc5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:07.540734 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-6e1450ab-deb7-4197-ae1a-0d5d0f3dcc5b None None] MFA Rules not processed for user `67b1d3f250db4dcf830011972c770467`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:39:07.542486 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-6e1450ab-deb7-4197-ae1a-0d5d0f3dcc5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:39:07.614895 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1294/2615] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:39:07 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:39:07.627802 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab14005-46da-48fb-a6db-c852a84060a6 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:07.629615 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-8ab14005-46da-48fb-a6db-c852a84060a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:39:07.689730 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab14005-46da-48fb-a6db-c852a84060a6 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:07.694336 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c786b233-c739-40b2-91f7-8689fdf54a7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:07.695078 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786b233-c739-40b2-91f7-8689fdf54a7d service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:07.695374 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786b233-c739-40b2-91f7-8689fdf54a7d service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:07.695631 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786b233-c739-40b2-91f7-8689fdf54a7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:07.753425 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c786b233-c739-40b2-91f7-8689fdf54a7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:07.754792 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c786b233-c739-40b2-91f7-8689fdf54a7d service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:07.764248 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1322/2616] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:39:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 03:39:08.552749 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1450ab-deb7-4197-ae1a-0d5d0f3dcc5b None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:08.554499 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-6e1450ab-deb7-4197-ae1a-0d5d0f3dcc5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:39:08.617337 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1450ab-deb7-4197-ae1a-0d5d0f3dcc5b None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:08.622208 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2122bef9-129d-4dc8-95ca-90ec5883692e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:08.623257 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122bef9-129d-4dc8-95ca-90ec5883692e service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:08.623538 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122bef9-129d-4dc8-95ca-90ec5883692e service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:08.623867 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122bef9-129d-4dc8-95ca-90ec5883692e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:08.626339 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2122bef9-129d-4dc8-95ca-90ec5883692e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:39:08.703846 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2122bef9-129d-4dc8-95ca-90ec5883692e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:08.706266 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2122bef9-129d-4dc8-95ca-90ec5883692e service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:08.720043 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1295/2617] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:39:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:39:09.256946 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c786b233-c739-40b2-91f7-8689fdf54a7d service cinder] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:09.265888 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c786b233-c739-40b2-91f7-8689fdf54a7d service cinder] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:09.269627 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c1eec1-c965-45ba-9cd4-a99163dbdebe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:09.270341 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c1eec1-c965-45ba-9cd4-a99163dbdebe service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:09.270680 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c1eec1-c965-45ba-9cd4-a99163dbdebe service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:09.271013 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c1eec1-c965-45ba-9cd4-a99163dbdebe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:09.336414 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c1eec1-c965-45ba-9cd4-a99163dbdebe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:09.337765 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c1eec1-c965-45ba-9cd4-a99163dbdebe service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:09.347814 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1323/2618] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:39:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:39:09.883052 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2122bef9-129d-4dc8-95ca-90ec5883692e service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:09.895052 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2122bef9-129d-4dc8-95ca-90ec5883692e service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:09.900334 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6143a73f-4041-43f2-8a71-b415be08841c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:09.901380 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6143a73f-4041-43f2-8a71-b415be08841c service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:09.901912 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6143a73f-4041-43f2-8a71-b415be08841c service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:09.902349 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6143a73f-4041-43f2-8a71-b415be08841c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:09.915061 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6143a73f-4041-43f2-8a71-b415be08841c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:09.917388 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6143a73f-4041-43f2-8a71-b415be08841c service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:09.932927 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1296/2619] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:39:09 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:39:11.981667 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c1eec1-c965-45ba-9cd4-a99163dbdebe service cinder] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:11.983542 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-72c1eec1-c965-45ba-9cd4-a99163dbdebe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:39:12.007585 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c1eec1-c965-45ba-9cd4-a99163dbdebe service cinder] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:12.013170 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9646e90-9645-4001-9768-ac066facfe52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:12.014308 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9646e90-9645-4001-9768-ac066facfe52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:12.014664 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9646e90-9645-4001-9768-ac066facfe52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:12.014976 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9646e90-9645-4001-9768-ac066facfe52 admin admin] PATH_INFO: `/v3/users/11ccfa53ebb7405d9325a22f0295bf61` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:12.017283 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9646e90-9645-4001-9768-ac066facfe52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11ccfa53ebb7405d9325a22f0295bf61)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:12.020286 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9646e90-9645-4001-9768-ac066facfe52 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:12.057098 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:39:12.077541 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d9646e90-9645-4001-9768-ac066facfe52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11ccfa53ebb7405d9325a22f0295bf61'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:12.078208 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d9646e90-9645-4001-9768-ac066facfe52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11ccfa53ebb7405d9325a22f0295bf61'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:12.086347 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d9646e90-9645-4001-9768-ac066facfe52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11ccfa53ebb7405d9325a22f0295bf61'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:12.087038 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d9646e90-9645-4001-9768-ac066facfe52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11ccfa53ebb7405d9325a22f0295bf61'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:12.099896 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d9646e90-9645-4001-9768-ac066facfe52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11ccfa53ebb7405d9325a22f0295bf61'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:12.112404 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1324/2620] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:39:11 2022] DELETE /identity/v3/users/11ccfa53ebb7405d9325a22f0295bf61 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:39:12.298286 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6143a73f-4041-43f2-8a71-b415be08841c service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:12.304732 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:39:12.313089 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6143a73f-4041-43f2-8a71-b415be08841c service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:12.371175 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbdaa0c-b013-4c54-a696-49eeeed37093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:12.371958 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbdaa0c-b013-4c54-a696-49eeeed37093 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:12.372239 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbdaa0c-b013-4c54-a696-49eeeed37093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:12.372505 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbdaa0c-b013-4c54-a696-49eeeed37093 admin admin] PATH_INFO: `/v3/projects/6cd770bfe49e4af5927749a0da0456c0` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:12.373796 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbdaa0c-b013-4c54-a696-49eeeed37093 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cd770bfe49e4af5927749a0da0456c0)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:12.375731 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbdaa0c-b013-4c54-a696-49eeeed37093 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:12.427741 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-8cbdaa0c-b013-4c54-a696-49eeeed37093 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cd770bfe49e4af5927749a0da0456c0', 'request_id': 'req-8cbdaa0c-b013-4c54-a696-49eeeed37093'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:12.433469 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-8cbdaa0c-b013-4c54-a696-49eeeed37093 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cd770bfe49e4af5927749a0da0456c0', 'request_id': 'req-8cbdaa0c-b013-4c54-a696-49eeeed37093'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:12.440912 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-8cbdaa0c-b013-4c54-a696-49eeeed37093 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cd770bfe49e4af5927749a0da0456c0', 'request_id': 'req-8cbdaa0c-b013-4c54-a696-49eeeed37093'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:12.452543 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-8cbdaa0c-b013-4c54-a696-49eeeed37093 admin admin] The token cache is being invalidate because project 6cd770bfe49e4af5927749a0da0456c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:39:12.452808 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-8cbdaa0c-b013-4c54-a696-49eeeed37093 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:12.453445 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-8cbdaa0c-b013-4c54-a696-49eeeed37093 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:12.455264 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1297/2621] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:39:12 2022] DELETE /identity/v3/projects/6cd770bfe49e4af5927749a0da0456c0 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:39:12.461131 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515485d-6486-41a7-97cc-ff00f1beda91 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:12.461419 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515485d-6486-41a7-97cc-ff00f1beda91 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:12.461704 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515485d-6486-41a7-97cc-ff00f1beda91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:12.480785 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-0515485d-6486-41a7-97cc-ff00f1beda91 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:39:12.482018 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-0515485d-6486-41a7-97cc-ff00f1beda91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:39:12.544317 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1325/2622] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:39:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:39:12.551967 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20987fc-f168-411e-b56a-3bf402562b09 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:12.552175 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20987fc-f168-411e-b56a-3bf402562b09 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:12.552512 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20987fc-f168-411e-b56a-3bf402562b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:12.571228 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-e20987fc-f168-411e-b56a-3bf402562b09 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:39:12.572448 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e20987fc-f168-411e-b56a-3bf402562b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:39:12.580794 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1298/2623] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:39:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:39:12.585046 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0515485d-6486-41a7-97cc-ff00f1beda91 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:12.594714 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0515485d-6486-41a7-97cc-ff00f1beda91 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:12.599426 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b1c63-966c-44b6-a690-74b4d7ef1b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:12.600072 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b1c63-966c-44b6-a690-74b4d7ef1b6b admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:12.600349 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b1c63-966c-44b6-a690-74b4d7ef1b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:12.600615 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b1c63-966c-44b6-a690-74b4d7ef1b6b admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:12.601333 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5b1c63-966c-44b6-a690-74b4d7ef1b6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:39:12.601634 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5b1c63-966c-44b6-a690-74b4d7ef1b6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:12.603249 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5b1c63-966c-44b6-a690-74b4d7ef1b6b admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:12.619154 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1326/2624] 10.222.0.60 () {58 vars in 1152 bytes} [Sat Jul 2 03:39:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:39:12.623225 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20987fc-f168-411e-b56a-3bf402562b09 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:12.633317 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20987fc-f168-411e-b56a-3bf402562b09 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:12.638998 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcec1a5-99bc-4095-8969-7eb5a69404a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:12.639701 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcec1a5-99bc-4095-8969-7eb5a69404a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:12.639991 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcec1a5-99bc-4095-8969-7eb5a69404a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:12.640268 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcec1a5-99bc-4095-8969-7eb5a69404a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:12.640989 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcec1a5-99bc-4095-8969-7eb5a69404a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:12.642946 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcec1a5-99bc-4095-8969-7eb5a69404a5 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:12.669855 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1299/2625] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:39:12 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:39:12.673803 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b1c63-966c-44b6-a690-74b4d7ef1b6b admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:12.683975 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b1c63-966c-44b6-a690-74b4d7ef1b6b admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:12.753015 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d5c37b-6354-4283-bf55-926fe97662fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:12.753771 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5c37b-6354-4283-bf55-926fe97662fb admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:12.754047 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5c37b-6354-4283-bf55-926fe97662fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:12.754319 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5c37b-6354-4283-bf55-926fe97662fb admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:12.755040 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d5c37b-6354-4283-bf55-926fe97662fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:12.757071 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d5c37b-6354-4283-bf55-926fe97662fb admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:12.778510 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1327/2626] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:39:12 2022] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:39:12.783540 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcec1a5-99bc-4095-8969-7eb5a69404a5 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:12.794636 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcec1a5-99bc-4095-8969-7eb5a69404a5 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:12.799885 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d044deaf-8484-4963-831e-e8b4f381c86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:12.800578 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044deaf-8484-4963-831e-e8b4f381c86c admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:12.800862 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044deaf-8484-4963-831e-e8b4f381c86c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:12.801136 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044deaf-8484-4963-831e-e8b4f381c86c admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:12.801872 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d044deaf-8484-4963-831e-e8b4f381c86c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:12.803530 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d044deaf-8484-4963-831e-e8b4f381c86c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:12.816383 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1300/2627] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:39:12.820550 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d5c37b-6354-4283-bf55-926fe97662fb admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:12.832944 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d5c37b-6354-4283-bf55-926fe97662fb admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:12.839804 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372a16d6-3541-464b-bd06-b0b0e407bc60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:12.840482 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a16d6-3541-464b-bd06-b0b0e407bc60 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:12.840757 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a16d6-3541-464b-bd06-b0b0e407bc60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:12.841023 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a16d6-3541-464b-bd06-b0b0e407bc60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:12.841819 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372a16d6-3541-464b-bd06-b0b0e407bc60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:12.843505 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372a16d6-3541-464b-bd06-b0b0e407bc60 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:12.854975 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1328/2628] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 03:39:12.861202 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d044deaf-8484-4963-831e-e8b4f381c86c admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:12.873231 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d044deaf-8484-4963-831e-e8b4f381c86c admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:12.878963 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f0cc7e-2e53-4424-99f9-f8bbf930867c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:12.879974 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0cc7e-2e53-4424-99f9-f8bbf930867c admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:12.880239 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0cc7e-2e53-4424-99f9-f8bbf930867c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:12.880512 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0cc7e-2e53-4424-99f9-f8bbf930867c admin admin] PATH_INFO: `/v3/projects/c895dc166211485793e6e4d62f50efef/users/412131f6cdfa47f4836c2205aa06ee75/roles/c43aada0326446c4ade0ab1262918fa4` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:12.896696 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f0cc7e-2e53-4424-99f9-f8bbf930867c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c895dc166211485793e6e4d62f50efef, user_id=412131f6cdfa47f4836c2205aa06ee75, role_id=c43aada0326446c4ade0ab1262918fa4)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:12.899436 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f0cc7e-2e53-4424-99f9-f8bbf930867c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:12.915685 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1301/2629] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:39:12 2022] PUT /identity/v3/projects/c895dc166211485793e6e4d62f50efef/users/412131f6cdfa47f4836c2205aa06ee75/roles/c43aada0326446c4ade0ab1262918fa4 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:39:12.926751 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e5f52-c856-47a7-b99a-76df57811b20 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:12.927088 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e5f52-c856-47a7-b99a-76df57811b20 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:12.927401 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e5f52-c856-47a7-b99a-76df57811b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:12.946909 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:39:12.958265 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-305e5f52-c856-47a7-b99a-76df57811b20 None None] MFA Rules not processed for user `412131f6cdfa47f4836c2205aa06ee75`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:39:12.959871 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-305e5f52-c856-47a7-b99a-76df57811b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:39:13.025442 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1329/2630] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:39:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:39:13.030273 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f0cc7e-2e53-4424-99f9-f8bbf930867c admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:13.062829 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:39:13.100877 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f0cc7e-2e53-4424-99f9-f8bbf930867c admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:13.106812 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4280d3-c438-4132-a9c8-40ae83760415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:13.107534 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4280d3-c438-4132-a9c8-40ae83760415 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:13.107813 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4280d3-c438-4132-a9c8-40ae83760415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:13.108080 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4280d3-c438-4132-a9c8-40ae83760415 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:13.108782 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4280d3-c438-4132-a9c8-40ae83760415 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:13.110719 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4280d3-c438-4132-a9c8-40ae83760415 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:13.144989 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1302/2631] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:39:13 2022] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 03:39:13.150689 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e5f52-c856-47a7-b99a-76df57811b20 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:13.164116 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e5f52-c856-47a7-b99a-76df57811b20 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:13.224502 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf96b3c-7a4a-4f9e-ac2b-821e1e91363b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:13.225158 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf96b3c-7a4a-4f9e-ac2b-821e1e91363b admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:13.225441 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf96b3c-7a4a-4f9e-ac2b-821e1e91363b admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:13.225713 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf96b3c-7a4a-4f9e-ac2b-821e1e91363b admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:13.226398 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf96b3c-7a4a-4f9e-ac2b-821e1e91363b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:13.228353 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf96b3c-7a4a-4f9e-ac2b-821e1e91363b admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:13.249246 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1330/2632] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:39:13 2022] POST /identity/v3/users => generated 299 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:39:13.253645 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4280d3-c438-4132-a9c8-40ae83760415 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:13.265358 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4280d3-c438-4132-a9c8-40ae83760415 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:13.272309 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c107f9-f4b2-4196-9c66-706c10a3d093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:13.272954 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c107f9-f4b2-4196-9c66-706c10a3d093 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:13.273236 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c107f9-f4b2-4196-9c66-706c10a3d093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:13.273507 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c107f9-f4b2-4196-9c66-706c10a3d093 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:13.274291 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c107f9-f4b2-4196-9c66-706c10a3d093 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:13.276017 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c107f9-f4b2-4196-9c66-706c10a3d093 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:13.287474 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1303/2633] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:39:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:39:13.292059 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf96b3c-7a4a-4f9e-ac2b-821e1e91363b admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:13.302322 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf96b3c-7a4a-4f9e-ac2b-821e1e91363b admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:13.307273 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269dcd8c-1fa3-4058-96a2-7e3d1f42a6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:13.308813 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269dcd8c-1fa3-4058-96a2-7e3d1f42a6e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:13.309111 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269dcd8c-1fa3-4058-96a2-7e3d1f42a6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:13.309383 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269dcd8c-1fa3-4058-96a2-7e3d1f42a6e2 admin admin] PATH_INFO: `/v3/projects/e3c0db4d488b463bac73151646ad80ca/users/a23f4796f57648e58517ebb005a0c480/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:13.324774 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269dcd8c-1fa3-4058-96a2-7e3d1f42a6e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3c0db4d488b463bac73151646ad80ca, user_id=a23f4796f57648e58517ebb005a0c480, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:13.327468 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269dcd8c-1fa3-4058-96a2-7e3d1f42a6e2 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:13.341241 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1331/2634] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:39:13 2022] PUT /identity/v3/projects/e3c0db4d488b463bac73151646ad80ca/users/a23f4796f57648e58517ebb005a0c480/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:39:13.345055 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c107f9-f4b2-4196-9c66-706c10a3d093 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:13.356321 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c107f9-f4b2-4196-9c66-706c10a3d093 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:13.413249 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df87fc65-e44e-4992-8d16-529a550a7ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:13.413869 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87fc65-e44e-4992-8d16-529a550a7ff2 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:13.414146 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87fc65-e44e-4992-8d16-529a550a7ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:13.414415 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87fc65-e44e-4992-8d16-529a550a7ff2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:13.415159 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df87fc65-e44e-4992-8d16-529a550a7ff2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:13.416799 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df87fc65-e44e-4992-8d16-529a550a7ff2 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:13.426943 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1304/2635] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:39:13 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:39:13.431244 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269dcd8c-1fa3-4058-96a2-7e3d1f42a6e2 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:13.441823 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269dcd8c-1fa3-4058-96a2-7e3d1f42a6e2 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:13.446730 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e3f25-2d72-4c43-bdd9-e946038e925e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:13.447663 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e3f25-2d72-4c43-bdd9-e946038e925e admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:13.447939 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e3f25-2d72-4c43-bdd9-e946038e925e admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:13.448208 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e3f25-2d72-4c43-bdd9-e946038e925e admin admin] PATH_INFO: `/v3/projects/e3c0db4d488b463bac73151646ad80ca/users/a23f4796f57648e58517ebb005a0c480/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:13.450175 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336e3f25-2d72-4c43-bdd9-e946038e925e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3c0db4d488b463bac73151646ad80ca, user_id=a23f4796f57648e58517ebb005a0c480, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:13.453031 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336e3f25-2d72-4c43-bdd9-e946038e925e admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:13.463497 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1332/2636] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:39:13 2022] PUT /identity/v3/projects/e3c0db4d488b463bac73151646ad80ca/users/a23f4796f57648e58517ebb005a0c480/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:39:13.474593 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b58083-fce1-4a7c-a643-0eff16d25fea None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:13.474886 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b58083-fce1-4a7c-a643-0eff16d25fea None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:13.475170 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b58083-fce1-4a7c-a643-0eff16d25fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:13.503162 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-96b58083-fce1-4a7c-a643-0eff16d25fea None None] MFA Rules not processed for user `a23f4796f57648e58517ebb005a0c480`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:39:13.504392 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-96b58083-fce1-4a7c-a643-0eff16d25fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:39:13.577867 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1305/2637] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:39:13 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:39:13.589463 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e3f25-2d72-4c43-bdd9-e946038e925e admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:13.591435 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-336e3f25-2d72-4c43-bdd9-e946038e925e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:39:13.652502 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e3f25-2d72-4c43-bdd9-e946038e925e admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:13.656815 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7accb49-8c99-452d-b8b3-236d278ece4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:13.657480 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7accb49-8c99-452d-b8b3-236d278ece4c service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:13.657757 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7accb49-8c99-452d-b8b3-236d278ece4c service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:13.658033 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7accb49-8c99-452d-b8b3-236d278ece4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:13.668134 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:39:13.672335 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7accb49-8c99-452d-b8b3-236d278ece4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:13.674397 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7accb49-8c99-452d-b8b3-236d278ece4c service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:13.684170 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1333/2638] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:39:13 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:39:13.747875 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b58083-fce1-4a7c-a643-0eff16d25fea None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:13.777028 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:39:13.824279 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b58083-fce1-4a7c-a643-0eff16d25fea None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:13.829147 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e4d88b-2d57-49a4-8d15-6e036a4c5332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:13.830025 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e4d88b-2d57-49a4-8d15-6e036a4c5332 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:13.830305 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e4d88b-2d57-49a4-8d15-6e036a4c5332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:13.830581 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e4d88b-2d57-49a4-8d15-6e036a4c5332 admin admin] PATH_INFO: `/v3/users/412131f6cdfa47f4836c2205aa06ee75` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:13.831911 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e4d88b-2d57-49a4-8d15-6e036a4c5332 admin admin] RBAC: Authorizing `identity:delete_user(user_id=412131f6cdfa47f4836c2205aa06ee75)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:13.833868 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e4d88b-2d57-49a4-8d15-6e036a4c5332 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:13.863472 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7accb49-8c99-452d-b8b3-236d278ece4c service cinder] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:13.864928 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-c7accb49-8c99-452d-b8b3-236d278ece4c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:39:13.879384 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7accb49-8c99-452d-b8b3-236d278ece4c service cinder] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:13.884420 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0f1d2b-9558-4670-ac4c-e84aa96bfb73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:13.885284 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f1d2b-9558-4670-ac4c-e84aa96bfb73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:13.885526 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-88e4d88b-2d57-49a4-8d15-6e036a4c5332 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '412131f6cdfa47f4836c2205aa06ee75'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:13.885667 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f1d2b-9558-4670-ac4c-e84aa96bfb73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:13.885930 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f1d2b-9558-4670-ac4c-e84aa96bfb73 admin admin] PATH_INFO: `/v3/users/b91517acac474118a85b8d202850ba4d` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:13.886237 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-88e4d88b-2d57-49a4-8d15-6e036a4c5332 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '412131f6cdfa47f4836c2205aa06ee75'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:13.886837 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-88e4d88b-2d57-49a4-8d15-6e036a4c5332 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '412131f6cdfa47f4836c2205aa06ee75'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:13.887067 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0f1d2b-9558-4670-ac4c-e84aa96bfb73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b91517acac474118a85b8d202850ba4d)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:13.889016 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0f1d2b-9558-4670-ac4c-e84aa96bfb73 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:13.899622 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-88e4d88b-2d57-49a4-8d15-6e036a4c5332 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '412131f6cdfa47f4836c2205aa06ee75'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:13.907195 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-88e4d88b-2d57-49a4-8d15-6e036a4c5332 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '412131f6cdfa47f4836c2205aa06ee75'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:13.921987 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1306/2639] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:39:13 2022] DELETE /identity/v3/users/412131f6cdfa47f4836c2205aa06ee75 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:39:13.926625 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46536477-e526-4dc4-ae3f-22c3ed4ed3ff None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:13.926904 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46536477-e526-4dc4-ae3f-22c3ed4ed3ff None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:13.927183 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46536477-e526-4dc4-ae3f-22c3ed4ed3ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:13.937944 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-4b0f1d2b-9558-4670-ac4c-e84aa96bfb73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b91517acac474118a85b8d202850ba4d'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:13.938598 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-4b0f1d2b-9558-4670-ac4c-e84aa96bfb73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b91517acac474118a85b8d202850ba4d'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:13.946112 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-46536477-e526-4dc4-ae3f-22c3ed4ed3ff None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:39:13.947375 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-46536477-e526-4dc4-ae3f-22c3ed4ed3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:39:13.947501 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-4b0f1d2b-9558-4670-ac4c-e84aa96bfb73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b91517acac474118a85b8d202850ba4d'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:13.948091 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-4b0f1d2b-9558-4670-ac4c-e84aa96bfb73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b91517acac474118a85b8d202850ba4d'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:13.961185 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-4b0f1d2b-9558-4670-ac4c-e84aa96bfb73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b91517acac474118a85b8d202850ba4d'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:13.974738 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1334/2640] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:39:13 2022] DELETE /identity/v3/users/b91517acac474118a85b8d202850ba4d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:39:13.979104 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6b353-efd7-40d0-9340-2672c24743bc None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:13.979425 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6b353-efd7-40d0-9340-2672c24743bc None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:13.979697 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6b353-efd7-40d0-9340-2672c24743bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:13.996555 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-c1d6b353-efd7-40d0-9340-2672c24743bc None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:39:13.997891 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-c1d6b353-efd7-40d0-9340-2672c24743bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:39:14.010424 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1307/2641] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:39:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 03:39:14.020881 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46536477-e526-4dc4-ae3f-22c3ed4ed3ff None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:14.022538 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-46536477-e526-4dc4-ae3f-22c3ed4ed3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:39:14.065040 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1335/2642] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:39:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 03:39:14.071216 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:39:14.075519 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d6b353-efd7-40d0-9340-2672c24743bc None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:14.084592 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46536477-e526-4dc4-ae3f-22c3ed4ed3ff None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:14.130492 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d6b353-efd7-40d0-9340-2672c24743bc None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:14.133639 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428d9f43-e43f-4c4b-be50-851f9baf38e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:14.134349 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d9f43-e43f-4c4b-be50-851f9baf38e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:14.134542 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ffd4f6-7cb8-4931-b3a9-6024cfc27776 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:14.134677 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d9f43-e43f-4c4b-be50-851f9baf38e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:14.135023 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d9f43-e43f-4c4b-be50-851f9baf38e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:14.135254 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ffd4f6-7cb8-4931-b3a9-6024cfc27776 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:14.135554 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ffd4f6-7cb8-4931-b3a9-6024cfc27776 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:14.135722 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ffd4f6-7cb8-4931-b3a9-6024cfc27776 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:14.144373 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428d9f43-e43f-4c4b-be50-851f9baf38e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:14.144956 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ffd4f6-7cb8-4931-b3a9-6024cfc27776 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:14.145843 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428d9f43-e43f-4c4b-be50-851f9baf38e9 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:14.146404 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ffd4f6-7cb8-4931-b3a9-6024cfc27776 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:14.155533 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1308/2643] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:39:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 03:39:14.155974 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1336/2644] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:39:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 03:39:14.520165 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428d9f43-e43f-4c4b-be50-851f9baf38e9 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:14.522060 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-428d9f43-e43f-4c4b-be50-851f9baf38e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:39:14.540756 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428d9f43-e43f-4c4b-be50-851f9baf38e9 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:14.552871 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ffd4f6-7cb8-4931-b3a9-6024cfc27776 service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:14.553154 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515e84f-99d4-4009-b647-5f1b20e1ee28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:14.554039 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515e84f-99d4-4009-b647-5f1b20e1ee28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:14.554316 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515e84f-99d4-4009-b647-5f1b20e1ee28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:14.554416 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-d0ffd4f6-7cb8-4931-b3a9-6024cfc27776 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:39:14.554587 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515e84f-99d4-4009-b647-5f1b20e1ee28 admin admin] PATH_INFO: `/v3/projects/c895dc166211485793e6e4d62f50efef` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:14.556308 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1515e84f-99d4-4009-b647-5f1b20e1ee28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c895dc166211485793e6e4d62f50efef)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:14.558281 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1515e84f-99d4-4009-b647-5f1b20e1ee28 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:14.568511 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ffd4f6-7cb8-4931-b3a9-6024cfc27776 service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:14.573280 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348a96bd-b9d0-40b0-a4a0-9298f9b731d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:14.574221 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a96bd-b9d0-40b0-a4a0-9298f9b731d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:14.574569 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a96bd-b9d0-40b0-a4a0-9298f9b731d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:14.574906 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a96bd-b9d0-40b0-a4a0-9298f9b731d2 admin admin] PATH_INFO: `/v3/projects/ff4049db62594f6b8e06244bc8cd2904` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:14.576221 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348a96bd-b9d0-40b0-a4a0-9298f9b731d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff4049db62594f6b8e06244bc8cd2904)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:14.578285 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348a96bd-b9d0-40b0-a4a0-9298f9b731d2 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:14.581070 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:39:14.611290 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-1515e84f-99d4-4009-b647-5f1b20e1ee28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c895dc166211485793e6e4d62f50efef', 'request_id': 'req-1515e84f-99d4-4009-b647-5f1b20e1ee28'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:14.617057 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-1515e84f-99d4-4009-b647-5f1b20e1ee28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c895dc166211485793e6e4d62f50efef', 'request_id': 'req-1515e84f-99d4-4009-b647-5f1b20e1ee28'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:14.625093 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-1515e84f-99d4-4009-b647-5f1b20e1ee28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c895dc166211485793e6e4d62f50efef', 'request_id': 'req-1515e84f-99d4-4009-b647-5f1b20e1ee28'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:14.631334 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-348a96bd-b9d0-40b0-a4a0-9298f9b731d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff4049db62594f6b8e06244bc8cd2904', 'request_id': 'req-348a96bd-b9d0-40b0-a4a0-9298f9b731d2'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:14.636802 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-1515e84f-99d4-4009-b647-5f1b20e1ee28 admin admin] The token cache is being invalidate because project c895dc166211485793e6e4d62f50efef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:39:14.637088 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-1515e84f-99d4-4009-b647-5f1b20e1ee28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:14.637197 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-348a96bd-b9d0-40b0-a4a0-9298f9b731d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff4049db62594f6b8e06244bc8cd2904', 'request_id': 'req-348a96bd-b9d0-40b0-a4a0-9298f9b731d2'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:14.637712 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-1515e84f-99d4-4009-b647-5f1b20e1ee28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:14.639329 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1309/2645] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:39:14 2022] DELETE /identity/v3/projects/c895dc166211485793e6e4d62f50efef => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:39:14.643256 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515e84f-99d4-4009-b647-5f1b20e1ee28 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:14.643614 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-348a96bd-b9d0-40b0-a4a0-9298f9b731d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff4049db62594f6b8e06244bc8cd2904', 'request_id': 'req-348a96bd-b9d0-40b0-a4a0-9298f9b731d2'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:14.644672 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1515e84f-99d4-4009-b647-5f1b20e1ee28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:39:14.657789 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-348a96bd-b9d0-40b0-a4a0-9298f9b731d2 admin admin] The token cache is being invalidate because project ff4049db62594f6b8e06244bc8cd2904 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:39:14.658079 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-348a96bd-b9d0-40b0-a4a0-9298f9b731d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:14.658701 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-348a96bd-b9d0-40b0-a4a0-9298f9b731d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:14.660612 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1337/2646] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:39:14 2022] DELETE /identity/v3/projects/ff4049db62594f6b8e06244bc8cd2904 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 03:39:14.664653 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348a96bd-b9d0-40b0-a4a0-9298f9b731d2 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:14.666055 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-348a96bd-b9d0-40b0-a4a0-9298f9b731d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:39:14.709686 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515e84f-99d4-4009-b647-5f1b20e1ee28 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:14.729593 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348a96bd-b9d0-40b0-a4a0-9298f9b731d2 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:14.734426 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d4c64-c5b2-4026-a5ff-4113ffb93b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:14.735418 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d4c64-c5b2-4026-a5ff-4113ffb93b9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:14.735718 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d4c64-c5b2-4026-a5ff-4113ffb93b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:14.735975 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d4c64-c5b2-4026-a5ff-4113ffb93b9c admin admin] PATH_INFO: `/v3/users/3d6b5fe65ab24485be5b86f78edde63a` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:14.737192 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00d4c64-c5b2-4026-a5ff-4113ffb93b9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d6b5fe65ab24485be5b86f78edde63a)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:14.739143 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00d4c64-c5b2-4026-a5ff-4113ffb93b9c admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:14.739674 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:39:14.768901 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12bf21f-6add-45f2-ad40-f7e02339ca5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:14.769831 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12bf21f-6add-45f2-ad40-f7e02339ca5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:14.770136 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12bf21f-6add-45f2-ad40-f7e02339ca5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:14.770460 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12bf21f-6add-45f2-ad40-f7e02339ca5f admin admin] PATH_INFO: `/v3/users/a23f4796f57648e58517ebb005a0c480` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:14.771783 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12bf21f-6add-45f2-ad40-f7e02339ca5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a23f4796f57648e58517ebb005a0c480)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:14.773826 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12bf21f-6add-45f2-ad40-f7e02339ca5f admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:14.793222 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-b00d4c64-c5b2-4026-a5ff-4113ffb93b9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d6b5fe65ab24485be5b86f78edde63a'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:14.793887 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-b00d4c64-c5b2-4026-a5ff-4113ffb93b9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d6b5fe65ab24485be5b86f78edde63a'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:14.801904 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-b00d4c64-c5b2-4026-a5ff-4113ffb93b9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d6b5fe65ab24485be5b86f78edde63a'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:14.802614 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-b00d4c64-c5b2-4026-a5ff-4113ffb93b9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d6b5fe65ab24485be5b86f78edde63a'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:14.815764 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-b00d4c64-c5b2-4026-a5ff-4113ffb93b9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d6b5fe65ab24485be5b86f78edde63a'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:14.823146 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f12bf21f-6add-45f2-ad40-f7e02339ca5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a23f4796f57648e58517ebb005a0c480'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:14.823821 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f12bf21f-6add-45f2-ad40-f7e02339ca5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a23f4796f57648e58517ebb005a0c480'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:14.824426 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f12bf21f-6add-45f2-ad40-f7e02339ca5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a23f4796f57648e58517ebb005a0c480'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:14.830112 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1338/2647] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:39:14 2022] DELETE /identity/v3/users/3d6b5fe65ab24485be5b86f78edde63a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:39:14.837280 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f12bf21f-6add-45f2-ad40-f7e02339ca5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a23f4796f57648e58517ebb005a0c480'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:14.844758 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f12bf21f-6add-45f2-ad40-f7e02339ca5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a23f4796f57648e58517ebb005a0c480'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:14.858341 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1310/2648] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:39:14 2022] DELETE /identity/v3/users/a23f4796f57648e58517ebb005a0c480 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 03:39:15.183832 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d4c64-c5b2-4026-a5ff-4113ffb93b9c admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:15.185318 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-b00d4c64-c5b2-4026-a5ff-4113ffb93b9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:39:15.197315 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12bf21f-6add-45f2-ad40-f7e02339ca5f admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:15.198867 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f12bf21f-6add-45f2-ad40-f7e02339ca5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:39:15.201285 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:39:15.269663 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d4c64-c5b2-4026-a5ff-4113ffb93b9c admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:15.281864 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12bf21f-6add-45f2-ad40-f7e02339ca5f admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:15.286809 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e7544f-d8a7-4c5b-b80f-fbbc492bc69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:15.287741 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7544f-d8a7-4c5b-b80f-fbbc492bc69a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:15.288060 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7544f-d8a7-4c5b-b80f-fbbc492bc69a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:15.288357 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7544f-d8a7-4c5b-b80f-fbbc492bc69a admin admin] PATH_INFO: `/v3/projects/e3c0db4d488b463bac73151646ad80ca` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:15.289580 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e7544f-d8a7-4c5b-b80f-fbbc492bc69a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3c0db4d488b463bac73151646ad80ca)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:15.291643 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e7544f-d8a7-4c5b-b80f-fbbc492bc69a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:15.327068 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa897f-9fb9-48cb-9d6d-c08d24a428a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:15.328547 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa897f-9fb9-48cb-9d6d-c08d24a428a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:15.329021 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa897f-9fb9-48cb-9d6d-c08d24a428a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:15.329512 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa897f-9fb9-48cb-9d6d-c08d24a428a6 admin admin] PATH_INFO: `/v3/projects/1732fc3b14fe469499cfe093d50a232e` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:15.331340 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aa897f-9fb9-48cb-9d6d-c08d24a428a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1732fc3b14fe469499cfe093d50a232e)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:15.333259 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aa897f-9fb9-48cb-9d6d-c08d24a428a6 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:15.339521 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-44e7544f-d8a7-4c5b-b80f-fbbc492bc69a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3c0db4d488b463bac73151646ad80ca', 'request_id': 'req-44e7544f-d8a7-4c5b-b80f-fbbc492bc69a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:15.344342 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:39:15.347866 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-44e7544f-d8a7-4c5b-b80f-fbbc492bc69a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3c0db4d488b463bac73151646ad80ca', 'request_id': 'req-44e7544f-d8a7-4c5b-b80f-fbbc492bc69a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:15.357508 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-44e7544f-d8a7-4c5b-b80f-fbbc492bc69a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3c0db4d488b463bac73151646ad80ca', 'request_id': 'req-44e7544f-d8a7-4c5b-b80f-fbbc492bc69a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:15.370738 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-44e7544f-d8a7-4c5b-b80f-fbbc492bc69a admin admin] The token cache is being invalidate because project e3c0db4d488b463bac73151646ad80ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:39:15.371393 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-44e7544f-d8a7-4c5b-b80f-fbbc492bc69a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:15.372528 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-44e7544f-d8a7-4c5b-b80f-fbbc492bc69a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:15.374856 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1311/2649] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:39:15 2022] DELETE /identity/v3/projects/e3c0db4d488b463bac73151646ad80ca => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 03:39:15.380058 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1188ea53-1c0d-43f4-a3d5-2ff3ffa139fa None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:15.380892 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1188ea53-1c0d-43f4-a3d5-2ff3ffa139fa None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:15.381336 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1188ea53-1c0d-43f4-a3d5-2ff3ffa139fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:15.386996 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e5aa897f-9fb9-48cb-9d6d-c08d24a428a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1732fc3b14fe469499cfe093d50a232e', 'request_id': 'req-e5aa897f-9fb9-48cb-9d6d-c08d24a428a6'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:15.393140 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e5aa897f-9fb9-48cb-9d6d-c08d24a428a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1732fc3b14fe469499cfe093d50a232e', 'request_id': 'req-e5aa897f-9fb9-48cb-9d6d-c08d24a428a6'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:15.399721 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e5aa897f-9fb9-48cb-9d6d-c08d24a428a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1732fc3b14fe469499cfe093d50a232e', 'request_id': 'req-e5aa897f-9fb9-48cb-9d6d-c08d24a428a6'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:15.401481 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-1188ea53-1c0d-43f4-a3d5-2ff3ffa139fa None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:39:15.402678 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1188ea53-1c0d-43f4-a3d5-2ff3ffa139fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:39:15.414600 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e5aa897f-9fb9-48cb-9d6d-c08d24a428a6 admin admin] The token cache is being invalidate because project 1732fc3b14fe469499cfe093d50a232e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:39:15.414875 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e5aa897f-9fb9-48cb-9d6d-c08d24a428a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:15.415562 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e5aa897f-9fb9-48cb-9d6d-c08d24a428a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:15.417272 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1339/2650] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:39:15 2022] DELETE /identity/v3/projects/1732fc3b14fe469499cfe093d50a232e => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:39:15.421346 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa897f-9fb9-48cb-9d6d-c08d24a428a6 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:15.422760 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-e5aa897f-9fb9-48cb-9d6d-c08d24a428a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:39:15.463097 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1312/2651] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:39:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 03:39:15.470666 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa65548-44be-4317-b251-11c55c8de825 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:15.470957 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa65548-44be-4317-b251-11c55c8de825 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:15.471270 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa65548-44be-4317-b251-11c55c8de825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:15.471897 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:39:15.488538 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa897f-9fb9-48cb-9d6d-c08d24a428a6 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:15.490204 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-2fa65548-44be-4317-b251-11c55c8de825 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:39:15.491462 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2fa65548-44be-4317-b251-11c55c8de825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:39:15.493363 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e493a2-851c-4ea1-80b9-c922b1b82f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:15.494239 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e493a2-851c-4ea1-80b9-c922b1b82f13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:15.494519 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e493a2-851c-4ea1-80b9-c922b1b82f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:15.494792 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e493a2-851c-4ea1-80b9-c922b1b82f13 admin admin] PATH_INFO: `/v3/users/67b1d3f250db4dcf830011972c770467` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:15.496022 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e493a2-851c-4ea1-80b9-c922b1b82f13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67b1d3f250db4dcf830011972c770467)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:15.498038 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e493a2-851c-4ea1-80b9-c922b1b82f13 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:15.500178 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1313/2652] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:39:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 03:39:15.504534 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa65548-44be-4317-b251-11c55c8de825 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:15.513610 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa65548-44be-4317-b251-11c55c8de825 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:15.518588 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c659b1-8cdc-4b1c-ad98-c2d138c1da12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:15.519280 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c659b1-8cdc-4b1c-ad98-c2d138c1da12 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:15.519565 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c659b1-8cdc-4b1c-ad98-c2d138c1da12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:15.519877 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c659b1-8cdc-4b1c-ad98-c2d138c1da12 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:15.520616 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c659b1-8cdc-4b1c-ad98-c2d138c1da12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:39:15.521215 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c659b1-8cdc-4b1c-ad98-c2d138c1da12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:15.522765 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c659b1-8cdc-4b1c-ad98-c2d138c1da12 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:15.536208 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1314/2653] 10.222.0.60 () {58 vars in 1152 bytes} [Sat Jul 2 03:39:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:39:15.540376 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c659b1-8cdc-4b1c-ad98-c2d138c1da12 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:15.547157 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-01e493a2-851c-4ea1-80b9-c922b1b82f13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67b1d3f250db4dcf830011972c770467'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:15.547938 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-01e493a2-851c-4ea1-80b9-c922b1b82f13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67b1d3f250db4dcf830011972c770467'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:15.550451 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c659b1-8cdc-4b1c-ad98-c2d138c1da12 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:15.556520 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f65f2-3675-4d59-8fb0-f923f3538794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:15.556749 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-01e493a2-851c-4ea1-80b9-c922b1b82f13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67b1d3f250db4dcf830011972c770467'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:15.557367 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f65f2-3675-4d59-8fb0-f923f3538794 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:15.557502 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-01e493a2-851c-4ea1-80b9-c922b1b82f13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67b1d3f250db4dcf830011972c770467'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:15.557641 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f65f2-3675-4d59-8fb0-f923f3538794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:15.557910 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f65f2-3675-4d59-8fb0-f923f3538794 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:15.558617 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98f65f2-3675-4d59-8fb0-f923f3538794 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:15.560732 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98f65f2-3675-4d59-8fb0-f923f3538794 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:15.569786 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-01e493a2-851c-4ea1-80b9-c922b1b82f13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67b1d3f250db4dcf830011972c770467'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:15.582520 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1340/2654] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:39:15 2022] DELETE /identity/v3/users/67b1d3f250db4dcf830011972c770467 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 03:39:15.590751 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1315/2655] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:39:15 2022] POST /identity/v3/projects => generated 393 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 03:39:15.595049 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e493a2-851c-4ea1-80b9-c922b1b82f13 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:15.596578 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-01e493a2-851c-4ea1-80b9-c922b1b82f13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:39:15.663345 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e493a2-851c-4ea1-80b9-c922b1b82f13 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:15.721450 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d8424-b774-465f-8c52-da6f44fc6b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:15.722100 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d8424-b774-465f-8c52-da6f44fc6b11 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:15.722385 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d8424-b774-465f-8c52-da6f44fc6b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:15.722779 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d8424-b774-465f-8c52-da6f44fc6b11 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:15.723520 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43d8424-b774-465f-8c52-da6f44fc6b11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:15.725629 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43d8424-b774-465f-8c52-da6f44fc6b11 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:15.749713 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1341/2656] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:39:15 2022] POST /identity/v3/users => generated 297 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:39:15.754000 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f65f2-3675-4d59-8fb0-f923f3538794 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:15.765001 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f65f2-3675-4d59-8fb0-f923f3538794 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:15.770044 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398a2cb9-fdf3-4fc3-b293-d6eba7a37a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:15.770836 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a2cb9-fdf3-4fc3-b293-d6eba7a37a6a admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:15.771174 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a2cb9-fdf3-4fc3-b293-d6eba7a37a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:15.771548 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a2cb9-fdf3-4fc3-b293-d6eba7a37a6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:15.772356 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398a2cb9-fdf3-4fc3-b293-d6eba7a37a6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:15.774067 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398a2cb9-fdf3-4fc3-b293-d6eba7a37a6a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:15.785050 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1316/2657] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:39:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:39:15.788908 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d8424-b774-465f-8c52-da6f44fc6b11 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:15.795518 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:39:15.799587 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d8424-b774-465f-8c52-da6f44fc6b11 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:15.805629 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25c5b82-37e2-4b39-837f-ec53bab088a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:15.806423 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c5b82-37e2-4b39-837f-ec53bab088a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:15.806913 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c5b82-37e2-4b39-837f-ec53bab088a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:15.807397 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c5b82-37e2-4b39-837f-ec53bab088a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:15.808245 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25c5b82-37e2-4b39-837f-ec53bab088a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:15.810108 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25c5b82-37e2-4b39-837f-ec53bab088a0 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:15.825562 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1342/2658] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:39:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:39:15.826885 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398a2cb9-fdf3-4fc3-b293-d6eba7a37a6a admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:15.839864 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398a2cb9-fdf3-4fc3-b293-d6eba7a37a6a admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:15.844823 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b5f8c2-25cb-4140-bda5-40a1e25fd265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:15.845722 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5f8c2-25cb-4140-bda5-40a1e25fd265 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:15.845982 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5f8c2-25cb-4140-bda5-40a1e25fd265 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:15.846256 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5f8c2-25cb-4140-bda5-40a1e25fd265 admin admin] PATH_INFO: `/v3/projects/67b9d06236c64e37b4c373bb52193127/users/b8982bf9bbe04d158a3db818f9d853bb/roles/c43aada0326446c4ade0ab1262918fa4` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:15.869201 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b5f8c2-25cb-4140-bda5-40a1e25fd265 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67b9d06236c64e37b4c373bb52193127, user_id=b8982bf9bbe04d158a3db818f9d853bb, role_id=c43aada0326446c4ade0ab1262918fa4)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:15.869662 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25c5b82-37e2-4b39-837f-ec53bab088a0 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:15.871620 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-f25c5b82-37e2-4b39-837f-ec53bab088a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:39:15.872492 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b5f8c2-25cb-4140-bda5-40a1e25fd265 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:15.886265 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25c5b82-37e2-4b39-837f-ec53bab088a0 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:15.896463 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1317/2659] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:39:15 2022] PUT /identity/v3/projects/67b9d06236c64e37b4c373bb52193127/users/b8982bf9bbe04d158a3db818f9d853bb/roles/c43aada0326446c4ade0ab1262918fa4 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:39:15.908812 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f9d724-5c7e-43bc-8314-bf2664ce5552 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:15.909098 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f9d724-5c7e-43bc-8314-bf2664ce5552 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:15.909372 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f9d724-5c7e-43bc-8314-bf2664ce5552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:15.936368 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-14f9d724-5c7e-43bc-8314-bf2664ce5552 None None] MFA Rules not processed for user `b8982bf9bbe04d158a3db818f9d853bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:39:15.937603 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-14f9d724-5c7e-43bc-8314-bf2664ce5552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:39:15.951373 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4380b-c2b2-4711-987a-a728b60267c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:15.952238 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4380b-c2b2-4711-987a-a728b60267c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:15.952513 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4380b-c2b2-4711-987a-a728b60267c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:15.952785 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4380b-c2b2-4711-987a-a728b60267c4 admin admin] PATH_INFO: `/v3/projects/97c7369983c94c96afa89fea33b1dfb2` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:15.953969 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e4380b-c2b2-4711-987a-a728b60267c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97c7369983c94c96afa89fea33b1dfb2)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:15.955909 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e4380b-c2b2-4711-987a-a728b60267c4 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:15.993487 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:39:16.004639 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-49e4380b-c2b2-4711-987a-a728b60267c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97c7369983c94c96afa89fea33b1dfb2', 'request_id': 'req-49e4380b-c2b2-4711-987a-a728b60267c4'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:16.004819 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1318/2660] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:39:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 03:39:16.008838 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f9d724-5c7e-43bc-8314-bf2664ce5552 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:16.010399 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-49e4380b-c2b2-4711-987a-a728b60267c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97c7369983c94c96afa89fea33b1dfb2', 'request_id': 'req-49e4380b-c2b2-4711-987a-a728b60267c4'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:16.016928 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-49e4380b-c2b2-4711-987a-a728b60267c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97c7369983c94c96afa89fea33b1dfb2', 'request_id': 'req-49e4380b-c2b2-4711-987a-a728b60267c4'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:16.019783 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f9d724-5c7e-43bc-8314-bf2664ce5552 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:16.031474 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-49e4380b-c2b2-4711-987a-a728b60267c4 admin admin] The token cache is being invalidate because project 97c7369983c94c96afa89fea33b1dfb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:39:16.031758 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-49e4380b-c2b2-4711-987a-a728b60267c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:16.032398 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-49e4380b-c2b2-4711-987a-a728b60267c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:16.034426 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1343/2661] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:39:15 2022] DELETE /identity/v3/projects/97c7369983c94c96afa89fea33b1dfb2 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 03:39:16.039789 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817333e-8b55-484a-84b7-91a9831e88e7 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:16.040194 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817333e-8b55-484a-84b7-91a9831e88e7 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:16.040539 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817333e-8b55-484a-84b7-91a9831e88e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:16.059242 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-2817333e-8b55-484a-84b7-91a9831e88e7 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:39:16.060553 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-2817333e-8b55-484a-84b7-91a9831e88e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:39:16.077637 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a88da2-5505-407a-b960-c3395ae27555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:16.078302 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a88da2-5505-407a-b960-c3395ae27555 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:16.078582 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a88da2-5505-407a-b960-c3395ae27555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:16.078851 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a88da2-5505-407a-b960-c3395ae27555 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:16.079568 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a88da2-5505-407a-b960-c3395ae27555 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:16.081468 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a88da2-5505-407a-b960-c3395ae27555 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:16.106745 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1319/2662] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:39:16 2022] POST /identity/v3/projects => generated 391 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 03:39:16.111098 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a88da2-5505-407a-b960-c3395ae27555 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:16.112733 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c1a88da2-5505-407a-b960-c3395ae27555 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:39:16.120615 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1344/2663] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:39:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 03:39:16.128738 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599e407-31cf-4669-ae54-e0849d56bdb0 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:16.129024 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599e407-31cf-4669-ae54-e0849d56bdb0 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:16.129300 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599e407-31cf-4669-ae54-e0849d56bdb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:16.147300 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-6599e407-31cf-4669-ae54-e0849d56bdb0 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:39:16.148505 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-6599e407-31cf-4669-ae54-e0849d56bdb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:39:16.167574 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:39:16.177012 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a88da2-5505-407a-b960-c3395ae27555 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:16.182047 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d08290-c7c0-42ec-8831-96e6b84f482d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:16.182855 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d08290-c7c0-42ec-8831-96e6b84f482d admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:16.183731 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d08290-c7c0-42ec-8831-96e6b84f482d admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:16.184010 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d08290-c7c0-42ec-8831-96e6b84f482d admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:16.184741 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d08290-c7c0-42ec-8831-96e6b84f482d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:16.186737 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d08290-c7c0-42ec-8831-96e6b84f482d admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:16.212597 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1320/2664] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:39:16 2022] POST /identity/v3/users => generated 302 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 03:39:16.212797 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1345/2665] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:39:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 03:39:16.213886 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d08290-c7c0-42ec-8831-96e6b84f482d admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:16.214375 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6599e407-31cf-4669-ae54-e0849d56bdb0 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:16.223958 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6599e407-31cf-4669-ae54-e0849d56bdb0 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:16.224533 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d08290-c7c0-42ec-8831-96e6b84f482d admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:16.228773 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89edf4fd-a37b-456c-a831-98569892405c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:16.229506 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89edf4fd-a37b-456c-a831-98569892405c admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:16.229659 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ff5596-ed5e-4425-b494-bece79d7e4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:16.229807 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89edf4fd-a37b-456c-a831-98569892405c admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:16.230107 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89edf4fd-a37b-456c-a831-98569892405c admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:16.230230 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff5596-ed5e-4425-b494-bece79d7e4f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:16.230510 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff5596-ed5e-4425-b494-bece79d7e4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:16.230772 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff5596-ed5e-4425-b494-bece79d7e4f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:16.230873 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89edf4fd-a37b-456c-a831-98569892405c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:39:16.231165 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89edf4fd-a37b-456c-a831-98569892405c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:16.231721 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ff5596-ed5e-4425-b494-bece79d7e4f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:16.232836 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89edf4fd-a37b-456c-a831-98569892405c admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:16.233611 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ff5596-ed5e-4425-b494-bece79d7e4f6 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:16.244287 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1321/2666] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:39:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:39:16.245245 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1346/2667] 10.222.0.60 () {58 vars in 1152 bytes} [Sat Jul 2 03:39:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:39:16.249258 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ff5596-ed5e-4425-b494-bece79d7e4f6 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:16.249394 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89edf4fd-a37b-456c-a831-98569892405c admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:16.259052 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ff5596-ed5e-4425-b494-bece79d7e4f6 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:16.259247 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89edf4fd-a37b-456c-a831-98569892405c admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:16.263700 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc294a8-8816-4f18-88ea-dc503a08aabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:16.263837 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27edce05-2309-4ab2-b740-b1abd3bf56d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:16.264375 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27edce05-2309-4ab2-b740-b1abd3bf56d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:16.264566 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc294a8-8816-4f18-88ea-dc503a08aabb admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:16.264667 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27edce05-2309-4ab2-b740-b1abd3bf56d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:16.264847 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc294a8-8816-4f18-88ea-dc503a08aabb admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:16.264945 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27edce05-2309-4ab2-b740-b1abd3bf56d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:16.265121 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc294a8-8816-4f18-88ea-dc503a08aabb admin admin] PATH_INFO: `/v3/projects/31de95cedba44c2d8e093f7843cca6c7/users/5c127ef1deb64154a3131bd0d66e75a7/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:16.265640 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27edce05-2309-4ab2-b740-b1abd3bf56d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:16.267601 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27edce05-2309-4ab2-b740-b1abd3bf56d2 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:16.279930 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc294a8-8816-4f18-88ea-dc503a08aabb admin admin] RBAC: Authorizing `identity:create_grant(project_id=31de95cedba44c2d8e093f7843cca6c7, user_id=5c127ef1deb64154a3131bd0d66e75a7, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:16.282569 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc294a8-8816-4f18-88ea-dc503a08aabb admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:16.295064 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1347/2668] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:39:16 2022] POST /identity/v3/projects => generated 389 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 03:39:16.296709 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1322/2669] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:39:16 2022] PUT /identity/v3/projects/31de95cedba44c2d8e093f7843cca6c7/users/5c127ef1deb64154a3131bd0d66e75a7/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:39:16.299270 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27edce05-2309-4ab2-b740-b1abd3bf56d2 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:16.300239 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc294a8-8816-4f18-88ea-dc503a08aabb admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:16.339459 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:39:16.364569 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27edce05-2309-4ab2-b740-b1abd3bf56d2 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:16.367639 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc294a8-8816-4f18-88ea-dc503a08aabb admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:16.373783 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8b0073-4a26-4ebf-a8a3-e3e3627ccbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:16.374480 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b0073-4a26-4ebf-a8a3-e3e3627ccbed admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:16.374759 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b0073-4a26-4ebf-a8a3-e3e3627ccbed admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:16.375030 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b0073-4a26-4ebf-a8a3-e3e3627ccbed admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:16.375755 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8b0073-4a26-4ebf-a8a3-e3e3627ccbed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:16.377672 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8b0073-4a26-4ebf-a8a3-e3e3627ccbed admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:16.378072 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986600dd-385b-42b9-8193-9c062ba153c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:16.378775 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986600dd-385b-42b9-8193-9c062ba153c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:16.379055 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986600dd-385b-42b9-8193-9c062ba153c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:16.379898 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986600dd-385b-42b9-8193-9c062ba153c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:16.381326 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986600dd-385b-42b9-8193-9c062ba153c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:16.382997 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986600dd-385b-42b9-8193-9c062ba153c8 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:16.394306 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1323/2670] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:39:16 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 03:39:16.398496 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986600dd-385b-42b9-8193-9c062ba153c8 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:16.400339 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1348/2671] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:39:16 2022] POST /identity/v3/users => generated 295 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:39:16.404285 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8b0073-4a26-4ebf-a8a3-e3e3627ccbed admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:16.412279 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986600dd-385b-42b9-8193-9c062ba153c8 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:16.415355 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8b0073-4a26-4ebf-a8a3-e3e3627ccbed admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:16.417117 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230a41fa-0282-4a0e-91b3-96c3ee6b8475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:16.417997 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a41fa-0282-4a0e-91b3-96c3ee6b8475 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:16.418303 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a41fa-0282-4a0e-91b3-96c3ee6b8475 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:16.418555 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a41fa-0282-4a0e-91b3-96c3ee6b8475 admin admin] PATH_INFO: `/v3/projects/31de95cedba44c2d8e093f7843cca6c7/users/5c127ef1deb64154a3131bd0d66e75a7/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:16.420277 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f259c480-ba18-49b3-ab0a-49749bd4481a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:16.420703 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230a41fa-0282-4a0e-91b3-96c3ee6b8475 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31de95cedba44c2d8e093f7843cca6c7, user_id=5c127ef1deb64154a3131bd0d66e75a7, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:16.420925 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f259c480-ba18-49b3-ab0a-49749bd4481a admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:16.421203 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f259c480-ba18-49b3-ab0a-49749bd4481a admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:16.421500 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f259c480-ba18-49b3-ab0a-49749bd4481a admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:16.422196 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f259c480-ba18-49b3-ab0a-49749bd4481a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:16.423595 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230a41fa-0282-4a0e-91b3-96c3ee6b8475 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:16.423890 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f259c480-ba18-49b3-ab0a-49749bd4481a admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:16.434192 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1349/2672] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:39:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 03:39:16.435004 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1324/2673] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:39:16 2022] PUT /identity/v3/projects/31de95cedba44c2d8e093f7843cca6c7/users/5c127ef1deb64154a3131bd0d66e75a7/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 03:39:16.438052 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f259c480-ba18-49b3-ab0a-49749bd4481a admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:16.444881 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15001878-07f3-4896-afe6-1aec3c514aff None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:16.445190 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15001878-07f3-4896-afe6-1aec3c514aff None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:16.445467 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15001878-07f3-4896-afe6-1aec3c514aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:16.448013 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f259c480-ba18-49b3-ab0a-49749bd4481a admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:16.471510 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-15001878-07f3-4896-afe6-1aec3c514aff None None] MFA Rules not processed for user `5c127ef1deb64154a3131bd0d66e75a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:39:16.472734 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-15001878-07f3-4896-afe6-1aec3c514aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:39:16.505971 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a8958-f40e-4237-9e77-febd41bf9227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:16.506563 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a8958-f40e-4237-9e77-febd41bf9227 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:16.506843 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a8958-f40e-4237-9e77-febd41bf9227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:16.507143 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a8958-f40e-4237-9e77-febd41bf9227 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:16.507887 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465a8958-f40e-4237-9e77-febd41bf9227 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:16.509530 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465a8958-f40e-4237-9e77-febd41bf9227 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:16.519907 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1350/2674] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:39:16 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:39:16.524349 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a8958-f40e-4237-9e77-febd41bf9227 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:16.530499 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:39:16.534528 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a8958-f40e-4237-9e77-febd41bf9227 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:16.540592 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc88d7-2ee0-4a42-801f-cf1e6f1fc03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:16.541588 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc88d7-2ee0-4a42-801f-cf1e6f1fc03e admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:16.541872 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc88d7-2ee0-4a42-801f-cf1e6f1fc03e admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:16.542142 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc88d7-2ee0-4a42-801f-cf1e6f1fc03e admin admin] PATH_INFO: `/v3/projects/e33c6d6e92994964b727f7f62e7cfc1c/users/2bd072a90c3b4cd6af559a1383470b35/roles/c43aada0326446c4ade0ab1262918fa4` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:16.545870 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1325/2675] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:39:16 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 03:39:16.553072 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15001878-07f3-4896-afe6-1aec3c514aff None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:16.554448 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-15001878-07f3-4896-afe6-1aec3c514aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:39:16.560498 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afc88d7-2ee0-4a42-801f-cf1e6f1fc03e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e33c6d6e92994964b727f7f62e7cfc1c, user_id=2bd072a90c3b4cd6af559a1383470b35, role_id=c43aada0326446c4ade0ab1262918fa4)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:16.563231 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afc88d7-2ee0-4a42-801f-cf1e6f1fc03e admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:16.577801 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1351/2676] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:39:16 2022] PUT /identity/v3/projects/e33c6d6e92994964b727f7f62e7cfc1c/users/2bd072a90c3b4cd6af559a1383470b35/roles/c43aada0326446c4ade0ab1262918fa4 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 03:39:16.588883 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b23f4-99f3-4210-a4eb-7dd62efd7df0 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:16.589317 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b23f4-99f3-4210-a4eb-7dd62efd7df0 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:16.589596 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b23f4-99f3-4210-a4eb-7dd62efd7df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:16.612957 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15001878-07f3-4896-afe6-1aec3c514aff None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:16.615036 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-2b9b23f4-99f3-4210-a4eb-7dd62efd7df0 None None] MFA Rules not processed for user `2bd072a90c3b4cd6af559a1383470b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:39:16.616337 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-2b9b23f4-99f3-4210-a4eb-7dd62efd7df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:39:16.659522 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f121ca26-210b-46e1-9839-ed538f44f3d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:16.660519 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f121ca26-210b-46e1-9839-ed538f44f3d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:16.660827 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f121ca26-210b-46e1-9839-ed538f44f3d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:16.661094 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f121ca26-210b-46e1-9839-ed538f44f3d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:16.673041 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:39:16.679622 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1352/2677] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:39:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 03:39:16.690509 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9b23f4-99f3-4210-a4eb-7dd62efd7df0 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:16.691910 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-2b9b23f4-99f3-4210-a4eb-7dd62efd7df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:39:16.704056 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9b23f4-99f3-4210-a4eb-7dd62efd7df0 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:16.707596 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792c0552-b5de-4b36-9a50-29cb0dd9902f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:16.708230 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c0552-b5de-4b36-9a50-29cb0dd9902f service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:16.708506 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c0552-b5de-4b36-9a50-29cb0dd9902f service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:16.708773 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c0552-b5de-4b36-9a50-29cb0dd9902f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:16.717438 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792c0552-b5de-4b36-9a50-29cb0dd9902f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:16.718852 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792c0552-b5de-4b36-9a50-29cb0dd9902f service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:16.724397 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f121ca26-210b-46e1-9839-ed538f44f3d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:16.726023 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f121ca26-210b-46e1-9839-ed538f44f3d4 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:16.727719 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1353/2678] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:39:16 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 03:39:16.736197 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1326/2679] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:39:16 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 03:39:16.782236 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792c0552-b5de-4b36-9a50-29cb0dd9902f service cinder] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:16.791411 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792c0552-b5de-4b36-9a50-29cb0dd9902f service cinder] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:16.795423 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a6e88-b4e7-401e-a5dd-20e66fe8ed33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:16.796069 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a6e88-b4e7-401e-a5dd-20e66fe8ed33 service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:16.796351 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a6e88-b4e7-401e-a5dd-20e66fe8ed33 service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:16.796623 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a6e88-b4e7-401e-a5dd-20e66fe8ed33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:16.798658 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-c92a6e88-b4e7-401e-a5dd-20e66fe8ed33 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:39:16.858647 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92a6e88-b4e7-401e-a5dd-20e66fe8ed33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:16.860153 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92a6e88-b4e7-401e-a5dd-20e66fe8ed33 service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:16.870911 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1354/2680] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:39:16 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:39:20.227835 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f121ca26-210b-46e1-9839-ed538f44f3d4 service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:20.302836 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f121ca26-210b-46e1-9839-ed538f44f3d4 service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:20.308771 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fffc685-1280-40cb-b7e1-0e02c48207de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:20.309665 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fffc685-1280-40cb-b7e1-0e02c48207de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:20.309971 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fffc685-1280-40cb-b7e1-0e02c48207de admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:20.310211 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fffc685-1280-40cb-b7e1-0e02c48207de admin admin] PATH_INFO: `/v3/users/b8982bf9bbe04d158a3db818f9d853bb` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:20.311607 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fffc685-1280-40cb-b7e1-0e02c48207de admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8982bf9bbe04d158a3db818f9d853bb)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:20.313610 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fffc685-1280-40cb-b7e1-0e02c48207de admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:20.362015 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4fffc685-1280-40cb-b7e1-0e02c48207de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8982bf9bbe04d158a3db818f9d853bb'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:20.362650 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4fffc685-1280-40cb-b7e1-0e02c48207de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8982bf9bbe04d158a3db818f9d853bb'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:20.363277 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4fffc685-1280-40cb-b7e1-0e02c48207de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8982bf9bbe04d158a3db818f9d853bb'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:20.376168 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4fffc685-1280-40cb-b7e1-0e02c48207de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8982bf9bbe04d158a3db818f9d853bb'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:20.383541 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4fffc685-1280-40cb-b7e1-0e02c48207de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8982bf9bbe04d158a3db818f9d853bb'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:20.398670 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1327/2681] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:39:20 2022] DELETE /identity/v3/users/b8982bf9bbe04d158a3db818f9d853bb => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:39:20.403343 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e761408-36c0-49a4-a860-1cc6e76def52 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:20.403832 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e761408-36c0-49a4-a860-1cc6e76def52 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:20.403938 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e761408-36c0-49a4-a860-1cc6e76def52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:20.421642 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-9e761408-36c0-49a4-a860-1cc6e76def52 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:39:20.422934 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-9e761408-36c0-49a4-a860-1cc6e76def52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:39:20.476374 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:39:20.490010 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1355/2682] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:39:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:39:20.500446 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fffc685-1280-40cb-b7e1-0e02c48207de admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:20.502524 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4fffc685-1280-40cb-b7e1-0e02c48207de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:39:20.537871 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:39:20.568884 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fffc685-1280-40cb-b7e1-0e02c48207de admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:20.572856 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84549eed-68a3-45f2-b5a3-aab9081405b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:20.573506 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84549eed-68a3-45f2-b5a3-aab9081405b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:20.573788 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84549eed-68a3-45f2-b5a3-aab9081405b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:20.574064 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84549eed-68a3-45f2-b5a3-aab9081405b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:20.584048 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84549eed-68a3-45f2-b5a3-aab9081405b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:20.585496 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84549eed-68a3-45f2-b5a3-aab9081405b2 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:20.595433 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1328/2683] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:39:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:39:20.877703 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e761408-36c0-49a4-a860-1cc6e76def52 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:20.879227 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-9e761408-36c0-49a4-a860-1cc6e76def52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:39:20.891866 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e761408-36c0-49a4-a860-1cc6e76def52 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:20.898417 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c79ae5c-b835-4af9-bc96-0ed43f472f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:20.899324 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c79ae5c-b835-4af9-bc96-0ed43f472f07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:20.899605 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c79ae5c-b835-4af9-bc96-0ed43f472f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:20.899842 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c79ae5c-b835-4af9-bc96-0ed43f472f07 admin admin] PATH_INFO: `/v3/projects/67b9d06236c64e37b4c373bb52193127` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:20.901166 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c79ae5c-b835-4af9-bc96-0ed43f472f07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67b9d06236c64e37b4c373bb52193127)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:20.903092 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c79ae5c-b835-4af9-bc96-0ed43f472f07 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:20.953756 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-5c79ae5c-b835-4af9-bc96-0ed43f472f07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67b9d06236c64e37b4c373bb52193127', 'request_id': 'req-5c79ae5c-b835-4af9-bc96-0ed43f472f07'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:20.960232 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-5c79ae5c-b835-4af9-bc96-0ed43f472f07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67b9d06236c64e37b4c373bb52193127', 'request_id': 'req-5c79ae5c-b835-4af9-bc96-0ed43f472f07'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:20.966947 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-5c79ae5c-b835-4af9-bc96-0ed43f472f07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67b9d06236c64e37b4c373bb52193127', 'request_id': 'req-5c79ae5c-b835-4af9-bc96-0ed43f472f07'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:20.984175 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-5c79ae5c-b835-4af9-bc96-0ed43f472f07 admin admin] The token cache is being invalidate because project 67b9d06236c64e37b4c373bb52193127 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:39:20.984545 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-5c79ae5c-b835-4af9-bc96-0ed43f472f07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:20.985166 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-5c79ae5c-b835-4af9-bc96-0ed43f472f07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:20.986745 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1356/2684] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:39:20 2022] DELETE /identity/v3/projects/67b9d06236c64e37b4c373bb52193127 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:39:20.990857 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84549eed-68a3-45f2-b5a3-aab9081405b2 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:21.001264 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84549eed-68a3-45f2-b5a3-aab9081405b2 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:21.061527 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab4715d-6478-4308-9da9-9eb69289be0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:21.062413 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab4715d-6478-4308-9da9-9eb69289be0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:21.062691 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab4715d-6478-4308-9da9-9eb69289be0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:21.062961 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab4715d-6478-4308-9da9-9eb69289be0b admin admin] PATH_INFO: `/v3/users/5c127ef1deb64154a3131bd0d66e75a7` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:21.064352 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab4715d-6478-4308-9da9-9eb69289be0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c127ef1deb64154a3131bd0d66e75a7)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:21.066298 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab4715d-6478-4308-9da9-9eb69289be0b admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:21.114578 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-fab4715d-6478-4308-9da9-9eb69289be0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c127ef1deb64154a3131bd0d66e75a7'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:21.115249 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-fab4715d-6478-4308-9da9-9eb69289be0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c127ef1deb64154a3131bd0d66e75a7'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:21.115865 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-fab4715d-6478-4308-9da9-9eb69289be0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c127ef1deb64154a3131bd0d66e75a7'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:21.127262 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-fab4715d-6478-4308-9da9-9eb69289be0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c127ef1deb64154a3131bd0d66e75a7'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:21.134035 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-fab4715d-6478-4308-9da9-9eb69289be0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c127ef1deb64154a3131bd0d66e75a7'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:21.152370 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1329/2685] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:39:20 2022] DELETE /identity/v3/users/5c127ef1deb64154a3131bd0d66e75a7 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:39:21.430574 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c79ae5c-b835-4af9-bc96-0ed43f472f07 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:21.432128 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-5c79ae5c-b835-4af9-bc96-0ed43f472f07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:39:21.446633 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c79ae5c-b835-4af9-bc96-0ed43f472f07 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:21.504787 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a651e8-7f6e-40ba-b6f9-d792f18e4dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:21.505655 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a651e8-7f6e-40ba-b6f9-d792f18e4dc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:21.505933 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a651e8-7f6e-40ba-b6f9-d792f18e4dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:21.506208 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a651e8-7f6e-40ba-b6f9-d792f18e4dc3 admin admin] PATH_INFO: `/v3/projects/31de95cedba44c2d8e093f7843cca6c7` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:21.507462 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a651e8-7f6e-40ba-b6f9-d792f18e4dc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31de95cedba44c2d8e093f7843cca6c7)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:21.509387 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a651e8-7f6e-40ba-b6f9-d792f18e4dc3 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:21.565000 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-24a651e8-7f6e-40ba-b6f9-d792f18e4dc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31de95cedba44c2d8e093f7843cca6c7', 'request_id': 'req-24a651e8-7f6e-40ba-b6f9-d792f18e4dc3'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:21.570886 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-24a651e8-7f6e-40ba-b6f9-d792f18e4dc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31de95cedba44c2d8e093f7843cca6c7', 'request_id': 'req-24a651e8-7f6e-40ba-b6f9-d792f18e4dc3'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:21.577058 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-24a651e8-7f6e-40ba-b6f9-d792f18e4dc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31de95cedba44c2d8e093f7843cca6c7', 'request_id': 'req-24a651e8-7f6e-40ba-b6f9-d792f18e4dc3'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:21.595292 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-24a651e8-7f6e-40ba-b6f9-d792f18e4dc3 admin admin] The token cache is being invalidate because project 31de95cedba44c2d8e093f7843cca6c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:39:21.595584 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-24a651e8-7f6e-40ba-b6f9-d792f18e4dc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:21.596341 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-24a651e8-7f6e-40ba-b6f9-d792f18e4dc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:21.597979 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1357/2686] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:39:21 2022] DELETE /identity/v3/projects/31de95cedba44c2d8e093f7843cca6c7 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:39:21.603083 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4963b609-2004-4815-977a-1e6682279f39 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:21.603592 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4963b609-2004-4815-977a-1e6682279f39 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:21.603695 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4963b609-2004-4815-977a-1e6682279f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:21.623945 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-4963b609-2004-4815-977a-1e6682279f39 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:39:21.625159 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4963b609-2004-4815-977a-1e6682279f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:39:21.672545 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:39:21.692751 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1330/2687] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:39:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:39:21.701230 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7bbdd-5c5c-4316-8a2e-ad41c1ec686a None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:21.701562 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7bbdd-5c5c-4316-8a2e-ad41c1ec686a None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:21.701842 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7bbdd-5c5c-4316-8a2e-ad41c1ec686a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:21.722152 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-faa7bbdd-5c5c-4316-8a2e-ad41c1ec686a None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:39:21.723424 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-faa7bbdd-5c5c-4316-8a2e-ad41c1ec686a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:39:21.731660 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1358/2688] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:39:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:39:21.735668 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4963b609-2004-4815-977a-1e6682279f39 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:21.745653 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4963b609-2004-4815-977a-1e6682279f39 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:21.751093 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445d7ba1-b381-4465-b5b3-eaea6c35eae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:21.751905 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d7ba1-b381-4465-b5b3-eaea6c35eae4 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:21.752200 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d7ba1-b381-4465-b5b3-eaea6c35eae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:21.752491 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d7ba1-b381-4465-b5b3-eaea6c35eae4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:21.753227 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445d7ba1-b381-4465-b5b3-eaea6c35eae4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:39:21.753569 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445d7ba1-b381-4465-b5b3-eaea6c35eae4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:21.755242 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445d7ba1-b381-4465-b5b3-eaea6c35eae4 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:21.768784 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1331/2689] 10.222.0.60 () {58 vars in 1152 bytes} [Sat Jul 2 03:39:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:39:21.773210 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7bbdd-5c5c-4316-8a2e-ad41c1ec686a None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:21.777683 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:39:21.788145 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7bbdd-5c5c-4316-8a2e-ad41c1ec686a None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:21.795234 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0aa916-cefa-480a-857a-d80bb606af31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:21.795929 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0aa916-cefa-480a-857a-d80bb606af31 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:21.796211 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0aa916-cefa-480a-857a-d80bb606af31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:21.796490 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0aa916-cefa-480a-857a-d80bb606af31 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:21.797271 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0aa916-cefa-480a-857a-d80bb606af31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:21.799338 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0aa916-cefa-480a-857a-d80bb606af31 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:21.825048 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1359/2690] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:39:21 2022] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:39:21.829091 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445d7ba1-b381-4465-b5b3-eaea6c35eae4 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:21.839149 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445d7ba1-b381-4465-b5b3-eaea6c35eae4 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:21.900734 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abddd9f-a98c-4ac8-b866-174b67015c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:21.901509 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abddd9f-a98c-4ac8-b866-174b67015c7b admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:21.901863 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abddd9f-a98c-4ac8-b866-174b67015c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:21.902263 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abddd9f-a98c-4ac8-b866-174b67015c7b admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:21.903165 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abddd9f-a98c-4ac8-b866-174b67015c7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:21.905524 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abddd9f-a98c-4ac8-b866-174b67015c7b admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:21.930640 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1332/2691] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:39:21 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 03:39:21.931949 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0aa916-cefa-480a-857a-d80bb606af31 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:21.943073 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0aa916-cefa-480a-857a-d80bb606af31 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:21.947853 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fadf27-1c43-48a1-a44f-80cf1da88a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:21.948545 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fadf27-1c43-48a1-a44f-80cf1da88a44 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:21.948828 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fadf27-1c43-48a1-a44f-80cf1da88a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:21.949102 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fadf27-1c43-48a1-a44f-80cf1da88a44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:21.949836 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fadf27-1c43-48a1-a44f-80cf1da88a44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:21.951661 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fadf27-1c43-48a1-a44f-80cf1da88a44 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:21.963896 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1360/2692] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:39:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:39:21.968012 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abddd9f-a98c-4ac8-b866-174b67015c7b admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:21.978527 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abddd9f-a98c-4ac8-b866-174b67015c7b admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:21.986238 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e2f59-21b9-489e-9950-b00b4e447123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:21.986999 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e2f59-21b9-489e-9950-b00b4e447123 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:21.987392 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e2f59-21b9-489e-9950-b00b4e447123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:21.987749 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e2f59-21b9-489e-9950-b00b4e447123 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:21.988540 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e2f59-21b9-489e-9950-b00b4e447123 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:21.990364 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e2f59-21b9-489e-9950-b00b4e447123 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:22.004358 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1333/2693] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:39:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:39:22.005490 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fadf27-1c43-48a1-a44f-80cf1da88a44 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:22.016081 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fadf27-1c43-48a1-a44f-80cf1da88a44 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:22.020874 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fddc29-89f4-44c7-92d2-b91ddefbe90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:22.021794 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fddc29-89f4-44c7-92d2-b91ddefbe90c admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:22.022072 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fddc29-89f4-44c7-92d2-b91ddefbe90c admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:22.022347 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fddc29-89f4-44c7-92d2-b91ddefbe90c admin admin] PATH_INFO: `/v3/projects/d3e8f2786b3648a38836bd2d38158a3c/users/97b70600fc3b4915874c7817d1850b48/roles/c43aada0326446c4ade0ab1262918fa4` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:22.039353 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fddc29-89f4-44c7-92d2-b91ddefbe90c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3e8f2786b3648a38836bd2d38158a3c, user_id=97b70600fc3b4915874c7817d1850b48, role_id=c43aada0326446c4ade0ab1262918fa4)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:22.042250 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fddc29-89f4-44c7-92d2-b91ddefbe90c admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:22.056250 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1361/2694] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:39:22 2022] PUT /identity/v3/projects/d3e8f2786b3648a38836bd2d38158a3c/users/97b70600fc3b4915874c7817d1850b48/roles/c43aada0326446c4ade0ab1262918fa4 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:39:22.067676 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec1a2c-83e1-424a-b202-f3a90558cef9 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:22.068058 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec1a2c-83e1-424a-b202-f3a90558cef9 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:22.068335 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec1a2c-83e1-424a-b202-f3a90558cef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:22.096099 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-92ec1a2c-83e1-424a-b202-f3a90558cef9 None None] MFA Rules not processed for user `97b70600fc3b4915874c7817d1850b48`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:39:22.097436 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-92ec1a2c-83e1-424a-b202-f3a90558cef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:39:22.165130 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1334/2695] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:39:22 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:39:22.169805 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fddc29-89f4-44c7-92d2-b91ddefbe90c admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:22.239615 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fddc29-89f4-44c7-92d2-b91ddefbe90c admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:22.244407 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547caefa-90c2-495f-b491-7abec1c5a795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:22.245092 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547caefa-90c2-495f-b491-7abec1c5a795 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:22.245377 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547caefa-90c2-495f-b491-7abec1c5a795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:22.245650 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547caefa-90c2-495f-b491-7abec1c5a795 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:22.246354 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547caefa-90c2-495f-b491-7abec1c5a795 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:22.248309 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547caefa-90c2-495f-b491-7abec1c5a795 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:22.280074 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1362/2696] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:39:22 2022] POST /identity/v3/projects => generated 375 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:39:22.283134 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ec1a2c-83e1-424a-b202-f3a90558cef9 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:22.294966 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ec1a2c-83e1-424a-b202-f3a90558cef9 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:22.343588 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:39:22.363872 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d313667-3c6a-45e7-b161-da6287869c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:22.364574 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d313667-3c6a-45e7-b161-da6287869c53 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:22.364862 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d313667-3c6a-45e7-b161-da6287869c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:22.365140 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d313667-3c6a-45e7-b161-da6287869c53 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:22.366062 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d313667-3c6a-45e7-b161-da6287869c53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:22.368090 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d313667-3c6a-45e7-b161-da6287869c53 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:22.394310 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1335/2697] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:39:22 2022] POST /identity/v3/users => generated 288 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:39:22.398558 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547caefa-90c2-495f-b491-7abec1c5a795 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:22.413069 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547caefa-90c2-495f-b491-7abec1c5a795 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:22.417958 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba2829-9bb0-4562-b705-b9962314d5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:22.418631 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba2829-9bb0-4562-b705-b9962314d5b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:22.418908 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba2829-9bb0-4562-b705-b9962314d5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:22.419421 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba2829-9bb0-4562-b705-b9962314d5b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:22.420175 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eba2829-9bb0-4562-b705-b9962314d5b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:22.422955 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eba2829-9bb0-4562-b705-b9962314d5b9 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:22.439747 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1363/2698] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:39:22.443988 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d313667-3c6a-45e7-b161-da6287869c53 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:22.455276 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d313667-3c6a-45e7-b161-da6287869c53 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:22.461096 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a551593b-49bf-4b7f-aee4-b65768e4c9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:22.461770 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a551593b-49bf-4b7f-aee4-b65768e4c9c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:22.462054 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a551593b-49bf-4b7f-aee4-b65768e4c9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:22.462324 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a551593b-49bf-4b7f-aee4-b65768e4c9c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:22.463065 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a551593b-49bf-4b7f-aee4-b65768e4c9c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:22.464760 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a551593b-49bf-4b7f-aee4-b65768e4c9c9 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:22.476872 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1336/2699] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:39:22.481527 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba2829-9bb0-4562-b705-b9962314d5b9 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:22.492121 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba2829-9bb0-4562-b705-b9962314d5b9 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:22.497285 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28527b36-81b2-4d50-89a2-a0cc7efb8b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:22.498228 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28527b36-81b2-4d50-89a2-a0cc7efb8b76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:22.498501 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28527b36-81b2-4d50-89a2-a0cc7efb8b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:22.498772 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28527b36-81b2-4d50-89a2-a0cc7efb8b76 admin admin] PATH_INFO: `/v3/projects/d18bd6880b19409ba89e0bc3e278a68b/users/bddc81fceb944ada8a3df4f874586b1d/roles/c43aada0326446c4ade0ab1262918fa4` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:22.514077 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28527b36-81b2-4d50-89a2-a0cc7efb8b76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d18bd6880b19409ba89e0bc3e278a68b, user_id=bddc81fceb944ada8a3df4f874586b1d, role_id=c43aada0326446c4ade0ab1262918fa4)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:22.516908 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28527b36-81b2-4d50-89a2-a0cc7efb8b76 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:22.536815 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1364/2700] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:39:22 2022] PUT /identity/v3/projects/d18bd6880b19409ba89e0bc3e278a68b/users/bddc81fceb944ada8a3df4f874586b1d/roles/c43aada0326446c4ade0ab1262918fa4 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 03:39:22.548223 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847182c-53ae-4359-abce-ee3995534caa None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:22.548496 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847182c-53ae-4359-abce-ee3995534caa None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:22.548767 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847182c-53ae-4359-abce-ee3995534caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:22.577358 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-c847182c-53ae-4359-abce-ee3995534caa None None] MFA Rules not processed for user `bddc81fceb944ada8a3df4f874586b1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:39:22.578724 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c847182c-53ae-4359-abce-ee3995534caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:39:22.650701 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1337/2701] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:39:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:39:22.655261 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28527b36-81b2-4d50-89a2-a0cc7efb8b76 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:22.717205 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:39:22.723733 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28527b36-81b2-4d50-89a2-a0cc7efb8b76 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:22.729381 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b966a0-78b8-4175-91ad-c6b259797c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:22.730042 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b966a0-78b8-4175-91ad-c6b259797c97 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:22.730322 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b966a0-78b8-4175-91ad-c6b259797c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:22.730593 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b966a0-78b8-4175-91ad-c6b259797c97 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:22.731326 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b966a0-78b8-4175-91ad-c6b259797c97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:22.733225 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b966a0-78b8-4175-91ad-c6b259797c97 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:22.760632 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1365/2702] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:39:22 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:39:22.765943 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847182c-53ae-4359-abce-ee3995534caa None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:22.776637 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847182c-53ae-4359-abce-ee3995534caa None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:22.833957 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e78c7d-21c1-408c-aaa6-7ae8c1f9198e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:22.834639 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e78c7d-21c1-408c-aaa6-7ae8c1f9198e admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:22.835035 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e78c7d-21c1-408c-aaa6-7ae8c1f9198e admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:22.835356 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e78c7d-21c1-408c-aaa6-7ae8c1f9198e admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:22.836205 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e78c7d-21c1-408c-aaa6-7ae8c1f9198e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:22.838183 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e78c7d-21c1-408c-aaa6-7ae8c1f9198e admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:22.860911 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1338/2703] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:39:22 2022] POST /identity/v3/users => generated 295 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:39:22.865358 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b966a0-78b8-4175-91ad-c6b259797c97 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:22.877094 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b966a0-78b8-4175-91ad-c6b259797c97 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:22.882604 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27175179-18e2-4bb4-9014-cf9a35209000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:22.883387 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27175179-18e2-4bb4-9014-cf9a35209000 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:22.883671 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27175179-18e2-4bb4-9014-cf9a35209000 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:22.883913 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27175179-18e2-4bb4-9014-cf9a35209000 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:22.884642 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27175179-18e2-4bb4-9014-cf9a35209000 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:22.886371 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27175179-18e2-4bb4-9014-cf9a35209000 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:22.899494 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1366/2704] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:39:22.903692 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e78c7d-21c1-408c-aaa6-7ae8c1f9198e admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:22.914644 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e78c7d-21c1-408c-aaa6-7ae8c1f9198e admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:22.920292 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de2fba8-9bb3-4266-b00a-0ce89b3b0f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:22.921425 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de2fba8-9bb3-4266-b00a-0ce89b3b0f95 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:22.921804 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de2fba8-9bb3-4266-b00a-0ce89b3b0f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:22.922212 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de2fba8-9bb3-4266-b00a-0ce89b3b0f95 admin admin] PATH_INFO: `/v3/projects/138f4468bce04dc49ebb5c3b065bea19/users/3c4aaa0310fe4624b633e1afdf57aa2e/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:22.940572 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de2fba8-9bb3-4266-b00a-0ce89b3b0f95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=138f4468bce04dc49ebb5c3b065bea19, user_id=3c4aaa0310fe4624b633e1afdf57aa2e, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:22.943687 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de2fba8-9bb3-4266-b00a-0ce89b3b0f95 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:22.958351 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1339/2705] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:39:22 2022] PUT /identity/v3/projects/138f4468bce04dc49ebb5c3b065bea19/users/3c4aaa0310fe4624b633e1afdf57aa2e/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:39:22.962664 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27175179-18e2-4bb4-9014-cf9a35209000 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:22.973476 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27175179-18e2-4bb4-9014-cf9a35209000 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:23.032524 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ba9bb1-1b0d-4b85-958c-5b5c736d90ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:23.033217 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba9bb1-1b0d-4b85-958c-5b5c736d90ba admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:23.033476 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba9bb1-1b0d-4b85-958c-5b5c736d90ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:23.033744 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba9bb1-1b0d-4b85-958c-5b5c736d90ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:23.034476 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ba9bb1-1b0d-4b85-958c-5b5c736d90ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:23.036519 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ba9bb1-1b0d-4b85-958c-5b5c736d90ba admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:23.046657 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1367/2706] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:39:23.050998 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de2fba8-9bb3-4266-b00a-0ce89b3b0f95 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:23.061838 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de2fba8-9bb3-4266-b00a-0ce89b3b0f95 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:23.067750 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76eff3b-f630-4252-8472-221ce8f10cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:23.068666 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76eff3b-f630-4252-8472-221ce8f10cfb admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:23.068921 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76eff3b-f630-4252-8472-221ce8f10cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:23.069193 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76eff3b-f630-4252-8472-221ce8f10cfb admin admin] PATH_INFO: `/v3/projects/138f4468bce04dc49ebb5c3b065bea19/users/3c4aaa0310fe4624b633e1afdf57aa2e/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:23.071250 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76eff3b-f630-4252-8472-221ce8f10cfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=138f4468bce04dc49ebb5c3b065bea19, user_id=3c4aaa0310fe4624b633e1afdf57aa2e, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:23.073900 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76eff3b-f630-4252-8472-221ce8f10cfb admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:23.089966 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1340/2707] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:39:23 2022] PUT /identity/v3/projects/138f4468bce04dc49ebb5c3b065bea19/users/3c4aaa0310fe4624b633e1afdf57aa2e/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:39:23.100573 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c0b1d-cefb-41ea-bdb4-7b3f2408869c None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:23.100874 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c0b1d-cefb-41ea-bdb4-7b3f2408869c None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:23.101146 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c0b1d-cefb-41ea-bdb4-7b3f2408869c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:23.129635 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-8c5c0b1d-cefb-41ea-bdb4-7b3f2408869c None None] MFA Rules not processed for user `3c4aaa0310fe4624b633e1afdf57aa2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:39:23.130872 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-8c5c0b1d-cefb-41ea-bdb4-7b3f2408869c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:39:23.212631 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1368/2708] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:39:23 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:39:23.224792 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76eff3b-f630-4252-8472-221ce8f10cfb admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:23.227065 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d76eff3b-f630-4252-8472-221ce8f10cfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:39:23.240010 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:39:23.290227 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76eff3b-f630-4252-8472-221ce8f10cfb admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:23.294285 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f696292b-335a-478b-a381-b29cc137846f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:23.294923 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f696292b-335a-478b-a381-b29cc137846f service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:23.295232 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f696292b-335a-478b-a381-b29cc137846f service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:23.295507 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f696292b-335a-478b-a381-b29cc137846f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:23.305175 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f696292b-335a-478b-a381-b29cc137846f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:23.306635 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f696292b-335a-478b-a381-b29cc137846f service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:23.316241 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1341/2709] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:39:23 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:39:23.363202 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c0b1d-cefb-41ea-bdb4-7b3f2408869c None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:23.364725 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-8c5c0b1d-cefb-41ea-bdb4-7b3f2408869c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:39:23.377929 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c0b1d-cefb-41ea-bdb4-7b3f2408869c None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:23.382585 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256b52fa-61c0-4ceb-89b7-42d8ea66836f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:23.383284 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b52fa-61c0-4ceb-89b7-42d8ea66836f service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:23.383566 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b52fa-61c0-4ceb-89b7-42d8ea66836f service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:23.383840 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b52fa-61c0-4ceb-89b7-42d8ea66836f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:23.434022 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:39:23.447269 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256b52fa-61c0-4ceb-89b7-42d8ea66836f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:23.448740 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256b52fa-61c0-4ceb-89b7-42d8ea66836f service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:23.458112 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1369/2710] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:39:23 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:39:26.373374 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f696292b-335a-478b-a381-b29cc137846f service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:26.441210 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f696292b-335a-478b-a381-b29cc137846f service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:26.446727 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f99722c-f406-4a23-a4e3-cf9d9c533256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:26.447632 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f99722c-f406-4a23-a4e3-cf9d9c533256 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:26.447906 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f99722c-f406-4a23-a4e3-cf9d9c533256 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:26.448184 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f99722c-f406-4a23-a4e3-cf9d9c533256 admin admin] PATH_INFO: `/v3/users/97b70600fc3b4915874c7817d1850b48` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:26.449461 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f99722c-f406-4a23-a4e3-cf9d9c533256 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97b70600fc3b4915874c7817d1850b48)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:26.451434 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f99722c-f406-4a23-a4e3-cf9d9c533256 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:26.507283 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3f99722c-f406-4a23-a4e3-cf9d9c533256 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97b70600fc3b4915874c7817d1850b48'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:26.507940 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3f99722c-f406-4a23-a4e3-cf9d9c533256 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97b70600fc3b4915874c7817d1850b48'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:26.508558 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3f99722c-f406-4a23-a4e3-cf9d9c533256 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97b70600fc3b4915874c7817d1850b48'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:26.521343 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3f99722c-f406-4a23-a4e3-cf9d9c533256 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97b70600fc3b4915874c7817d1850b48'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:26.528503 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3f99722c-f406-4a23-a4e3-cf9d9c533256 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97b70600fc3b4915874c7817d1850b48'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:26.542298 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1342/2711] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:39:26 2022] DELETE /identity/v3/users/97b70600fc3b4915874c7817d1850b48 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:39:26.547039 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8f98d-fc9a-45bf-b44d-290c2f4b254d None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:26.547549 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8f98d-fc9a-45bf-b44d-290c2f4b254d None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:26.547658 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8f98d-fc9a-45bf-b44d-290c2f4b254d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:26.566011 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-5ba8f98d-fc9a-45bf-b44d-290c2f4b254d None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:39:26.567272 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-5ba8f98d-fc9a-45bf-b44d-290c2f4b254d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:39:26.636369 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1370/2712] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:39:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:39:26.648118 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f99722c-f406-4a23-a4e3-cf9d9c533256 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:26.649763 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3f99722c-f406-4a23-a4e3-cf9d9c533256 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:39:26.683834 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:39:26.711000 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f99722c-f406-4a23-a4e3-cf9d9c533256 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:26.715545 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc7b415-efc2-4146-8150-0db9e2129363 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:26.716223 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7b415-efc2-4146-8150-0db9e2129363 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:26.716503 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7b415-efc2-4146-8150-0db9e2129363 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:26.716776 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7b415-efc2-4146-8150-0db9e2129363 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:26.727266 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc7b415-efc2-4146-8150-0db9e2129363 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:26.728911 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc7b415-efc2-4146-8150-0db9e2129363 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:26.739445 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1343/2713] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:39:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:39:26.815399 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba8f98d-fc9a-45bf-b44d-290c2f4b254d None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:26.816947 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-5ba8f98d-fc9a-45bf-b44d-290c2f4b254d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:39:26.830118 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba8f98d-fc9a-45bf-b44d-290c2f4b254d None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:26.835443 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b4b93-0988-4198-9f42-c87d6bd341d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:26.836367 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b4b93-0988-4198-9f42-c87d6bd341d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:26.836643 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b4b93-0988-4198-9f42-c87d6bd341d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:26.836910 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b4b93-0988-4198-9f42-c87d6bd341d6 admin admin] PATH_INFO: `/v3/users/2bd072a90c3b4cd6af559a1383470b35` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:26.838261 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115b4b93-0988-4198-9f42-c87d6bd341d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bd072a90c3b4cd6af559a1383470b35)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:26.840252 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115b4b93-0988-4198-9f42-c87d6bd341d6 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:26.891282 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-115b4b93-0988-4198-9f42-c87d6bd341d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bd072a90c3b4cd6af559a1383470b35'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:26.891985 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-115b4b93-0988-4198-9f42-c87d6bd341d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bd072a90c3b4cd6af559a1383470b35'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:26.906424 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-115b4b93-0988-4198-9f42-c87d6bd341d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bd072a90c3b4cd6af559a1383470b35'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:26.907260 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-115b4b93-0988-4198-9f42-c87d6bd341d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bd072a90c3b4cd6af559a1383470b35'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:26.920943 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-115b4b93-0988-4198-9f42-c87d6bd341d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bd072a90c3b4cd6af559a1383470b35'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:26.934170 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1371/2714] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:39:26 2022] DELETE /identity/v3/users/2bd072a90c3b4cd6af559a1383470b35 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:39:26.938992 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b59277-1435-4daf-9466-9e1c8ff9ecee None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:26.939344 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b59277-1435-4daf-9466-9e1c8ff9ecee None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:26.939625 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b59277-1435-4daf-9466-9e1c8ff9ecee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:26.957600 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-07b59277-1435-4daf-9466-9e1c8ff9ecee None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:39:26.958812 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-07b59277-1435-4daf-9466-9e1c8ff9ecee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:39:27.024233 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1344/2715] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:39:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:39:27.033210 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b4b93-0988-4198-9f42-c87d6bd341d6 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:27.035166 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-115b4b93-0988-4198-9f42-c87d6bd341d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:39:27.035803 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b59277-1435-4daf-9466-9e1c8ff9ecee None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:27.037493 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-07b59277-1435-4daf-9466-9e1c8ff9ecee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:39:27.060150 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b4b93-0988-4198-9f42-c87d6bd341d6 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:27.068427 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df19f0f-0360-4676-9f32-40c679aeb19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:27.069346 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df19f0f-0360-4676-9f32-40c679aeb19d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:27.069594 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df19f0f-0360-4676-9f32-40c679aeb19d admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:27.069933 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df19f0f-0360-4676-9f32-40c679aeb19d admin admin] PATH_INFO: `/v3/projects/d3e8f2786b3648a38836bd2d38158a3c` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:27.071359 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df19f0f-0360-4676-9f32-40c679aeb19d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3e8f2786b3648a38836bd2d38158a3c)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:27.073416 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df19f0f-0360-4676-9f32-40c679aeb19d admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:27.098657 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b59277-1435-4daf-9466-9e1c8ff9ecee None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:27.102760 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe8f4b4-e0e8-4abf-a087-0f55efb71fbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:27.103502 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe8f4b4-e0e8-4abf-a087-0f55efb71fbd service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:27.103819 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe8f4b4-e0e8-4abf-a087-0f55efb71fbd service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:27.104151 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe8f4b4-e0e8-4abf-a087-0f55efb71fbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:27.114236 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe8f4b4-e0e8-4abf-a087-0f55efb71fbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:27.115753 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe8f4b4-e0e8-4abf-a087-0f55efb71fbd service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:27.124054 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6df19f0f-0360-4676-9f32-40c679aeb19d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3e8f2786b3648a38836bd2d38158a3c', 'request_id': 'req-6df19f0f-0360-4676-9f32-40c679aeb19d'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:27.125993 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1345/2716] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:39:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:39:27.129410 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:39:27.130711 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6df19f0f-0360-4676-9f32-40c679aeb19d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3e8f2786b3648a38836bd2d38158a3c', 'request_id': 'req-6df19f0f-0360-4676-9f32-40c679aeb19d'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:27.138740 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6df19f0f-0360-4676-9f32-40c679aeb19d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3e8f2786b3648a38836bd2d38158a3c', 'request_id': 'req-6df19f0f-0360-4676-9f32-40c679aeb19d'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:27.152690 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6df19f0f-0360-4676-9f32-40c679aeb19d admin admin] The token cache is being invalidate because project d3e8f2786b3648a38836bd2d38158a3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:39:27.153081 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6df19f0f-0360-4676-9f32-40c679aeb19d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:27.153706 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6df19f0f-0360-4676-9f32-40c679aeb19d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:27.155368 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1372/2717] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:39:27 2022] DELETE /identity/v3/projects/d3e8f2786b3648a38836bd2d38158a3c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:39:27.159503 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe8f4b4-e0e8-4abf-a087-0f55efb71fbd service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:27.169773 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe8f4b4-e0e8-4abf-a087-0f55efb71fbd service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:27.239454 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582190ed-69fa-486f-9555-ad1473a7dac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:27.240347 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582190ed-69fa-486f-9555-ad1473a7dac1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:27.240627 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582190ed-69fa-486f-9555-ad1473a7dac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:27.240903 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582190ed-69fa-486f-9555-ad1473a7dac1 admin admin] PATH_INFO: `/v3/users/bddc81fceb944ada8a3df4f874586b1d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:27.242222 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582190ed-69fa-486f-9555-ad1473a7dac1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bddc81fceb944ada8a3df4f874586b1d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:27.244216 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582190ed-69fa-486f-9555-ad1473a7dac1 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:27.263182 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:39:27.304275 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-582190ed-69fa-486f-9555-ad1473a7dac1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bddc81fceb944ada8a3df4f874586b1d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:27.305026 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-582190ed-69fa-486f-9555-ad1473a7dac1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bddc81fceb944ada8a3df4f874586b1d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:27.305684 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-582190ed-69fa-486f-9555-ad1473a7dac1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bddc81fceb944ada8a3df4f874586b1d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:27.318695 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-582190ed-69fa-486f-9555-ad1473a7dac1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bddc81fceb944ada8a3df4f874586b1d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:27.326265 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-582190ed-69fa-486f-9555-ad1473a7dac1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bddc81fceb944ada8a3df4f874586b1d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:27.340103 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1346/2718] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:39:27 2022] DELETE /identity/v3/users/bddc81fceb944ada8a3df4f874586b1d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:39:27.418014 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df19f0f-0360-4676-9f32-40c679aeb19d admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:27.419506 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-6df19f0f-0360-4676-9f32-40c679aeb19d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:39:27.436286 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df19f0f-0360-4676-9f32-40c679aeb19d admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:27.495778 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e0d60-18d4-4482-8f39-4127376e7042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:27.496640 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e0d60-18d4-4482-8f39-4127376e7042 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:27.496920 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e0d60-18d4-4482-8f39-4127376e7042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:27.497185 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e0d60-18d4-4482-8f39-4127376e7042 admin admin] PATH_INFO: `/v3/projects/e33c6d6e92994964b727f7f62e7cfc1c` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:27.498436 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86e0d60-18d4-4482-8f39-4127376e7042 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e33c6d6e92994964b727f7f62e7cfc1c)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:27.500876 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86e0d60-18d4-4482-8f39-4127376e7042 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:27.550683 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-f86e0d60-18d4-4482-8f39-4127376e7042 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e33c6d6e92994964b727f7f62e7cfc1c', 'request_id': 'req-f86e0d60-18d4-4482-8f39-4127376e7042'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:27.556641 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-f86e0d60-18d4-4482-8f39-4127376e7042 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e33c6d6e92994964b727f7f62e7cfc1c', 'request_id': 'req-f86e0d60-18d4-4482-8f39-4127376e7042'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:27.562931 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-f86e0d60-18d4-4482-8f39-4127376e7042 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e33c6d6e92994964b727f7f62e7cfc1c', 'request_id': 'req-f86e0d60-18d4-4482-8f39-4127376e7042'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:27.577385 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-f86e0d60-18d4-4482-8f39-4127376e7042 admin admin] The token cache is being invalidate because project e33c6d6e92994964b727f7f62e7cfc1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:39:27.577671 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-f86e0d60-18d4-4482-8f39-4127376e7042 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:27.578406 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-f86e0d60-18d4-4482-8f39-4127376e7042 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:27.580310 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1373/2719] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:39:27 2022] DELETE /identity/v3/projects/e33c6d6e92994964b727f7f62e7cfc1c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 03:39:27.629566 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582190ed-69fa-486f-9555-ad1473a7dac1 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:27.631105 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-582190ed-69fa-486f-9555-ad1473a7dac1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:39:27.645999 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582190ed-69fa-486f-9555-ad1473a7dac1 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:27.708207 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6059dc15-672f-4f7d-b063-5eacb0309224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:27.709073 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6059dc15-672f-4f7d-b063-5eacb0309224 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:27.709349 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6059dc15-672f-4f7d-b063-5eacb0309224 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:27.709644 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6059dc15-672f-4f7d-b063-5eacb0309224 admin admin] PATH_INFO: `/v3/projects/d18bd6880b19409ba89e0bc3e278a68b` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:27.710805 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6059dc15-672f-4f7d-b063-5eacb0309224 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d18bd6880b19409ba89e0bc3e278a68b)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:27.712761 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6059dc15-672f-4f7d-b063-5eacb0309224 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:27.767061 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6059dc15-672f-4f7d-b063-5eacb0309224 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd18bd6880b19409ba89e0bc3e278a68b', 'request_id': 'req-6059dc15-672f-4f7d-b063-5eacb0309224'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:27.773374 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6059dc15-672f-4f7d-b063-5eacb0309224 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd18bd6880b19409ba89e0bc3e278a68b', 'request_id': 'req-6059dc15-672f-4f7d-b063-5eacb0309224'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:27.782792 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6059dc15-672f-4f7d-b063-5eacb0309224 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd18bd6880b19409ba89e0bc3e278a68b', 'request_id': 'req-6059dc15-672f-4f7d-b063-5eacb0309224'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:27.795876 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6059dc15-672f-4f7d-b063-5eacb0309224 admin admin] The token cache is being invalidate because project d18bd6880b19409ba89e0bc3e278a68b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:39:27.796440 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6059dc15-672f-4f7d-b063-5eacb0309224 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:27.797120 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6059dc15-672f-4f7d-b063-5eacb0309224 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:27.798788 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1347/2720] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:39:27 2022] DELETE /identity/v3/projects/d18bd6880b19409ba89e0bc3e278a68b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 03:39:27.802936 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e0d60-18d4-4482-8f39-4127376e7042 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:27.804339 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-f86e0d60-18d4-4482-8f39-4127376e7042 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:39:27.817315 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e0d60-18d4-4482-8f39-4127376e7042 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:27.874068 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3077e61c-72b8-43af-a926-a20a11e64d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:27.874932 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077e61c-72b8-43af-a926-a20a11e64d3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:27.875247 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077e61c-72b8-43af-a926-a20a11e64d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:27.875516 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077e61c-72b8-43af-a926-a20a11e64d3d admin admin] PATH_INFO: `/v3/users/3c4aaa0310fe4624b633e1afdf57aa2e` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:27.876713 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3077e61c-72b8-43af-a926-a20a11e64d3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c4aaa0310fe4624b633e1afdf57aa2e)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:27.878612 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3077e61c-72b8-43af-a926-a20a11e64d3d admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:27.898668 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:39:27.934316 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-3077e61c-72b8-43af-a926-a20a11e64d3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c4aaa0310fe4624b633e1afdf57aa2e'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:27.935052 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-3077e61c-72b8-43af-a926-a20a11e64d3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c4aaa0310fe4624b633e1afdf57aa2e'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:27.944226 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-3077e61c-72b8-43af-a926-a20a11e64d3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c4aaa0310fe4624b633e1afdf57aa2e'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:27.944856 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-3077e61c-72b8-43af-a926-a20a11e64d3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c4aaa0310fe4624b633e1afdf57aa2e'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:27.958629 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-3077e61c-72b8-43af-a926-a20a11e64d3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c4aaa0310fe4624b633e1afdf57aa2e'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:27.972087 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1374/2721] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:39:27 2022] DELETE /identity/v3/users/3c4aaa0310fe4624b633e1afdf57aa2e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:39:28.259971 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6059dc15-672f-4f7d-b063-5eacb0309224 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:28.261609 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-6059dc15-672f-4f7d-b063-5eacb0309224 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:39:28.275157 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6059dc15-672f-4f7d-b063-5eacb0309224 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:28.297204 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:39:28.336029 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caf9f87-9a98-4a6f-8428-080c069ff253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:28.336842 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf9f87-9a98-4a6f-8428-080c069ff253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:28.337124 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf9f87-9a98-4a6f-8428-080c069ff253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:28.337399 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf9f87-9a98-4a6f-8428-080c069ff253 admin admin] PATH_INFO: `/v3/projects/138f4468bce04dc49ebb5c3b065bea19` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:28.338724 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caf9f87-9a98-4a6f-8428-080c069ff253 admin admin] RBAC: Authorizing `identity:delete_project(project_id=138f4468bce04dc49ebb5c3b065bea19)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:28.340707 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caf9f87-9a98-4a6f-8428-080c069ff253 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:28.399469 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6caf9f87-9a98-4a6f-8428-080c069ff253 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '138f4468bce04dc49ebb5c3b065bea19', 'request_id': 'req-6caf9f87-9a98-4a6f-8428-080c069ff253'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:28.405083 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6caf9f87-9a98-4a6f-8428-080c069ff253 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '138f4468bce04dc49ebb5c3b065bea19', 'request_id': 'req-6caf9f87-9a98-4a6f-8428-080c069ff253'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:28.413887 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6caf9f87-9a98-4a6f-8428-080c069ff253 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '138f4468bce04dc49ebb5c3b065bea19', 'request_id': 'req-6caf9f87-9a98-4a6f-8428-080c069ff253'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:28.427457 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6caf9f87-9a98-4a6f-8428-080c069ff253 admin admin] The token cache is being invalidate because project 138f4468bce04dc49ebb5c3b065bea19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:39:28.427983 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6caf9f87-9a98-4a6f-8428-080c069ff253 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:28.429017 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6caf9f87-9a98-4a6f-8428-080c069ff253 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:39:28.430895 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1348/2722] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:39:28 2022] DELETE /identity/v3/projects/138f4468bce04dc49ebb5c3b065bea19 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:39:28.440051 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae51cf-49f8-4654-a7c1-7d74d73f7f1a None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:28.440335 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae51cf-49f8-4654-a7c1-7d74d73f7f1a None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:28.440645 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae51cf-49f8-4654-a7c1-7d74d73f7f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:28.460957 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-c8ae51cf-49f8-4654-a7c1-7d74d73f7f1a None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:39:28.462209 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-c8ae51cf-49f8-4654-a7c1-7d74d73f7f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:39:28.526459 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1375/2723] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:39:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:39:28.537500 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a889724-69ea-40d5-aa32-79508591db53 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:28.537791 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a889724-69ea-40d5-aa32-79508591db53 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:28.538079 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a889724-69ea-40d5-aa32-79508591db53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:28.560821 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-6a889724-69ea-40d5-aa32-79508591db53 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:39:28.562089 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-6a889724-69ea-40d5-aa32-79508591db53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:39:28.570584 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1349/2724] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:39:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:39:28.574924 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae51cf-49f8-4654-a7c1-7d74d73f7f1a None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:28.584867 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae51cf-49f8-4654-a7c1-7d74d73f7f1a None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:28.590176 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fb801a-87c6-4732-a5d1-bbcd024d0445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:28.590747 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb801a-87c6-4732-a5d1-bbcd024d0445 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:28.591030 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb801a-87c6-4732-a5d1-bbcd024d0445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:28.591345 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb801a-87c6-4732-a5d1-bbcd024d0445 admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:28.592075 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fb801a-87c6-4732-a5d1-bbcd024d0445 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:39:28.592385 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fb801a-87c6-4732-a5d1-bbcd024d0445 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:28.593984 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fb801a-87c6-4732-a5d1-bbcd024d0445 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:28.605638 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1376/2725] 10.222.0.60 () {58 vars in 1152 bytes} [Sat Jul 2 03:39:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:39:28.610700 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a889724-69ea-40d5-aa32-79508591db53 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:28.620536 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a889724-69ea-40d5-aa32-79508591db53 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:28.626647 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a24002-6b4b-413b-9de0-8b38d5851a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:28.627330 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a24002-6b4b-413b-9de0-8b38d5851a2a admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:28.627613 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a24002-6b4b-413b-9de0-8b38d5851a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:28.627886 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a24002-6b4b-413b-9de0-8b38d5851a2a admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:28.628575 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a24002-6b4b-413b-9de0-8b38d5851a2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:28.630492 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a24002-6b4b-413b-9de0-8b38d5851a2a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:28.660289 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1350/2726] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:39:28 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:39:28.663835 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fb801a-87c6-4732-a5d1-bbcd024d0445 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:28.674014 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fb801a-87c6-4732-a5d1-bbcd024d0445 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:28.730952 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fcee43-dfd5-4fec-aecf-732214744f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:28.731644 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fcee43-dfd5-4fec-aecf-732214744f01 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:28.731916 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fcee43-dfd5-4fec-aecf-732214744f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:28.732167 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fcee43-dfd5-4fec-aecf-732214744f01 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:28.732875 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fcee43-dfd5-4fec-aecf-732214744f01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:28.734795 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fcee43-dfd5-4fec-aecf-732214744f01 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:28.756152 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1377/2727] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:39:28 2022] POST /identity/v3/users => generated 286 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:39:28.760694 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a24002-6b4b-413b-9de0-8b38d5851a2a admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:28.771164 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a24002-6b4b-413b-9de0-8b38d5851a2a admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:28.776190 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b958164b-0f0f-4f31-9616-db282e5da350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:28.776837 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b958164b-0f0f-4f31-9616-db282e5da350 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:28.777119 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b958164b-0f0f-4f31-9616-db282e5da350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:28.777393 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b958164b-0f0f-4f31-9616-db282e5da350 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:28.778122 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b958164b-0f0f-4f31-9616-db282e5da350 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:28.779767 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b958164b-0f0f-4f31-9616-db282e5da350 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:28.790510 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1351/2728] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 03:39:28.794386 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fcee43-dfd5-4fec-aecf-732214744f01 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:28.804596 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fcee43-dfd5-4fec-aecf-732214744f01 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:28.809477 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c3c346-b471-4b45-bcb9-120b5ad7d825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:28.810204 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c3c346-b471-4b45-bcb9-120b5ad7d825 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:28.810484 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c3c346-b471-4b45-bcb9-120b5ad7d825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:28.810757 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c3c346-b471-4b45-bcb9-120b5ad7d825 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:28.811541 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c3c346-b471-4b45-bcb9-120b5ad7d825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:28.813235 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c3c346-b471-4b45-bcb9-120b5ad7d825 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:28.818664 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:39:28.824807 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1378/2729] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:39:28.829244 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b958164b-0f0f-4f31-9616-db282e5da350 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:28.839766 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b958164b-0f0f-4f31-9616-db282e5da350 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:28.845100 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f471c-b18f-439f-ba4c-42fbf72ec538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:28.846014 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f471c-b18f-439f-ba4c-42fbf72ec538 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:28.846296 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f471c-b18f-439f-ba4c-42fbf72ec538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:28.846572 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f471c-b18f-439f-ba4c-42fbf72ec538 admin admin] PATH_INFO: `/v3/projects/8e6948635dfe406396024bf6c763b207/users/ec799bf599f84e34a211e54fad6301af/roles/c43aada0326446c4ade0ab1262918fa4` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:28.860926 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3f471c-b18f-439f-ba4c-42fbf72ec538 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e6948635dfe406396024bf6c763b207, user_id=ec799bf599f84e34a211e54fad6301af, role_id=c43aada0326446c4ade0ab1262918fa4)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:28.863628 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3f471c-b18f-439f-ba4c-42fbf72ec538 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:28.879316 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1352/2730] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:39:28 2022] PUT /identity/v3/projects/8e6948635dfe406396024bf6c763b207/users/ec799bf599f84e34a211e54fad6301af/roles/c43aada0326446c4ade0ab1262918fa4 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:39:28.884402 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71158a57-c22b-4d7c-bb4d-09a3ef066676 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:28.884708 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71158a57-c22b-4d7c-bb4d-09a3ef066676 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:28.884984 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71158a57-c22b-4d7c-bb4d-09a3ef066676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:28.902489 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-71158a57-c22b-4d7c-bb4d-09a3ef066676 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:39:28.903718 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-71158a57-c22b-4d7c-bb4d-09a3ef066676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:39:28.970477 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1379/2731] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:39:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 03:39:28.980071 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f471c-b18f-439f-ba4c-42fbf72ec538 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:28.981843 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-be3f471c-b18f-439f-ba4c-42fbf72ec538 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:39:29.041049 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f471c-b18f-439f-ba4c-42fbf72ec538 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:29.045352 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aad7b04-ea8c-4f14-9222-9e2fc74491c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:29.046023 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad7b04-ea8c-4f14-9222-9e2fc74491c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:29.046301 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad7b04-ea8c-4f14-9222-9e2fc74491c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:29.046578 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad7b04-ea8c-4f14-9222-9e2fc74491c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:29.053031 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:39:29.056988 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aad7b04-ea8c-4f14-9222-9e2fc74491c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:29.058972 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aad7b04-ea8c-4f14-9222-9e2fc74491c9 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:29.069212 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1353/2732] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:39:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:39:29.733719 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d378fe1-7ec3-4262-835d-4c61e7d6b7a3 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:29.734259 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d378fe1-7ec3-4262-835d-4c61e7d6b7a3 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:29.734259 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d378fe1-7ec3-4262-835d-4c61e7d6b7a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:29.761694 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-1d378fe1-7ec3-4262-835d-4c61e7d6b7a3 None None] MFA Rules not processed for user `ec799bf599f84e34a211e54fad6301af`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:39:29.762930 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-1d378fe1-7ec3-4262-835d-4c61e7d6b7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:39:29.834876 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1380/2733] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:39:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:39:29.846406 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aad7b04-ea8c-4f14-9222-9e2fc74491c9 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:29.847993 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0aad7b04-ea8c-4f14-9222-9e2fc74491c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:39:29.909104 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aad7b04-ea8c-4f14-9222-9e2fc74491c9 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:29.913454 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aef65a-7750-4cd7-9418-7584a91d7820 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:29.914100 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aef65a-7750-4cd7-9418-7584a91d7820 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:29.914378 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aef65a-7750-4cd7-9418-7584a91d7820 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:29.914643 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aef65a-7750-4cd7-9418-7584a91d7820 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:29.923987 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aef65a-7750-4cd7-9418-7584a91d7820 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:29.925440 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aef65a-7750-4cd7-9418-7584a91d7820 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:29.934537 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1354/2734] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:39:29 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:39:31.305288 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c200e65-301b-4606-b501-e839fb2b0e15 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:31.305819 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c200e65-301b-4606-b501-e839fb2b0e15 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:31.305917 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c200e65-301b-4606-b501-e839fb2b0e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:31.333182 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-2c200e65-301b-4606-b501-e839fb2b0e15 None None] MFA Rules not processed for user `ec799bf599f84e34a211e54fad6301af`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:39:31.334390 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-2c200e65-301b-4606-b501-e839fb2b0e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:39:31.342223 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1381/2735] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:39:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:39:39.195428 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aef65a-7750-4cd7-9418-7584a91d7820 service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:39.196907 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-89aef65a-7750-4cd7-9418-7584a91d7820 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:39:39.209080 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aef65a-7750-4cd7-9418-7584a91d7820 service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:39.213169 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5261e1c2-b3e2-4872-87c8-bd36a8ca0d6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:39.213960 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5261e1c2-b3e2-4872-87c8-bd36a8ca0d6f service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:39.214299 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5261e1c2-b3e2-4872-87c8-bd36a8ca0d6f service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:39.214679 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5261e1c2-b3e2-4872-87c8-bd36a8ca0d6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:39.216513 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5261e1c2-b3e2-4872-87c8-bd36a8ca0d6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:39:39.295968 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5261e1c2-b3e2-4872-87c8-bd36a8ca0d6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:39.297412 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5261e1c2-b3e2-4872-87c8-bd36a8ca0d6f service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:39.308672 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1355/2736] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:39:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:39:40.508181 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c200e65-301b-4606-b501-e839fb2b0e15 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:39:40.523224 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c200e65-301b-4606-b501-e839fb2b0e15 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:39:40.528161 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990ca604-7ba3-4e22-9ff4-a39e368d71b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:39:40.529169 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ca604-7ba3-4e22-9ff4-a39e368d71b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:40.529620 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ca604-7ba3-4e22-9ff4-a39e368d71b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:40.529914 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ca604-7ba3-4e22-9ff4-a39e368d71b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:40.533407 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-990ca604-7ba3-4e22-9ff4-a39e368d71b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:39:40.551592 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990ca604-7ba3-4e22-9ff4-a39e368d71b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:39:40.553004 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990ca604-7ba3-4e22-9ff4-a39e368d71b2 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:39:40.564825 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1382/2737] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:39:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:39:45.943111 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b1244-1eb6-4f0b-94e1-4cff247dff1b None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:39:45.943631 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b1244-1eb6-4f0b-94e1-4cff247dff1b None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:39:45.943729 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b1244-1eb6-4f0b-94e1-4cff247dff1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:39:45.962166 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-3f9b1244-1eb6-4f0b-94e1-4cff247dff1b None None] MFA Rules not processed for user `ec799bf599f84e34a211e54fad6301af`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:39:45.963438 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3f9b1244-1eb6-4f0b-94e1-4cff247dff1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:39:45.971512 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1356/2738] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:39:45 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:39:50.559447 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=68 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:39:55.956517 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=66 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:40:03.356937 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef01688-2576-4090-b287-c56c5de5aedd None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:03.357539 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef01688-2576-4090-b287-c56c5de5aedd None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:03.357701 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef01688-2576-4090-b287-c56c5de5aedd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:03.377699 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-1ef01688-2576-4090-b287-c56c5de5aedd None None] MFA Rules not processed for user `3333e7495b9546d882e2a2211ff8875c`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:40:03.379177 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-1ef01688-2576-4090-b287-c56c5de5aedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:40:03.447077 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1383/2739] 10.222.0.60 () {58 vars in 1009 bytes} [Sat Jul 2 03:40:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:40:03.498708 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b1244-1eb6-4f0b-94e1-4cff247dff1b None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:03.500307 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3f9b1244-1eb6-4f0b-94e1-4cff247dff1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:40:03.575311 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b1244-1eb6-4f0b-94e1-4cff247dff1b None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:03.580466 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1cad23-fa99-4b35-87b5-4c55029062c1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '692ec343bf9f4339ba691440f55a6c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:03.581133 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1cad23-fa99-4b35-87b5-4c55029062c1 service swift] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:03.581413 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1cad23-fa99-4b35-87b5-4c55029062c1 service swift] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:03.581683 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1cad23-fa99-4b35-87b5-4c55029062c1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:03.590083 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1cad23-fa99-4b35-87b5-4c55029062c1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:03.591803 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1cad23-fa99-4b35-87b5-4c55029062c1 service swift] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:03.600533 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1357/2740] 10.222.0.60 () {60 vars in 1384 bytes} [Sat Jul 2 03:40:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 03:40:07.563235 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef01688-2576-4090-b287-c56c5de5aedd None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:07.574397 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef01688-2576-4090-b287-c56c5de5aedd None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:07.578599 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a52162e-47a2-4f25-9ad4-41620c6633f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:07.579316 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52162e-47a2-4f25-9ad4-41620c6633f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:07.579599 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52162e-47a2-4f25-9ad4-41620c6633f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:07.579872 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52162e-47a2-4f25-9ad4-41620c6633f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:07.581671 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-6a52162e-47a2-4f25-9ad4-41620c6633f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:40:07.596037 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a52162e-47a2-4f25-9ad4-41620c6633f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:07.597553 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a52162e-47a2-4f25-9ad4-41620c6633f7 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:07.619423 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1384/2741] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:40:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:40:11.153189 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1cad23-fa99-4b35-87b5-4c55029062c1 service swift] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:11.156832 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-fc1cad23-fa99-4b35-87b5-4c55029062c1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:40:11.175747 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1cad23-fa99-4b35-87b5-4c55029062c1 service swift] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:11.181300 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01986953-c3ad-4ce5-9afd-a9a1f6cea09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:11.182198 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01986953-c3ad-4ce5-9afd-a9a1f6cea09a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:11.182479 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01986953-c3ad-4ce5-9afd-a9a1f6cea09a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:11.182754 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01986953-c3ad-4ce5-9afd-a9a1f6cea09a admin admin] PATH_INFO: `/v3/users/c42a4b22cda34bb68980388f63e822cb` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:11.184021 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01986953-c3ad-4ce5-9afd-a9a1f6cea09a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c42a4b22cda34bb68980388f63e822cb)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:11.186328 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01986953-c3ad-4ce5-9afd-a9a1f6cea09a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:11.242379 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-01986953-c3ad-4ce5-9afd-a9a1f6cea09a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c42a4b22cda34bb68980388f63e822cb'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:11.243596 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-01986953-c3ad-4ce5-9afd-a9a1f6cea09a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c42a4b22cda34bb68980388f63e822cb'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:11.244566 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-01986953-c3ad-4ce5-9afd-a9a1f6cea09a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c42a4b22cda34bb68980388f63e822cb'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:11.260329 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-01986953-c3ad-4ce5-9afd-a9a1f6cea09a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c42a4b22cda34bb68980388f63e822cb'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:11.269001 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-01986953-c3ad-4ce5-9afd-a9a1f6cea09a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c42a4b22cda34bb68980388f63e822cb'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:11.299592 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1358/2742] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:40:11 2022] DELETE /identity/v3/users/c42a4b22cda34bb68980388f63e822cb => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:40:11.529615 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a52162e-47a2-4f25-9ad4-41620c6633f7 service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:11.545470 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a52162e-47a2-4f25-9ad4-41620c6633f7 service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:11.618969 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f98e898-1e34-40c2-af46-d2fe9afa364b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:11.620324 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98e898-1e34-40c2-af46-d2fe9afa364b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:11.620687 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98e898-1e34-40c2-af46-d2fe9afa364b admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:11.621018 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98e898-1e34-40c2-af46-d2fe9afa364b admin admin] PATH_INFO: `/v3/projects/5c0462adc09d489ca2b9e816d1ce3c54` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:11.622364 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f98e898-1e34-40c2-af46-d2fe9afa364b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c0462adc09d489ca2b9e816d1ce3c54)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:11.624557 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f98e898-1e34-40c2-af46-d2fe9afa364b admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:11.678345 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-3f98e898-1e34-40c2-af46-d2fe9afa364b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c0462adc09d489ca2b9e816d1ce3c54', 'request_id': 'req-3f98e898-1e34-40c2-af46-d2fe9afa364b'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:11.685700 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-3f98e898-1e34-40c2-af46-d2fe9afa364b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c0462adc09d489ca2b9e816d1ce3c54', 'request_id': 'req-3f98e898-1e34-40c2-af46-d2fe9afa364b'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:11.693648 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-3f98e898-1e34-40c2-af46-d2fe9afa364b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c0462adc09d489ca2b9e816d1ce3c54', 'request_id': 'req-3f98e898-1e34-40c2-af46-d2fe9afa364b'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:11.711746 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-3f98e898-1e34-40c2-af46-d2fe9afa364b admin admin] The token cache is being invalidate because project 5c0462adc09d489ca2b9e816d1ce3c54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:40:11.712108 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-3f98e898-1e34-40c2-af46-d2fe9afa364b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:11.713081 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-3f98e898-1e34-40c2-af46-d2fe9afa364b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:11.714996 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1385/2743] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:40:11 2022] DELETE /identity/v3/projects/5c0462adc09d489ca2b9e816d1ce3c54 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:40:11.720810 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42fd938-0796-468a-ada1-a36744a435bf None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:11.721222 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42fd938-0796-468a-ada1-a36744a435bf None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:11.721665 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42fd938-0796-468a-ada1-a36744a435bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:11.747921 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-d42fd938-0796-468a-ada1-a36744a435bf None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:40:11.749300 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d42fd938-0796-468a-ada1-a36744a435bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:40:11.828545 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1359/2744] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:40:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:40:11.830629 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c926688-f730-4424-8d71-d9b1f4f33c73 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:11.830988 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c926688-f730-4424-8d71-d9b1f4f33c73 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:11.831385 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c926688-f730-4424-8d71-d9b1f4f33c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:11.851541 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-2c926688-f730-4424-8d71-d9b1f4f33c73 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:40:11.853138 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-2c926688-f730-4424-8d71-d9b1f4f33c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:40:11.862409 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1386/2745] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:40:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:40:11.866562 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42fd938-0796-468a-ada1-a36744a435bf None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:11.874538 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:40:11.886360 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42fd938-0796-468a-ada1-a36744a435bf None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:11.892371 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2073c04-ff2e-4393-bf52-063db1c762a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:11.893059 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2073c04-ff2e-4393-bf52-063db1c762a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:11.893333 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2073c04-ff2e-4393-bf52-063db1c762a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:11.893601 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2073c04-ff2e-4393-bf52-063db1c762a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:11.894338 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2073c04-ff2e-4393-bf52-063db1c762a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:40:11.894642 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2073c04-ff2e-4393-bf52-063db1c762a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:11.896462 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2073c04-ff2e-4393-bf52-063db1c762a8 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:11.914252 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1360/2746] 10.222.0.60 () {58 vars in 1152 bytes} [Sat Jul 2 03:40:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:40:11.915855 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c926688-f730-4424-8d71-d9b1f4f33c73 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:11.929668 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c926688-f730-4424-8d71-d9b1f4f33c73 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:11.935279 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e021a1-bdd6-461a-b472-5433064c3c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:11.935942 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e021a1-bdd6-461a-b472-5433064c3c6a admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:11.936225 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e021a1-bdd6-461a-b472-5433064c3c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:11.936502 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e021a1-bdd6-461a-b472-5433064c3c6a admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:11.937200 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e021a1-bdd6-461a-b472-5433064c3c6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:11.939133 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e021a1-bdd6-461a-b472-5433064c3c6a admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:11.956979 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:40:11.976020 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1387/2747] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:40:11 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:40:11.980450 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2073c04-ff2e-4393-bf52-063db1c762a8 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:11.995159 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2073c04-ff2e-4393-bf52-063db1c762a8 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:12.054540 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ba61a-c3be-4fa9-80fb-649f90a952fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:12.055268 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ba61a-c3be-4fa9-80fb-649f90a952fb admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:12.055556 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ba61a-c3be-4fa9-80fb-649f90a952fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:12.055832 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ba61a-c3be-4fa9-80fb-649f90a952fb admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:12.056565 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2ba61a-c3be-4fa9-80fb-649f90a952fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:12.058546 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2ba61a-c3be-4fa9-80fb-649f90a952fb admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:12.081502 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1361/2748] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:40:11 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:40:12.085857 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e021a1-bdd6-461a-b472-5433064c3c6a admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:12.101468 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e021a1-bdd6-461a-b472-5433064c3c6a admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:12.107055 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722f929-31d8-4eb5-8df8-0b6c7a0ea68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:12.107818 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722f929-31d8-4eb5-8df8-0b6c7a0ea68b admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:12.108098 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722f929-31d8-4eb5-8df8-0b6c7a0ea68b admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:12.108366 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722f929-31d8-4eb5-8df8-0b6c7a0ea68b admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:12.109147 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6722f929-31d8-4eb5-8df8-0b6c7a0ea68b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:12.110826 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6722f929-31d8-4eb5-8df8-0b6c7a0ea68b admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:12.125969 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1388/2749] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:40:12 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 03:40:12.129982 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ba61a-c3be-4fa9-80fb-649f90a952fb admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:12.141499 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ba61a-c3be-4fa9-80fb-649f90a952fb admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:12.147037 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f72ec5-8b07-4214-aaf8-3a0e3bcad56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:12.147780 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f72ec5-8b07-4214-aaf8-3a0e3bcad56f admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:12.148060 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f72ec5-8b07-4214-aaf8-3a0e3bcad56f admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:12.148335 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f72ec5-8b07-4214-aaf8-3a0e3bcad56f admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:12.149098 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f72ec5-8b07-4214-aaf8-3a0e3bcad56f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:12.150747 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f72ec5-8b07-4214-aaf8-3a0e3bcad56f admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:12.166436 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1362/2750] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:40:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:40:12.167688 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722f929-31d8-4eb5-8df8-0b6c7a0ea68b admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:12.178574 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722f929-31d8-4eb5-8df8-0b6c7a0ea68b admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:12.185865 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb4115-d167-4a71-b3ae-dd548dac78b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:12.186818 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb4115-d167-4a71-b3ae-dd548dac78b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:12.187092 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb4115-d167-4a71-b3ae-dd548dac78b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:12.187413 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb4115-d167-4a71-b3ae-dd548dac78b8 admin admin] PATH_INFO: `/v3/projects/32b1efaf5b514a19829b20e2970789d8/users/43c52839d35d407c975052040eb822c7/roles/c43aada0326446c4ade0ab1262918fa4` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:12.205022 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecb4115-d167-4a71-b3ae-dd548dac78b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32b1efaf5b514a19829b20e2970789d8, user_id=43c52839d35d407c975052040eb822c7, role_id=c43aada0326446c4ade0ab1262918fa4)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:12.207730 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecb4115-d167-4a71-b3ae-dd548dac78b8 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:12.222930 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1389/2751] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:40:12 2022] PUT /identity/v3/projects/32b1efaf5b514a19829b20e2970789d8/users/43c52839d35d407c975052040eb822c7/roles/c43aada0326446c4ade0ab1262918fa4 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:40:12.233623 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e4497-5e47-44f8-9e08-3e3965f386c8 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:12.233920 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e4497-5e47-44f8-9e08-3e3965f386c8 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:12.234189 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e4497-5e47-44f8-9e08-3e3965f386c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:12.283016 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-9e8e4497-5e47-44f8-9e08-3e3965f386c8 None None] MFA Rules not processed for user `43c52839d35d407c975052040eb822c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:40:12.284428 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9e8e4497-5e47-44f8-9e08-3e3965f386c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:40:12.352128 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1363/2752] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:40:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:40:12.356845 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb4115-d167-4a71-b3ae-dd548dac78b8 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:12.427809 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb4115-d167-4a71-b3ae-dd548dac78b8 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:12.433348 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378e3287-e3bc-4dc1-bec9-b4b40a9c59bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:12.434011 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e3287-e3bc-4dc1-bec9-b4b40a9c59bd admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:12.434293 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e3287-e3bc-4dc1-bec9-b4b40a9c59bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:12.434567 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e3287-e3bc-4dc1-bec9-b4b40a9c59bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:12.435322 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378e3287-e3bc-4dc1-bec9-b4b40a9c59bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:12.437254 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378e3287-e3bc-4dc1-bec9-b4b40a9c59bd admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:12.471356 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1390/2753] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:40:12 2022] POST /identity/v3/projects => generated 373 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:40:12.472920 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8e4497-5e47-44f8-9e08-3e3965f386c8 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:12.485114 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8e4497-5e47-44f8-9e08-3e3965f386c8 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:12.539718 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:40:12.547499 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7f86a6-2d34-4195-9d01-9c19310ce804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:12.548416 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7f86a6-2d34-4195-9d01-9c19310ce804 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:12.548868 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7f86a6-2d34-4195-9d01-9c19310ce804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:12.549228 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7f86a6-2d34-4195-9d01-9c19310ce804 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:12.550019 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7f86a6-2d34-4195-9d01-9c19310ce804 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:12.552249 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7f86a6-2d34-4195-9d01-9c19310ce804 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:12.577455 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1364/2754] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:40:12 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:40:12.578882 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378e3287-e3bc-4dc1-bec9-b4b40a9c59bd admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:12.592274 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378e3287-e3bc-4dc1-bec9-b4b40a9c59bd admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:12.598445 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f926c2ef-3281-49a7-9ad9-632e43b88930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:12.599470 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f926c2ef-3281-49a7-9ad9-632e43b88930 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:12.599752 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f926c2ef-3281-49a7-9ad9-632e43b88930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:12.600179 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f926c2ef-3281-49a7-9ad9-632e43b88930 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:12.600919 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f926c2ef-3281-49a7-9ad9-632e43b88930 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:12.602741 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f926c2ef-3281-49a7-9ad9-632e43b88930 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:12.618240 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1391/2755] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:40:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:40:12.619743 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7f86a6-2d34-4195-9d01-9c19310ce804 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:12.630582 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7f86a6-2d34-4195-9d01-9c19310ce804 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:12.635617 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d20483-4dd1-4e26-af59-2b414045302f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:12.636504 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d20483-4dd1-4e26-af59-2b414045302f admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:12.636783 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d20483-4dd1-4e26-af59-2b414045302f admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:12.637057 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d20483-4dd1-4e26-af59-2b414045302f admin admin] PATH_INFO: `/v3/projects/145ba0401a4d48c0a667cbf60a551a45/users/21a6ab3e108f4baa9fad26adcf3ddd57/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:12.658915 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d20483-4dd1-4e26-af59-2b414045302f admin admin] RBAC: Authorizing `identity:create_grant(project_id=145ba0401a4d48c0a667cbf60a551a45, user_id=21a6ab3e108f4baa9fad26adcf3ddd57, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:12.662848 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d20483-4dd1-4e26-af59-2b414045302f admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:12.684321 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1365/2756] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:40:12 2022] PUT /identity/v3/projects/145ba0401a4d48c0a667cbf60a551a45/users/21a6ab3e108f4baa9fad26adcf3ddd57/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:40:12.688280 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f926c2ef-3281-49a7-9ad9-632e43b88930 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:12.699236 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f926c2ef-3281-49a7-9ad9-632e43b88930 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:12.766363 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3865811-6b81-44f9-80c6-a3c63e6a6b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:12.767175 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3865811-6b81-44f9-80c6-a3c63e6a6b06 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:12.767566 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3865811-6b81-44f9-80c6-a3c63e6a6b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:12.767942 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3865811-6b81-44f9-80c6-a3c63e6a6b06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:12.768942 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3865811-6b81-44f9-80c6-a3c63e6a6b06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:12.770793 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3865811-6b81-44f9-80c6-a3c63e6a6b06 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:12.783160 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1392/2757] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:40:12 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:40:12.787829 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d20483-4dd1-4e26-af59-2b414045302f admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:12.799059 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d20483-4dd1-4e26-af59-2b414045302f admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:12.804707 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221f2128-d110-4d39-9b34-9886e77ee785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:12.805987 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f2128-d110-4d39-9b34-9886e77ee785 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:12.806503 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f2128-d110-4d39-9b34-9886e77ee785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:12.806884 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f2128-d110-4d39-9b34-9886e77ee785 admin admin] PATH_INFO: `/v3/projects/145ba0401a4d48c0a667cbf60a551a45/users/21a6ab3e108f4baa9fad26adcf3ddd57/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:12.809047 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221f2128-d110-4d39-9b34-9886e77ee785 admin admin] RBAC: Authorizing `identity:create_grant(project_id=145ba0401a4d48c0a667cbf60a551a45, user_id=21a6ab3e108f4baa9fad26adcf3ddd57, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:12.812119 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221f2128-d110-4d39-9b34-9886e77ee785 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:12.825210 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1366/2758] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:40:12 2022] PUT /identity/v3/projects/145ba0401a4d48c0a667cbf60a551a45/users/21a6ab3e108f4baa9fad26adcf3ddd57/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:40:12.839194 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4dbc6c-1e32-44c1-bed9-0d298ce9958e None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:12.839559 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4dbc6c-1e32-44c1-bed9-0d298ce9958e None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:12.840037 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4dbc6c-1e32-44c1-bed9-0d298ce9958e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:12.876894 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-3c4dbc6c-1e32-44c1-bed9-0d298ce9958e None None] MFA Rules not processed for user `21a6ab3e108f4baa9fad26adcf3ddd57`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:40:12.878138 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-3c4dbc6c-1e32-44c1-bed9-0d298ce9958e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:40:12.901000 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:40:12.973172 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1393/2759] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:40:12 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:40:12.981045 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221f2128-d110-4d39-9b34-9886e77ee785 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:12.982848 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-221f2128-d110-4d39-9b34-9886e77ee785 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:40:13.051812 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221f2128-d110-4d39-9b34-9886e77ee785 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:13.055564 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9307aa-98ce-463e-8ccc-5eb278068c79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:13.056221 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9307aa-98ce-463e-8ccc-5eb278068c79 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:13.056504 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9307aa-98ce-463e-8ccc-5eb278068c79 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:13.056776 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9307aa-98ce-463e-8ccc-5eb278068c79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:13.070428 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9307aa-98ce-463e-8ccc-5eb278068c79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:13.071954 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9307aa-98ce-463e-8ccc-5eb278068c79 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:13.082556 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1367/2760] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:40:12 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:40:13.169258 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4dbc6c-1e32-44c1-bed9-0d298ce9958e None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:13.180720 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4dbc6c-1e32-44c1-bed9-0d298ce9958e None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:13.184528 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0872d3d5-39a1-43a8-b13e-198530c9594f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:13.185405 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0872d3d5-39a1-43a8-b13e-198530c9594f service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:13.185754 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0872d3d5-39a1-43a8-b13e-198530c9594f service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:13.186086 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0872d3d5-39a1-43a8-b13e-198530c9594f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:13.253116 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0872d3d5-39a1-43a8-b13e-198530c9594f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:13.254578 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0872d3d5-39a1-43a8-b13e-198530c9594f service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:13.267657 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1394/2761] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:40:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:40:19.023809 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334052b5-4b3a-4182-8487-0bfc2f2af867 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:19.024355 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334052b5-4b3a-4182-8487-0bfc2f2af867 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:19.024355 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334052b5-4b3a-4182-8487-0bfc2f2af867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:19.043323 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-334052b5-4b3a-4182-8487-0bfc2f2af867 None None] MFA Rules not processed for user `3333e7495b9546d882e2a2211ff8875c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:40:19.044533 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-334052b5-4b3a-4182-8487-0bfc2f2af867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:40:19.100582 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1368/2762] 10.222.0.60 () {58 vars in 967 bytes} [Sat Jul 2 03:40:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:40:19.113184 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0872d3d5-39a1-43a8-b13e-198530c9594f service cinder] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:19.114703 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-0872d3d5-39a1-43a8-b13e-198530c9594f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:40:19.189996 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0872d3d5-39a1-43a8-b13e-198530c9594f service cinder] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:19.195086 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae44b1-6d4b-4e1c-a666-ce165936e264 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '692ec343bf9f4339ba691440f55a6c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:19.195763 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae44b1-6d4b-4e1c-a666-ce165936e264 service swift] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:19.196047 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae44b1-6d4b-4e1c-a666-ce165936e264 service swift] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:19.196319 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae44b1-6d4b-4e1c-a666-ce165936e264 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:19.204574 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ae44b1-6d4b-4e1c-a666-ce165936e264 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:19.206220 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ae44b1-6d4b-4e1c-a666-ce165936e264 service swift] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:19.217445 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1395/2763] 10.222.0.60 () {60 vars in 1384 bytes} [Sat Jul 2 03:40:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 03:40:21.186652 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334052b5-4b3a-4182-8487-0bfc2f2af867 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:21.188170 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-334052b5-4b3a-4182-8487-0bfc2f2af867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:40:21.252473 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:40:21.257036 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334052b5-4b3a-4182-8487-0bfc2f2af867 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:21.262513 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e940ee35-57e7-460d-97cb-f08c1640c552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:21.263415 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e940ee35-57e7-460d-97cb-f08c1640c552 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:21.263799 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e940ee35-57e7-460d-97cb-f08c1640c552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:21.264080 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e940ee35-57e7-460d-97cb-f08c1640c552 admin admin] PATH_INFO: `/v3/users/ec799bf599f84e34a211e54fad6301af` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:21.265312 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e940ee35-57e7-460d-97cb-f08c1640c552 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec799bf599f84e34a211e54fad6301af)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:21.267302 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e940ee35-57e7-460d-97cb-f08c1640c552 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:21.314277 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e940ee35-57e7-460d-97cb-f08c1640c552 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec799bf599f84e34a211e54fad6301af'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:21.314937 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e940ee35-57e7-460d-97cb-f08c1640c552 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec799bf599f84e34a211e54fad6301af'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:21.315579 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e940ee35-57e7-460d-97cb-f08c1640c552 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec799bf599f84e34a211e54fad6301af'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:21.327195 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e940ee35-57e7-460d-97cb-f08c1640c552 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec799bf599f84e34a211e54fad6301af'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:21.334227 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e940ee35-57e7-460d-97cb-f08c1640c552 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec799bf599f84e34a211e54fad6301af'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:21.349043 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1369/2764] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:40:21 2022] DELETE /identity/v3/users/ec799bf599f84e34a211e54fad6301af => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:40:21.539561 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae44b1-6d4b-4e1c-a666-ce165936e264 service swift] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:21.551704 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae44b1-6d4b-4e1c-a666-ce165936e264 service swift] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:21.596192 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:40:21.614284 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db4305e-f2a4-43e6-a7bb-e511e631e230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:21.615141 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4305e-f2a4-43e6-a7bb-e511e631e230 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:21.615454 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4305e-f2a4-43e6-a7bb-e511e631e230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:21.615722 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4305e-f2a4-43e6-a7bb-e511e631e230 admin admin] PATH_INFO: `/v3/projects/8e6948635dfe406396024bf6c763b207` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:21.616997 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db4305e-f2a4-43e6-a7bb-e511e631e230 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e6948635dfe406396024bf6c763b207)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:21.618911 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db4305e-f2a4-43e6-a7bb-e511e631e230 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:21.667344 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6db4305e-f2a4-43e6-a7bb-e511e631e230 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e6948635dfe406396024bf6c763b207', 'request_id': 'req-6db4305e-f2a4-43e6-a7bb-e511e631e230'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:21.673345 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6db4305e-f2a4-43e6-a7bb-e511e631e230 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e6948635dfe406396024bf6c763b207', 'request_id': 'req-6db4305e-f2a4-43e6-a7bb-e511e631e230'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:21.679715 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6db4305e-f2a4-43e6-a7bb-e511e631e230 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e6948635dfe406396024bf6c763b207', 'request_id': 'req-6db4305e-f2a4-43e6-a7bb-e511e631e230'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:21.694553 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6db4305e-f2a4-43e6-a7bb-e511e631e230 admin admin] The token cache is being invalidate because project 8e6948635dfe406396024bf6c763b207 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:40:21.694830 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6db4305e-f2a4-43e6-a7bb-e511e631e230 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:21.695495 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6db4305e-f2a4-43e6-a7bb-e511e631e230 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:21.697080 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1396/2765] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:40:21 2022] DELETE /identity/v3/projects/8e6948635dfe406396024bf6c763b207 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:40:21.703932 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33174006-3bf4-4cf1-bf82-8a8d509c32a0 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:21.704218 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33174006-3bf4-4cf1-bf82-8a8d509c32a0 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:21.704501 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33174006-3bf4-4cf1-bf82-8a8d509c32a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:21.722787 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-33174006-3bf4-4cf1-bf82-8a8d509c32a0 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:40:21.724005 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-33174006-3bf4-4cf1-bf82-8a8d509c32a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:40:21.787136 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1370/2766] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:40:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:40:21.795523 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc89e428-a38f-4a5a-a89b-4f1fb5005177 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:21.795839 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc89e428-a38f-4a5a-a89b-4f1fb5005177 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:21.796111 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc89e428-a38f-4a5a-a89b-4f1fb5005177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:21.815771 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-cc89e428-a38f-4a5a-a89b-4f1fb5005177 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:40:21.817088 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-cc89e428-a38f-4a5a-a89b-4f1fb5005177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:40:21.825241 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1397/2767] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:40:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:40:21.829821 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33174006-3bf4-4cf1-bf82-8a8d509c32a0 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:21.839889 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33174006-3bf4-4cf1-bf82-8a8d509c32a0 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:21.844384 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e8ee6-c16a-45f7-859b-758e63f2aea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:21.845029 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e8ee6-c16a-45f7-859b-758e63f2aea1 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:21.845332 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e8ee6-c16a-45f7-859b-758e63f2aea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:21.845625 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e8ee6-c16a-45f7-859b-758e63f2aea1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:21.846341 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971e8ee6-c16a-45f7-859b-758e63f2aea1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:40:21.846754 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971e8ee6-c16a-45f7-859b-758e63f2aea1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:21.848418 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971e8ee6-c16a-45f7-859b-758e63f2aea1 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:21.862747 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1371/2768] 10.222.0.60 () {58 vars in 1152 bytes} [Sat Jul 2 03:40:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:40:21.867522 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc89e428-a38f-4a5a-a89b-4f1fb5005177 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:21.878002 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc89e428-a38f-4a5a-a89b-4f1fb5005177 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:21.883363 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dec544-1c86-460f-b941-589e270d5b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:21.884026 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dec544-1c86-460f-b941-589e270d5b1c admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:21.884302 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dec544-1c86-460f-b941-589e270d5b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:21.884576 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dec544-1c86-460f-b941-589e270d5b1c admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:21.885301 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dec544-1c86-460f-b941-589e270d5b1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:21.887201 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dec544-1c86-460f-b941-589e270d5b1c admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:21.922332 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1398/2769] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:40:21 2022] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:40:21.927209 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e8ee6-c16a-45f7-859b-758e63f2aea1 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:21.937628 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e8ee6-c16a-45f7-859b-758e63f2aea1 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:21.997472 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e0f008-70ca-471b-b9ea-5a9ea72e4386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:21.998060 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0f008-70ca-471b-b9ea-5a9ea72e4386 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:21.998349 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0f008-70ca-471b-b9ea-5a9ea72e4386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:21.998627 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0f008-70ca-471b-b9ea-5a9ea72e4386 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:21.999380 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e0f008-70ca-471b-b9ea-5a9ea72e4386 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:22.001625 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e0f008-70ca-471b-b9ea-5a9ea72e4386 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:22.011031 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:40:22.027834 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1372/2770] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:40:21 2022] POST /identity/v3/users => generated 286 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:40:22.029064 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dec544-1c86-460f-b941-589e270d5b1c admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:22.042103 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dec544-1c86-460f-b941-589e270d5b1c admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:22.047884 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207ab4e1-22c0-4e03-b242-95f8c51b7e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:22.048550 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ab4e1-22c0-4e03-b242-95f8c51b7e31 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:22.048835 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ab4e1-22c0-4e03-b242-95f8c51b7e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:22.049104 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ab4e1-22c0-4e03-b242-95f8c51b7e31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:22.049865 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207ab4e1-22c0-4e03-b242-95f8c51b7e31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:22.051489 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207ab4e1-22c0-4e03-b242-95f8c51b7e31 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:22.065234 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1399/2771] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:40:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:40:22.066429 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e0f008-70ca-471b-b9ea-5a9ea72e4386 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:22.076581 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e0f008-70ca-471b-b9ea-5a9ea72e4386 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:22.081688 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc510a79-0ced-4acc-a046-9c95f387db0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:22.082345 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc510a79-0ced-4acc-a046-9c95f387db0d admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:22.082620 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc510a79-0ced-4acc-a046-9c95f387db0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:22.082889 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc510a79-0ced-4acc-a046-9c95f387db0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:22.083641 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc510a79-0ced-4acc-a046-9c95f387db0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:22.085234 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc510a79-0ced-4acc-a046-9c95f387db0d admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:22.095779 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1373/2772] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:40:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:40:22.100108 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207ab4e1-22c0-4e03-b242-95f8c51b7e31 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:22.110184 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207ab4e1-22c0-4e03-b242-95f8c51b7e31 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:22.114727 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d884de-f781-4f38-a39d-8028814b196a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:22.115626 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d884de-f781-4f38-a39d-8028814b196a admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:22.115904 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d884de-f781-4f38-a39d-8028814b196a admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:22.116177 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d884de-f781-4f38-a39d-8028814b196a admin admin] PATH_INFO: `/v3/projects/ab3f20a5fe2f46bf9f25e6356294a1a4/users/7fcec66a9e6e4c4588e993be55dc1a2f/roles/c43aada0326446c4ade0ab1262918fa4` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:22.132373 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d884de-f781-4f38-a39d-8028814b196a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab3f20a5fe2f46bf9f25e6356294a1a4, user_id=7fcec66a9e6e4c4588e993be55dc1a2f, role_id=c43aada0326446c4ade0ab1262918fa4)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:22.135231 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d884de-f781-4f38-a39d-8028814b196a admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:22.153020 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1400/2773] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:40:22 2022] PUT /identity/v3/projects/ab3f20a5fe2f46bf9f25e6356294a1a4/users/7fcec66a9e6e4c4588e993be55dc1a2f/roles/c43aada0326446c4ade0ab1262918fa4 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 03:40:22.223357 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38fb9f9-245c-4503-92a2-0c164452168d None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:22.223890 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38fb9f9-245c-4503-92a2-0c164452168d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:22.223890 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38fb9f9-245c-4503-92a2-0c164452168d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:22.257700 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-a38fb9f9-245c-4503-92a2-0c164452168d None None] MFA Rules not processed for user `7fcec66a9e6e4c4588e993be55dc1a2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:40:22.259063 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a38fb9f9-245c-4503-92a2-0c164452168d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:40:22.328654 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1374/2774] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:40:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 03:40:22.340325 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d884de-f781-4f38-a39d-8028814b196a admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:22.342450 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-d3d884de-f781-4f38-a39d-8028814b196a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:40:22.402869 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d884de-f781-4f38-a39d-8028814b196a admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:22.407551 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f437acf8-7cd0-446f-aec9-fad3cb8ae443 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:22.408212 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437acf8-7cd0-446f-aec9-fad3cb8ae443 service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:22.408487 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437acf8-7cd0-446f-aec9-fad3cb8ae443 service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:22.408760 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437acf8-7cd0-446f-aec9-fad3cb8ae443 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:22.418041 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f437acf8-7cd0-446f-aec9-fad3cb8ae443 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:22.419506 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f437acf8-7cd0-446f-aec9-fad3cb8ae443 service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:22.428507 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1401/2775] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:40:22 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:40:22.453783 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38fb9f9-245c-4503-92a2-0c164452168d None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:22.528541 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38fb9f9-245c-4503-92a2-0c164452168d None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:22.533990 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cec748-de77-4287-b329-5d79ec771c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:22.535056 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cec748-de77-4287-b329-5d79ec771c53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:22.535491 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cec748-de77-4287-b329-5d79ec771c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:22.536179 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cec748-de77-4287-b329-5d79ec771c53 admin admin] PATH_INFO: `/v3/users/7fcec66a9e6e4c4588e993be55dc1a2f` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:22.537641 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cec748-de77-4287-b329-5d79ec771c53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fcec66a9e6e4c4588e993be55dc1a2f)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:22.539769 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cec748-de77-4287-b329-5d79ec771c53 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:22.593993 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-01cec748-de77-4287-b329-5d79ec771c53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fcec66a9e6e4c4588e993be55dc1a2f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:22.594637 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-01cec748-de77-4287-b329-5d79ec771c53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fcec66a9e6e4c4588e993be55dc1a2f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:22.595267 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-01cec748-de77-4287-b329-5d79ec771c53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fcec66a9e6e4c4588e993be55dc1a2f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:22.607959 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-01cec748-de77-4287-b329-5d79ec771c53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fcec66a9e6e4c4588e993be55dc1a2f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:22.614910 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-01cec748-de77-4287-b329-5d79ec771c53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fcec66a9e6e4c4588e993be55dc1a2f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:22.616710 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:INSERT=1,keystone:SELECT=90,keystone:DELETE=9 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:40:22.631727 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1375/2776] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:40:22 2022] DELETE /identity/v3/users/7fcec66a9e6e4c4588e993be55dc1a2f => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:40:22.636317 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8bf454-698a-4e71-8d73-d62253ddb1a2 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:22.636839 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8bf454-698a-4e71-8d73-d62253ddb1a2 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:22.636947 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8bf454-698a-4e71-8d73-d62253ddb1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:22.654127 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-7d8bf454-698a-4e71-8d73-d62253ddb1a2 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:40:22.655407 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-7d8bf454-698a-4e71-8d73-d62253ddb1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:40:22.661275 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:40:22.721101 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1402/2777] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:40:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 03:40:22.730976 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cec748-de77-4287-b329-5d79ec771c53 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:22.732556 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-01cec748-de77-4287-b329-5d79ec771c53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:40:22.793920 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cec748-de77-4287-b329-5d79ec771c53 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:22.798196 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c42c0c1-cabb-4ced-8850-cdec1c2e02eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:22.798843 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42c0c1-cabb-4ced-8850-cdec1c2e02eb service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:22.799147 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42c0c1-cabb-4ced-8850-cdec1c2e02eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:22.799440 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42c0c1-cabb-4ced-8850-cdec1c2e02eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:22.809692 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c42c0c1-cabb-4ced-8850-cdec1c2e02eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:22.811269 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c42c0c1-cabb-4ced-8850-cdec1c2e02eb service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:22.821383 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1376/2778] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:40:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:40:23.114709 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8bf454-698a-4e71-8d73-d62253ddb1a2 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:23.116378 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-7d8bf454-698a-4e71-8d73-d62253ddb1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:40:23.129398 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8bf454-698a-4e71-8d73-d62253ddb1a2 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:23.134612 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd492153-91e8-4f96-b152-0248e0d91c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:23.135546 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd492153-91e8-4f96-b152-0248e0d91c30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:23.135825 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd492153-91e8-4f96-b152-0248e0d91c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:23.136097 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd492153-91e8-4f96-b152-0248e0d91c30 admin admin] PATH_INFO: `/v3/projects/ab3f20a5fe2f46bf9f25e6356294a1a4` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:23.137954 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd492153-91e8-4f96-b152-0248e0d91c30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab3f20a5fe2f46bf9f25e6356294a1a4)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:23.139506 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd492153-91e8-4f96-b152-0248e0d91c30 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:23.198001 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-fd492153-91e8-4f96-b152-0248e0d91c30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab3f20a5fe2f46bf9f25e6356294a1a4', 'request_id': 'req-fd492153-91e8-4f96-b152-0248e0d91c30'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:23.207980 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-fd492153-91e8-4f96-b152-0248e0d91c30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab3f20a5fe2f46bf9f25e6356294a1a4', 'request_id': 'req-fd492153-91e8-4f96-b152-0248e0d91c30'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:23.215003 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-fd492153-91e8-4f96-b152-0248e0d91c30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab3f20a5fe2f46bf9f25e6356294a1a4', 'request_id': 'req-fd492153-91e8-4f96-b152-0248e0d91c30'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:23.229498 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-fd492153-91e8-4f96-b152-0248e0d91c30 admin admin] The token cache is being invalidate because project ab3f20a5fe2f46bf9f25e6356294a1a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:40:23.229786 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-fd492153-91e8-4f96-b152-0248e0d91c30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:23.230405 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-fd492153-91e8-4f96-b152-0248e0d91c30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:23.232585 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1403/2779] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:40:23 2022] DELETE /identity/v3/projects/ab3f20a5fe2f46bf9f25e6356294a1a4 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:40:23.237760 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0d748-c172-4ba5-ac39-17a11a4cbc8a None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:23.238308 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0d748-c172-4ba5-ac39-17a11a4cbc8a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:23.238308 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0d748-c172-4ba5-ac39-17a11a4cbc8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:23.257681 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-dcb0d748-c172-4ba5-ac39-17a11a4cbc8a None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:40:23.258893 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-dcb0d748-c172-4ba5-ac39-17a11a4cbc8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:40:23.321159 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1377/2780] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:40:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 03:40:23.329958 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6679e05e-8fc0-4875-89c1-7093e8815718 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:23.329958 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6679e05e-8fc0-4875-89c1-7093e8815718 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:23.329958 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6679e05e-8fc0-4875-89c1-7093e8815718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:23.350024 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-6679e05e-8fc0-4875-89c1-7093e8815718 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:40:23.351400 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-6679e05e-8fc0-4875-89c1-7093e8815718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:40:23.363479 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1404/2781] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:40:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:40:23.364739 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb0d748-c172-4ba5-ac39-17a11a4cbc8a None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:23.379104 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb0d748-c172-4ba5-ac39-17a11a4cbc8a None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:23.384154 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17118794-4f93-43f9-834f-0592adfdae50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:23.384854 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17118794-4f93-43f9-834f-0592adfdae50 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:23.385142 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17118794-4f93-43f9-834f-0592adfdae50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:23.385420 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17118794-4f93-43f9-834f-0592adfdae50 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:23.386165 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17118794-4f93-43f9-834f-0592adfdae50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:40:23.386474 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17118794-4f93-43f9-834f-0592adfdae50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:23.388157 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17118794-4f93-43f9-834f-0592adfdae50 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:23.400188 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1378/2782] 10.222.0.60 () {58 vars in 1152 bytes} [Sat Jul 2 03:40:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:40:23.405119 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6679e05e-8fc0-4875-89c1-7093e8815718 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:23.415770 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6679e05e-8fc0-4875-89c1-7093e8815718 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:23.421344 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587f9560-a82a-4d47-9c69-1bc0689eed9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:23.421995 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f9560-a82a-4d47-9c69-1bc0689eed9d admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:23.422274 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f9560-a82a-4d47-9c69-1bc0689eed9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:23.422544 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f9560-a82a-4d47-9c69-1bc0689eed9d admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:23.423268 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587f9560-a82a-4d47-9c69-1bc0689eed9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:23.425164 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587f9560-a82a-4d47-9c69-1bc0689eed9d admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:23.453180 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1405/2783] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:40:23 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:40:23.457352 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17118794-4f93-43f9-834f-0592adfdae50 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:23.467978 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17118794-4f93-43f9-834f-0592adfdae50 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:23.525089 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9aece-5410-4d3e-81ad-4c64d2001a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:23.525758 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9aece-5410-4d3e-81ad-4c64d2001a3d admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:23.526029 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9aece-5410-4d3e-81ad-4c64d2001a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:23.526288 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9aece-5410-4d3e-81ad-4c64d2001a3d admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:23.526979 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af9aece-5410-4d3e-81ad-4c64d2001a3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:23.528945 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af9aece-5410-4d3e-81ad-4c64d2001a3d admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:23.553445 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1379/2784] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:40:23 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:40:23.557919 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587f9560-a82a-4d47-9c69-1bc0689eed9d admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:23.568843 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587f9560-a82a-4d47-9c69-1bc0689eed9d admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:23.574802 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bfbcc7-998e-4dcd-b689-fb10fe53c646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:23.575416 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bfbcc7-998e-4dcd-b689-fb10fe53c646 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:23.575690 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bfbcc7-998e-4dcd-b689-fb10fe53c646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:23.575981 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bfbcc7-998e-4dcd-b689-fb10fe53c646 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:23.576700 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bfbcc7-998e-4dcd-b689-fb10fe53c646 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:23.578326 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bfbcc7-998e-4dcd-b689-fb10fe53c646 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:23.589515 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1406/2785] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:40:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:40:23.593724 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9aece-5410-4d3e-81ad-4c64d2001a3d admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:23.604121 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9aece-5410-4d3e-81ad-4c64d2001a3d admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:23.609196 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4f14a4-9aaa-4329-9a48-ea5bf6713fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:23.609856 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f14a4-9aaa-4329-9a48-ea5bf6713fea admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:23.610134 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f14a4-9aaa-4329-9a48-ea5bf6713fea admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:23.610400 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f14a4-9aaa-4329-9a48-ea5bf6713fea admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:23.611141 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4f14a4-9aaa-4329-9a48-ea5bf6713fea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:23.612747 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4f14a4-9aaa-4329-9a48-ea5bf6713fea admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:23.618050 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:40:23.624507 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1380/2786] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:40:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:40:23.629416 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bfbcc7-998e-4dcd-b689-fb10fe53c646 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:23.640258 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bfbcc7-998e-4dcd-b689-fb10fe53c646 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:23.645822 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cca82d3-12b0-42f3-8b67-e39c63069778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:23.646729 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca82d3-12b0-42f3-8b67-e39c63069778 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:23.647015 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca82d3-12b0-42f3-8b67-e39c63069778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:23.647317 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca82d3-12b0-42f3-8b67-e39c63069778 admin admin] PATH_INFO: `/v3/projects/133ac514bbe14f1c9409c37b321bb68d/users/089580e581824803aeb276a0e51df138/roles/c43aada0326446c4ade0ab1262918fa4` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:23.663213 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cca82d3-12b0-42f3-8b67-e39c63069778 admin admin] RBAC: Authorizing `identity:create_grant(project_id=133ac514bbe14f1c9409c37b321bb68d, user_id=089580e581824803aeb276a0e51df138, role_id=c43aada0326446c4ade0ab1262918fa4)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:23.665845 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cca82d3-12b0-42f3-8b67-e39c63069778 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:23.681145 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1407/2787] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:40:23 2022] PUT /identity/v3/projects/133ac514bbe14f1c9409c37b321bb68d/users/089580e581824803aeb276a0e51df138/roles/c43aada0326446c4ade0ab1262918fa4 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:40:23.686398 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c1a61-769c-4d4f-a312-b273a73b3f94 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:23.686845 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c1a61-769c-4d4f-a312-b273a73b3f94 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:23.687156 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c1a61-769c-4d4f-a312-b273a73b3f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:23.704996 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-786c1a61-769c-4d4f-a312-b273a73b3f94 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:40:23.706335 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-786c1a61-769c-4d4f-a312-b273a73b3f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:40:23.768084 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1381/2788] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:40:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:40:23.778473 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cca82d3-12b0-42f3-8b67-e39c63069778 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:23.781084 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-7cca82d3-12b0-42f3-8b67-e39c63069778 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:40:23.816440 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:40:23.841280 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cca82d3-12b0-42f3-8b67-e39c63069778 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:23.845927 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856adc2b-cb20-4fe8-8c64-1f349ebea3ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:23.846571 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856adc2b-cb20-4fe8-8c64-1f349ebea3ca service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:23.846859 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856adc2b-cb20-4fe8-8c64-1f349ebea3ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:23.847156 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856adc2b-cb20-4fe8-8c64-1f349ebea3ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:23.857456 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856adc2b-cb20-4fe8-8c64-1f349ebea3ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:23.858911 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856adc2b-cb20-4fe8-8c64-1f349ebea3ca service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:23.868987 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1408/2789] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:40:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:40:28.034911 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bcb054-7b5c-4a10-b7ff-e8f08a07245b None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:28.035465 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bcb054-7b5c-4a10-b7ff-e8f08a07245b None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:28.035566 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bcb054-7b5c-4a10-b7ff-e8f08a07245b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:28.065921 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-e9bcb054-7b5c-4a10-b7ff-e8f08a07245b None None] MFA Rules not processed for user `089580e581824803aeb276a0e51df138`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:40:28.067318 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e9bcb054-7b5c-4a10-b7ff-e8f08a07245b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:40:28.133485 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1382/2790] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:40:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:40:28.138027 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856adc2b-cb20-4fe8-8c64-1f349ebea3ca service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:28.148378 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856adc2b-cb20-4fe8-8c64-1f349ebea3ca service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:28.153056 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e3d9e-18af-48f1-91d8-1d4f3b2806f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:28.153807 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e3d9e-18af-48f1-91d8-1d4f3b2806f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:28.154146 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e3d9e-18af-48f1-91d8-1d4f3b2806f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:28.154497 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e3d9e-18af-48f1-91d8-1d4f3b2806f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:28.155404 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310e3d9e-18af-48f1-91d8-1d4f3b2806f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:28.157598 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310e3d9e-18af-48f1-91d8-1d4f3b2806f1 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:28.186002 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1409/2791] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:40:28 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 03:40:28.192226 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bcb054-7b5c-4a10-b7ff-e8f08a07245b None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:28.203326 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bcb054-7b5c-4a10-b7ff-e8f08a07245b None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:28.262439 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa11b407-cb35-40fe-82fc-ec66eb9a8c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:28.263257 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11b407-cb35-40fe-82fc-ec66eb9a8c4d admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:28.263607 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11b407-cb35-40fe-82fc-ec66eb9a8c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:28.263938 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11b407-cb35-40fe-82fc-ec66eb9a8c4d admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:28.264696 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa11b407-cb35-40fe-82fc-ec66eb9a8c4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:28.266727 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa11b407-cb35-40fe-82fc-ec66eb9a8c4d admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:28.287587 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1383/2792] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:40:28 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:40:28.291825 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e3d9e-18af-48f1-91d8-1d4f3b2806f1 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:28.302368 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e3d9e-18af-48f1-91d8-1d4f3b2806f1 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:28.307297 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bf718d-16a8-4316-9b09-4aa2aef3a464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:28.308049 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf718d-16a8-4316-9b09-4aa2aef3a464 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:28.308400 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf718d-16a8-4316-9b09-4aa2aef3a464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:28.308736 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf718d-16a8-4316-9b09-4aa2aef3a464 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:28.309572 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bf718d-16a8-4316-9b09-4aa2aef3a464 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:28.311359 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bf718d-16a8-4316-9b09-4aa2aef3a464 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:28.323095 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1410/2793] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:40:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:40:28.327494 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa11b407-cb35-40fe-82fc-ec66eb9a8c4d admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:28.337918 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa11b407-cb35-40fe-82fc-ec66eb9a8c4d admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:28.346743 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d15caed-205b-4260-a7fa-06bb050f3799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:28.347697 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d15caed-205b-4260-a7fa-06bb050f3799 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:28.347984 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d15caed-205b-4260-a7fa-06bb050f3799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:28.348257 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d15caed-205b-4260-a7fa-06bb050f3799 admin admin] PATH_INFO: `/v3/projects/c24106a2c5494c32800eddb9d2dc7796/users/0fa95665222d4abe92b714481e02b207/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:28.364620 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d15caed-205b-4260-a7fa-06bb050f3799 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c24106a2c5494c32800eddb9d2dc7796, user_id=0fa95665222d4abe92b714481e02b207, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:28.367487 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d15caed-205b-4260-a7fa-06bb050f3799 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:28.371541 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:40:28.387045 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1384/2794] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:40:28 2022] PUT /identity/v3/projects/c24106a2c5494c32800eddb9d2dc7796/users/0fa95665222d4abe92b714481e02b207/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:40:28.391249 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bf718d-16a8-4316-9b09-4aa2aef3a464 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:28.401759 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bf718d-16a8-4316-9b09-4aa2aef3a464 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:28.460453 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ed42b6-a0df-4729-8a5b-c318ae80fecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:28.461117 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed42b6-a0df-4729-8a5b-c318ae80fecb admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:28.461394 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed42b6-a0df-4729-8a5b-c318ae80fecb admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:28.461665 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed42b6-a0df-4729-8a5b-c318ae80fecb admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:28.462392 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ed42b6-a0df-4729-8a5b-c318ae80fecb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:28.464013 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ed42b6-a0df-4729-8a5b-c318ae80fecb admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:28.473785 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1411/2795] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:40:28 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:40:28.478004 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d15caed-205b-4260-a7fa-06bb050f3799 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:28.488790 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d15caed-205b-4260-a7fa-06bb050f3799 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:28.494008 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b27a223-60b9-45d7-bc87-5f5d1a660e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:28.494899 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27a223-60b9-45d7-bc87-5f5d1a660e69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:28.495211 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27a223-60b9-45d7-bc87-5f5d1a660e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:28.495487 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27a223-60b9-45d7-bc87-5f5d1a660e69 admin admin] PATH_INFO: `/v3/projects/c24106a2c5494c32800eddb9d2dc7796/users/0fa95665222d4abe92b714481e02b207/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:28.497640 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b27a223-60b9-45d7-bc87-5f5d1a660e69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c24106a2c5494c32800eddb9d2dc7796, user_id=0fa95665222d4abe92b714481e02b207, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:28.500375 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b27a223-60b9-45d7-bc87-5f5d1a660e69 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:28.511173 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1385/2796] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:40:28 2022] PUT /identity/v3/projects/c24106a2c5494c32800eddb9d2dc7796/users/0fa95665222d4abe92b714481e02b207/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:40:33.306355 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bab90b-5804-4fbe-9697-a40490d7731d None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:33.306809 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bab90b-5804-4fbe-9697-a40490d7731d None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:33.311025 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bab90b-5804-4fbe-9697-a40490d7731d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:33.362684 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-d7bab90b-5804-4fbe-9697-a40490d7731d None None] MFA Rules not processed for user `0fa95665222d4abe92b714481e02b207`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:40:33.363929 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-d7bab90b-5804-4fbe-9697-a40490d7731d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:40:33.480190 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1412/2797] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:40:33 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:40:33.495532 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b27a223-60b9-45d7-bc87-5f5d1a660e69 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:33.497342 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5b27a223-60b9-45d7-bc87-5f5d1a660e69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:40:33.585670 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b27a223-60b9-45d7-bc87-5f5d1a660e69 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:33.591627 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b9802-96b7-4a27-830d-690821386a31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13530240e2d446b6bf26a431d001362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:33.592288 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b9802-96b7-4a27-830d-690821386a31 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:33.592566 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b9802-96b7-4a27-830d-690821386a31 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:33.592948 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b9802-96b7-4a27-830d-690821386a31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:33.669310 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10b9802-96b7-4a27-830d-690821386a31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:33.671029 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10b9802-96b7-4a27-830d-690821386a31 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:33.682843 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1386/2798] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:40:33 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:40:34.726959 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478332a-dfe8-4739-ab22-9d66034df2d2 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:34.727535 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478332a-dfe8-4739-ab22-9d66034df2d2 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:34.727633 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478332a-dfe8-4739-ab22-9d66034df2d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:34.747878 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-9478332a-dfe8-4739-ab22-9d66034df2d2 None None] MFA Rules not processed for user `089580e581824803aeb276a0e51df138`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:40:34.749133 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-9478332a-dfe8-4739-ab22-9d66034df2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:40:34.756912 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1413/2799] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:40:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:40:43.679537 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=63,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:40:43.729170 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b9802-96b7-4a27-830d-690821386a31 service nova] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:43.730729 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c10b9802-96b7-4a27-830d-690821386a31 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:40:43.797231 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b9802-96b7-4a27-830d-690821386a31 service nova] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:43.802237 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c549564-1c0e-4b42-bb3a-ee21eccbfc54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:43.803149 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c549564-1c0e-4b42-bb3a-ee21eccbfc54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:43.803421 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c549564-1c0e-4b42-bb3a-ee21eccbfc54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:43.803692 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c549564-1c0e-4b42-bb3a-ee21eccbfc54 admin admin] PATH_INFO: `/v3/users/43c52839d35d407c975052040eb822c7` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:43.804939 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c549564-1c0e-4b42-bb3a-ee21eccbfc54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43c52839d35d407c975052040eb822c7)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:43.806890 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c549564-1c0e-4b42-bb3a-ee21eccbfc54 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:43.858058 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5c549564-1c0e-4b42-bb3a-ee21eccbfc54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43c52839d35d407c975052040eb822c7'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:43.858973 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5c549564-1c0e-4b42-bb3a-ee21eccbfc54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43c52839d35d407c975052040eb822c7'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:43.859734 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5c549564-1c0e-4b42-bb3a-ee21eccbfc54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43c52839d35d407c975052040eb822c7'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:43.871961 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5c549564-1c0e-4b42-bb3a-ee21eccbfc54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43c52839d35d407c975052040eb822c7'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:43.878845 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5c549564-1c0e-4b42-bb3a-ee21eccbfc54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43c52839d35d407c975052040eb822c7'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:43.894152 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1387/2800] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:40:43 2022] DELETE /identity/v3/users/43c52839d35d407c975052040eb822c7 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:40:43.899813 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805fa99d-6bd5-4c2a-9f0c-266feb713934 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:43.900463 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805fa99d-6bd5-4c2a-9f0c-266feb713934 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:43.900463 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805fa99d-6bd5-4c2a-9f0c-266feb713934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:43.919088 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-805fa99d-6bd5-4c2a-9f0c-266feb713934 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:40:43.920334 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-805fa99d-6bd5-4c2a-9f0c-266feb713934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:40:43.930393 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:40:43.981484 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1414/2801] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:40:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:40:43.991621 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c549564-1c0e-4b42-bb3a-ee21eccbfc54 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:43.993368 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5c549564-1c0e-4b42-bb3a-ee21eccbfc54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:40:44.056335 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c549564-1c0e-4b42-bb3a-ee21eccbfc54 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:44.060209 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c97c333-59bb-4247-bebb-03e11edda30a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:44.060874 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97c333-59bb-4247-bebb-03e11edda30a service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:44.061149 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97c333-59bb-4247-bebb-03e11edda30a service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:44.061420 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97c333-59bb-4247-bebb-03e11edda30a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:44.071442 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c97c333-59bb-4247-bebb-03e11edda30a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:44.072878 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c97c333-59bb-4247-bebb-03e11edda30a service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:44.082195 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1388/2802] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:40:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:40:44.374132 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805fa99d-6bd5-4c2a-9f0c-266feb713934 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:44.376116 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-805fa99d-6bd5-4c2a-9f0c-266feb713934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:40:44.389309 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805fa99d-6bd5-4c2a-9f0c-266feb713934 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:44.395134 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c14fb-de87-45d1-8d97-e7372558618b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:44.396025 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c14fb-de87-45d1-8d97-e7372558618b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:44.396321 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c14fb-de87-45d1-8d97-e7372558618b admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:44.396593 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c14fb-de87-45d1-8d97-e7372558618b admin admin] PATH_INFO: `/v3/projects/32b1efaf5b514a19829b20e2970789d8` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:44.397897 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028c14fb-de87-45d1-8d97-e7372558618b admin admin] RBAC: Authorizing `identity:delete_project(project_id=32b1efaf5b514a19829b20e2970789d8)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:44.399897 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028c14fb-de87-45d1-8d97-e7372558618b admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:44.449175 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-028c14fb-de87-45d1-8d97-e7372558618b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32b1efaf5b514a19829b20e2970789d8', 'request_id': 'req-028c14fb-de87-45d1-8d97-e7372558618b'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:44.454488 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-028c14fb-de87-45d1-8d97-e7372558618b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32b1efaf5b514a19829b20e2970789d8', 'request_id': 'req-028c14fb-de87-45d1-8d97-e7372558618b'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:44.460673 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-028c14fb-de87-45d1-8d97-e7372558618b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32b1efaf5b514a19829b20e2970789d8', 'request_id': 'req-028c14fb-de87-45d1-8d97-e7372558618b'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:44.475095 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-028c14fb-de87-45d1-8d97-e7372558618b admin admin] The token cache is being invalidate because project 32b1efaf5b514a19829b20e2970789d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:40:44.475411 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-028c14fb-de87-45d1-8d97-e7372558618b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:44.476073 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-028c14fb-de87-45d1-8d97-e7372558618b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:44.477661 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1415/2803] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:40:44 2022] DELETE /identity/v3/projects/32b1efaf5b514a19829b20e2970789d8 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:40:44.481875 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c97c333-59bb-4247-bebb-03e11edda30a service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:44.491841 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c97c333-59bb-4247-bebb-03e11edda30a service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:44.513209 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:40:44.560213 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f793508d-ddf6-4860-a5ca-0467090b064a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:44.561451 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793508d-ddf6-4860-a5ca-0467090b064a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:44.561725 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793508d-ddf6-4860-a5ca-0467090b064a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:44.562106 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793508d-ddf6-4860-a5ca-0467090b064a admin admin] PATH_INFO: `/v3/users/21a6ab3e108f4baa9fad26adcf3ddd57` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:44.563369 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f793508d-ddf6-4860-a5ca-0467090b064a admin admin] RBAC: Authorizing `identity:delete_user(user_id=21a6ab3e108f4baa9fad26adcf3ddd57)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:44.565385 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f793508d-ddf6-4860-a5ca-0467090b064a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:44.617088 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f793508d-ddf6-4860-a5ca-0467090b064a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21a6ab3e108f4baa9fad26adcf3ddd57'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:44.617727 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f793508d-ddf6-4860-a5ca-0467090b064a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21a6ab3e108f4baa9fad26adcf3ddd57'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:44.618306 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f793508d-ddf6-4860-a5ca-0467090b064a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21a6ab3e108f4baa9fad26adcf3ddd57'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:44.629633 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f793508d-ddf6-4860-a5ca-0467090b064a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21a6ab3e108f4baa9fad26adcf3ddd57'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:44.636339 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f793508d-ddf6-4860-a5ca-0467090b064a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21a6ab3e108f4baa9fad26adcf3ddd57'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:44.650959 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1389/2804] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:40:44 2022] DELETE /identity/v3/users/21a6ab3e108f4baa9fad26adcf3ddd57 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:40:44.937039 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c14fb-de87-45d1-8d97-e7372558618b admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:44.938610 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-028c14fb-de87-45d1-8d97-e7372558618b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:40:44.952714 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c14fb-de87-45d1-8d97-e7372558618b admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:45.017315 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7727f8e-78ac-4f98-b3ee-ffcc2c299a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:45.018227 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7727f8e-78ac-4f98-b3ee-ffcc2c299a68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:45.018515 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7727f8e-78ac-4f98-b3ee-ffcc2c299a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:45.018791 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7727f8e-78ac-4f98-b3ee-ffcc2c299a68 admin admin] PATH_INFO: `/v3/projects/145ba0401a4d48c0a667cbf60a551a45` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:45.020029 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7727f8e-78ac-4f98-b3ee-ffcc2c299a68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=145ba0401a4d48c0a667cbf60a551a45)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:45.021965 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7727f8e-78ac-4f98-b3ee-ffcc2c299a68 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:45.070214 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:40:45.077710 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d7727f8e-78ac-4f98-b3ee-ffcc2c299a68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '145ba0401a4d48c0a667cbf60a551a45', 'request_id': 'req-d7727f8e-78ac-4f98-b3ee-ffcc2c299a68'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:45.084230 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d7727f8e-78ac-4f98-b3ee-ffcc2c299a68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '145ba0401a4d48c0a667cbf60a551a45', 'request_id': 'req-d7727f8e-78ac-4f98-b3ee-ffcc2c299a68'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:45.090588 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d7727f8e-78ac-4f98-b3ee-ffcc2c299a68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '145ba0401a4d48c0a667cbf60a551a45', 'request_id': 'req-d7727f8e-78ac-4f98-b3ee-ffcc2c299a68'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:45.107680 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d7727f8e-78ac-4f98-b3ee-ffcc2c299a68 admin admin] The token cache is being invalidate because project 145ba0401a4d48c0a667cbf60a551a45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:40:45.107959 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d7727f8e-78ac-4f98-b3ee-ffcc2c299a68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:45.108586 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d7727f8e-78ac-4f98-b3ee-ffcc2c299a68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:45.110140 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1416/2805] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:40:44 2022] DELETE /identity/v3/projects/145ba0401a4d48c0a667cbf60a551a45 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:40:45.115250 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37392505-4e4b-4354-b791-d03e5a0c6720 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:45.115749 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37392505-4e4b-4354-b791-d03e5a0c6720 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:45.115852 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37392505-4e4b-4354-b791-d03e5a0c6720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:45.134053 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-37392505-4e4b-4354-b791-d03e5a0c6720 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:40:45.135304 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-37392505-4e4b-4354-b791-d03e5a0c6720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:40:45.196782 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1390/2806] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:40:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:40:45.204683 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e4070-0432-4697-bb78-371ed13b0ffb None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:45.204966 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e4070-0432-4697-bb78-371ed13b0ffb None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:45.205236 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e4070-0432-4697-bb78-371ed13b0ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:45.228141 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-605e4070-0432-4697-bb78-371ed13b0ffb None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:40:45.229438 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-605e4070-0432-4697-bb78-371ed13b0ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:40:45.239048 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1417/2807] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:40:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:40:45.243949 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37392505-4e4b-4354-b791-d03e5a0c6720 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:45.259677 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37392505-4e4b-4354-b791-d03e5a0c6720 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:45.266967 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5c77b7-52f5-4a78-80a4-c3cea682b169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:45.267965 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c77b7-52f5-4a78-80a4-c3cea682b169 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:45.268353 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c77b7-52f5-4a78-80a4-c3cea682b169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:45.268701 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c77b7-52f5-4a78-80a4-c3cea682b169 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:45.269421 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5c77b7-52f5-4a78-80a4-c3cea682b169 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:40:45.269720 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5c77b7-52f5-4a78-80a4-c3cea682b169 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:45.271337 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5c77b7-52f5-4a78-80a4-c3cea682b169 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:45.283033 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1391/2808] 10.222.0.60 () {58 vars in 1152 bytes} [Sat Jul 2 03:40:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 03:40:45.287954 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e4070-0432-4697-bb78-371ed13b0ffb None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:45.297542 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e4070-0432-4697-bb78-371ed13b0ffb None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:45.302477 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722a95f4-843a-4179-96c0-154d2f3c9004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:45.303159 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a95f4-843a-4179-96c0-154d2f3c9004 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:45.303406 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a95f4-843a-4179-96c0-154d2f3c9004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:45.303671 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a95f4-843a-4179-96c0-154d2f3c9004 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:45.304346 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722a95f4-843a-4179-96c0-154d2f3c9004 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:45.306226 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722a95f4-843a-4179-96c0-154d2f3c9004 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:45.333585 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1418/2809] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:40:45 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:40:45.340242 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5c77b7-52f5-4a78-80a4-c3cea682b169 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:45.355890 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5c77b7-52f5-4a78-80a4-c3cea682b169 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:45.385431 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:40:45.421834 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926dab55-3994-40d8-ba45-02ddd6ff9205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:45.422938 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926dab55-3994-40d8-ba45-02ddd6ff9205 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:45.423473 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926dab55-3994-40d8-ba45-02ddd6ff9205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:45.423988 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926dab55-3994-40d8-ba45-02ddd6ff9205 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:45.425280 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926dab55-3994-40d8-ba45-02ddd6ff9205 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:45.428984 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926dab55-3994-40d8-ba45-02ddd6ff9205 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:45.454839 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1392/2810] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:40:45 2022] POST /identity/v3/users => generated 283 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:40:45.459317 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722a95f4-843a-4179-96c0-154d2f3c9004 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:45.470086 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722a95f4-843a-4179-96c0-154d2f3c9004 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:45.474975 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a9980-d4e0-458d-98bc-f4933f3a5366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:45.475672 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a9980-d4e0-458d-98bc-f4933f3a5366 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:45.475952 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a9980-d4e0-458d-98bc-f4933f3a5366 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:45.476229 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a9980-d4e0-458d-98bc-f4933f3a5366 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:45.476996 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2a9980-d4e0-458d-98bc-f4933f3a5366 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:45.478592 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2a9980-d4e0-458d-98bc-f4933f3a5366 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:45.489561 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1419/2811] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:40:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 03:40:45.493469 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926dab55-3994-40d8-ba45-02ddd6ff9205 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:45.503955 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926dab55-3994-40d8-ba45-02ddd6ff9205 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:45.509615 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad57181-f9f8-4a3f-89ca-708860a4187a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:45.510271 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad57181-f9f8-4a3f-89ca-708860a4187a admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:45.510548 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad57181-f9f8-4a3f-89ca-708860a4187a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:45.510824 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad57181-f9f8-4a3f-89ca-708860a4187a admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:45.511601 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad57181-f9f8-4a3f-89ca-708860a4187a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:45.513204 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad57181-f9f8-4a3f-89ca-708860a4187a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:45.523872 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1393/2812] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:40:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:40:45.527946 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a9980-d4e0-458d-98bc-f4933f3a5366 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:45.538347 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a9980-d4e0-458d-98bc-f4933f3a5366 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:45.543541 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549c7f83-247a-4ee5-bfbc-f6fa90989484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:45.544405 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c7f83-247a-4ee5-bfbc-f6fa90989484 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:45.544683 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c7f83-247a-4ee5-bfbc-f6fa90989484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:45.544926 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c7f83-247a-4ee5-bfbc-f6fa90989484 admin admin] PATH_INFO: `/v3/projects/9cfddf37770948e9873e2c96f32c3b1f/users/1b609081f3d54ac7902c6082fd868924/roles/c43aada0326446c4ade0ab1262918fa4` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:45.560364 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549c7f83-247a-4ee5-bfbc-f6fa90989484 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cfddf37770948e9873e2c96f32c3b1f, user_id=1b609081f3d54ac7902c6082fd868924, role_id=c43aada0326446c4ade0ab1262918fa4)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:45.563029 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549c7f83-247a-4ee5-bfbc-f6fa90989484 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:45.578303 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1420/2813] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:40:45 2022] PUT /identity/v3/projects/9cfddf37770948e9873e2c96f32c3b1f/users/1b609081f3d54ac7902c6082fd868924/roles/c43aada0326446c4ade0ab1262918fa4 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:40:45.590061 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e13e315-f6e4-4e87-a6bc-6bc32b7ff5d1 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:45.590282 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e13e315-f6e4-4e87-a6bc-6bc32b7ff5d1 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:45.590562 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e13e315-f6e4-4e87-a6bc-6bc32b7ff5d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:45.620642 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-7e13e315-f6e4-4e87-a6bc-6bc32b7ff5d1 None None] MFA Rules not processed for user `1b609081f3d54ac7902c6082fd868924`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:40:45.621854 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7e13e315-f6e4-4e87-a6bc-6bc32b7ff5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:40:45.688866 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1394/2814] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:40:45 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:40:45.693630 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549c7f83-247a-4ee5-bfbc-f6fa90989484 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:45.761184 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549c7f83-247a-4ee5-bfbc-f6fa90989484 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:45.766651 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9d8b42-4289-4c7c-9400-d20d39d2431d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:45.767379 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d8b42-4289-4c7c-9400-d20d39d2431d admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:45.767646 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d8b42-4289-4c7c-9400-d20d39d2431d admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:45.767925 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d8b42-4289-4c7c-9400-d20d39d2431d admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:45.768614 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9d8b42-4289-4c7c-9400-d20d39d2431d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:45.770524 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9d8b42-4289-4c7c-9400-d20d39d2431d admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:45.799203 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1421/2815] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:40:45 2022] POST /identity/v3/projects => generated 365 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:40:45.801999 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e13e315-f6e4-4e87-a6bc-6bc32b7ff5d1 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:45.813185 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e13e315-f6e4-4e87-a6bc-6bc32b7ff5d1 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:45.871823 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4967b9d6-c80e-4dff-8876-650521e4f113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:45.872412 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967b9d6-c80e-4dff-8876-650521e4f113 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:45.872698 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967b9d6-c80e-4dff-8876-650521e4f113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:45.872972 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967b9d6-c80e-4dff-8876-650521e4f113 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:45.873668 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4967b9d6-c80e-4dff-8876-650521e4f113 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:45.875659 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4967b9d6-c80e-4dff-8876-650521e4f113 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:45.898230 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1395/2816] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:40:45 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:40:45.902631 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9d8b42-4289-4c7c-9400-d20d39d2431d admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:45.920818 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9d8b42-4289-4c7c-9400-d20d39d2431d admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:45.926603 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20466a70-d414-4e27-97d0-b7cbf426f307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:45.927444 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20466a70-d414-4e27-97d0-b7cbf426f307 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:45.927728 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20466a70-d414-4e27-97d0-b7cbf426f307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:45.928003 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20466a70-d414-4e27-97d0-b7cbf426f307 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:45.928765 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20466a70-d414-4e27-97d0-b7cbf426f307 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:45.930406 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20466a70-d414-4e27-97d0-b7cbf426f307 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:45.945694 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1422/2817] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:40:45 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:40:45.947055 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4967b9d6-c80e-4dff-8876-650521e4f113 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:45.957761 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4967b9d6-c80e-4dff-8876-650521e4f113 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:45.963184 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3a2972-5953-468e-ac47-495d76df953a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:45.964151 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a2972-5953-468e-ac47-495d76df953a admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:45.964435 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a2972-5953-468e-ac47-495d76df953a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:45.964731 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a2972-5953-468e-ac47-495d76df953a admin admin] PATH_INFO: `/v3/projects/c5d404294ab2499a81e863ed97ddcfcc/users/be2e2cf99c784173aeb0e0e292979fb4/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:45.979926 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3a2972-5953-468e-ac47-495d76df953a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5d404294ab2499a81e863ed97ddcfcc, user_id=be2e2cf99c784173aeb0e0e292979fb4, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:45.982644 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3a2972-5953-468e-ac47-495d76df953a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:45.997816 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1396/2818] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:40:45 2022] PUT /identity/v3/projects/c5d404294ab2499a81e863ed97ddcfcc/users/be2e2cf99c784173aeb0e0e292979fb4/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:40:46.001969 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20466a70-d414-4e27-97d0-b7cbf426f307 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:46.014185 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20466a70-d414-4e27-97d0-b7cbf426f307 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:46.056679 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:40:46.077359 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a99e6b-27a0-47ce-a04e-dc99c164d14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:46.078020 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a99e6b-27a0-47ce-a04e-dc99c164d14b admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:46.078297 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a99e6b-27a0-47ce-a04e-dc99c164d14b admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:46.078568 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a99e6b-27a0-47ce-a04e-dc99c164d14b admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:46.079320 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a99e6b-27a0-47ce-a04e-dc99c164d14b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:46.081198 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a99e6b-27a0-47ce-a04e-dc99c164d14b admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:46.091420 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1423/2819] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:40:46 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:40:46.095805 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3a2972-5953-468e-ac47-495d76df953a admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:46.101323 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:40:46.107899 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3a2972-5953-468e-ac47-495d76df953a admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:46.113500 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e2cb2f-4a4c-42f5-86c6-0717d2df11b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:46.114434 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e2cb2f-4a4c-42f5-86c6-0717d2df11b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:46.114744 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e2cb2f-4a4c-42f5-86c6-0717d2df11b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:46.115027 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e2cb2f-4a4c-42f5-86c6-0717d2df11b4 admin admin] PATH_INFO: `/v3/projects/c5d404294ab2499a81e863ed97ddcfcc/users/be2e2cf99c784173aeb0e0e292979fb4/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:46.117087 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e2cb2f-4a4c-42f5-86c6-0717d2df11b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5d404294ab2499a81e863ed97ddcfcc, user_id=be2e2cf99c784173aeb0e0e292979fb4, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:46.119939 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e2cb2f-4a4c-42f5-86c6-0717d2df11b4 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:46.130827 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1397/2820] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:40:46 2022] PUT /identity/v3/projects/c5d404294ab2499a81e863ed97ddcfcc/users/be2e2cf99c784173aeb0e0e292979fb4/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:40:46.141555 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1115f7de-2e1a-4fb5-b7ec-04add3f78c43 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:46.141942 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1115f7de-2e1a-4fb5-b7ec-04add3f78c43 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:46.142213 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1115f7de-2e1a-4fb5-b7ec-04add3f78c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:46.169330 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-1115f7de-2e1a-4fb5-b7ec-04add3f78c43 None None] MFA Rules not processed for user `be2e2cf99c784173aeb0e0e292979fb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:40:46.170541 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-1115f7de-2e1a-4fb5-b7ec-04add3f78c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:40:46.238963 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1424/2821] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:40:46 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 03:40:46.250968 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e2cb2f-4a4c-42f5-86c6-0717d2df11b4 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:46.252814 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b7e2cb2f-4a4c-42f5-86c6-0717d2df11b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:40:46.311243 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e2cb2f-4a4c-42f5-86c6-0717d2df11b4 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:46.315699 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df744a1b-c646-43cb-8fcb-f5cca3539513 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:46.316325 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df744a1b-c646-43cb-8fcb-f5cca3539513 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:46.316599 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df744a1b-c646-43cb-8fcb-f5cca3539513 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:46.316873 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df744a1b-c646-43cb-8fcb-f5cca3539513 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:46.326355 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df744a1b-c646-43cb-8fcb-f5cca3539513 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:46.327816 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df744a1b-c646-43cb-8fcb-f5cca3539513 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:46.337243 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1398/2822] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:40:46 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:40:46.746036 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1115f7de-2e1a-4fb5-b7ec-04add3f78c43 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:46.808186 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1115f7de-2e1a-4fb5-b7ec-04add3f78c43 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:46.813024 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc89ed9a-314f-47aa-895c-5106fd4c7187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:46.813897 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc89ed9a-314f-47aa-895c-5106fd4c7187 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:46.814171 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc89ed9a-314f-47aa-895c-5106fd4c7187 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:46.814437 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc89ed9a-314f-47aa-895c-5106fd4c7187 admin admin] PATH_INFO: `/v3/users/1b609081f3d54ac7902c6082fd868924` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:46.815701 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc89ed9a-314f-47aa-895c-5106fd4c7187 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b609081f3d54ac7902c6082fd868924)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:46.817636 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc89ed9a-314f-47aa-895c-5106fd4c7187 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:46.879000 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-bc89ed9a-314f-47aa-895c-5106fd4c7187 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b609081f3d54ac7902c6082fd868924'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:46.879692 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-bc89ed9a-314f-47aa-895c-5106fd4c7187 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b609081f3d54ac7902c6082fd868924'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:46.889475 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-bc89ed9a-314f-47aa-895c-5106fd4c7187 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b609081f3d54ac7902c6082fd868924'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:46.890038 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-bc89ed9a-314f-47aa-895c-5106fd4c7187 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b609081f3d54ac7902c6082fd868924'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:46.897480 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:40:46.903649 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-bc89ed9a-314f-47aa-895c-5106fd4c7187 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b609081f3d54ac7902c6082fd868924'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:46.917511 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1425/2823] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:40:46 2022] DELETE /identity/v3/users/1b609081f3d54ac7902c6082fd868924 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:40:46.924524 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65284916-324c-49cd-a89f-4c2630e10e5f None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:46.924962 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65284916-324c-49cd-a89f-4c2630e10e5f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:46.925259 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65284916-324c-49cd-a89f-4c2630e10e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:46.943422 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-65284916-324c-49cd-a89f-4c2630e10e5f None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:40:46.944634 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-65284916-324c-49cd-a89f-4c2630e10e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:40:47.005327 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1399/2824] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:40:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:40:47.015750 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc89ed9a-314f-47aa-895c-5106fd4c7187 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:47.017374 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-bc89ed9a-314f-47aa-895c-5106fd4c7187 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:40:47.082189 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc89ed9a-314f-47aa-895c-5106fd4c7187 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:47.086345 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e582f1de-e4e7-4c0b-8c27-c60894d80648 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:47.086996 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582f1de-e4e7-4c0b-8c27-c60894d80648 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:47.087457 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582f1de-e4e7-4c0b-8c27-c60894d80648 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:47.087667 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582f1de-e4e7-4c0b-8c27-c60894d80648 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:47.097824 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e582f1de-e4e7-4c0b-8c27-c60894d80648 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:47.099281 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e582f1de-e4e7-4c0b-8c27-c60894d80648 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:47.108776 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1426/2825] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:40:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:40:47.399066 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65284916-324c-49cd-a89f-4c2630e10e5f None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:47.400655 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-65284916-324c-49cd-a89f-4c2630e10e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:40:47.414691 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65284916-324c-49cd-a89f-4c2630e10e5f None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:47.420044 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be96d7-8ee9-4c37-a793-86eb16386cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:47.421070 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be96d7-8ee9-4c37-a793-86eb16386cb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:47.421345 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be96d7-8ee9-4c37-a793-86eb16386cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:47.421648 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be96d7-8ee9-4c37-a793-86eb16386cb6 admin admin] PATH_INFO: `/v3/projects/9cfddf37770948e9873e2c96f32c3b1f` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:47.422835 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48be96d7-8ee9-4c37-a793-86eb16386cb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cfddf37770948e9873e2c96f32c3b1f)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:47.424825 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48be96d7-8ee9-4c37-a793-86eb16386cb6 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:47.473664 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-48be96d7-8ee9-4c37-a793-86eb16386cb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cfddf37770948e9873e2c96f32c3b1f', 'request_id': 'req-48be96d7-8ee9-4c37-a793-86eb16386cb6'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:47.478935 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-48be96d7-8ee9-4c37-a793-86eb16386cb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cfddf37770948e9873e2c96f32c3b1f', 'request_id': 'req-48be96d7-8ee9-4c37-a793-86eb16386cb6'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:47.487044 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-48be96d7-8ee9-4c37-a793-86eb16386cb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cfddf37770948e9873e2c96f32c3b1f', 'request_id': 'req-48be96d7-8ee9-4c37-a793-86eb16386cb6'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:47.499537 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-48be96d7-8ee9-4c37-a793-86eb16386cb6 admin admin] The token cache is being invalidate because project 9cfddf37770948e9873e2c96f32c3b1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:40:47.499537 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-48be96d7-8ee9-4c37-a793-86eb16386cb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:47.499857 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-48be96d7-8ee9-4c37-a793-86eb16386cb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:47.501795 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1400/2826] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:40:47 2022] DELETE /identity/v3/projects/9cfddf37770948e9873e2c96f32c3b1f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:40:47.506031 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e582f1de-e4e7-4c0b-8c27-c60894d80648 service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:47.516257 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e582f1de-e4e7-4c0b-8c27-c60894d80648 service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:47.577496 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f0730-c5e3-4ed8-92d8-779036300db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:47.578376 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f0730-c5e3-4ed8-92d8-779036300db2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:47.578657 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f0730-c5e3-4ed8-92d8-779036300db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:47.578929 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f0730-c5e3-4ed8-92d8-779036300db2 admin admin] PATH_INFO: `/v3/users/be2e2cf99c784173aeb0e0e292979fb4` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:47.580179 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f0730-c5e3-4ed8-92d8-779036300db2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be2e2cf99c784173aeb0e0e292979fb4)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:47.582231 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f0730-c5e3-4ed8-92d8-779036300db2 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:47.630402 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-fb3f0730-c5e3-4ed8-92d8-779036300db2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be2e2cf99c784173aeb0e0e292979fb4'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:47.631086 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-fb3f0730-c5e3-4ed8-92d8-779036300db2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be2e2cf99c784173aeb0e0e292979fb4'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:47.639280 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-fb3f0730-c5e3-4ed8-92d8-779036300db2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be2e2cf99c784173aeb0e0e292979fb4'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:47.639897 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-fb3f0730-c5e3-4ed8-92d8-779036300db2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be2e2cf99c784173aeb0e0e292979fb4'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:47.652104 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-fb3f0730-c5e3-4ed8-92d8-779036300db2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be2e2cf99c784173aeb0e0e292979fb4'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:47.664735 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1427/2827] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:40:47 2022] DELETE /identity/v3/users/be2e2cf99c784173aeb0e0e292979fb4 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:40:47.954219 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be96d7-8ee9-4c37-a793-86eb16386cb6 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:47.955766 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-48be96d7-8ee9-4c37-a793-86eb16386cb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:40:47.969437 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be96d7-8ee9-4c37-a793-86eb16386cb6 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:47.982310 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:40:48.029541 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ad10da-f257-4c25-b49c-b8d82f424911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:48.030342 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ad10da-f257-4c25-b49c-b8d82f424911 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:48.030614 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ad10da-f257-4c25-b49c-b8d82f424911 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:48.030886 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ad10da-f257-4c25-b49c-b8d82f424911 admin admin] PATH_INFO: `/v3/projects/c5d404294ab2499a81e863ed97ddcfcc` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:48.032131 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ad10da-f257-4c25-b49c-b8d82f424911 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5d404294ab2499a81e863ed97ddcfcc)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:48.034115 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ad10da-f257-4c25-b49c-b8d82f424911 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:48.081396 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-64ad10da-f257-4c25-b49c-b8d82f424911 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5d404294ab2499a81e863ed97ddcfcc', 'request_id': 'req-64ad10da-f257-4c25-b49c-b8d82f424911'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:48.086855 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-64ad10da-f257-4c25-b49c-b8d82f424911 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5d404294ab2499a81e863ed97ddcfcc', 'request_id': 'req-64ad10da-f257-4c25-b49c-b8d82f424911'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:48.095812 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-64ad10da-f257-4c25-b49c-b8d82f424911 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5d404294ab2499a81e863ed97ddcfcc', 'request_id': 'req-64ad10da-f257-4c25-b49c-b8d82f424911'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:48.107756 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-64ad10da-f257-4c25-b49c-b8d82f424911 admin admin] The token cache is being invalidate because project c5d404294ab2499a81e863ed97ddcfcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:40:48.108041 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-64ad10da-f257-4c25-b49c-b8d82f424911 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:48.108679 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-64ad10da-f257-4c25-b49c-b8d82f424911 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:48.110241 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1401/2828] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:40:47 2022] DELETE /identity/v3/projects/c5d404294ab2499a81e863ed97ddcfcc => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:40:48.115473 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c67877-e350-4a5f-94d3-a5c5ea773617 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:48.115939 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c67877-e350-4a5f-94d3-a5c5ea773617 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:48.116032 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c67877-e350-4a5f-94d3-a5c5ea773617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:48.122621 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:40:48.137587 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-62c67877-e350-4a5f-94d3-a5c5ea773617 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:40:48.138827 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-62c67877-e350-4a5f-94d3-a5c5ea773617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:40:48.207348 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1428/2829] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:40:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:40:48.215839 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e3f6c7-1e95-4439-9083-11b638aa8af3 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:48.216127 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e3f6c7-1e95-4439-9083-11b638aa8af3 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:48.216402 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e3f6c7-1e95-4439-9083-11b638aa8af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:48.237134 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-e0e3f6c7-1e95-4439-9083-11b638aa8af3 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:40:48.238331 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e0e3f6c7-1e95-4439-9083-11b638aa8af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:40:48.248004 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1402/2830] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:40:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:40:48.252980 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c67877-e350-4a5f-94d3-a5c5ea773617 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:48.263767 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c67877-e350-4a5f-94d3-a5c5ea773617 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:48.270169 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87256725-70a1-41fc-97ba-9bd24c66e2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:48.270835 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87256725-70a1-41fc-97ba-9bd24c66e2f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:48.271114 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87256725-70a1-41fc-97ba-9bd24c66e2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:48.271420 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87256725-70a1-41fc-97ba-9bd24c66e2f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:48.272196 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87256725-70a1-41fc-97ba-9bd24c66e2f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:40:48.272506 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87256725-70a1-41fc-97ba-9bd24c66e2f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:48.274196 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87256725-70a1-41fc-97ba-9bd24c66e2f5 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:48.287251 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1429/2831] 10.222.0.60 () {58 vars in 1152 bytes} [Sat Jul 2 03:40:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:40:48.291629 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e3f6c7-1e95-4439-9083-11b638aa8af3 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:48.301750 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e3f6c7-1e95-4439-9083-11b638aa8af3 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:48.307883 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ab8075-3753-46e4-8d17-28c83127c248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:48.308595 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab8075-3753-46e4-8d17-28c83127c248 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:48.308854 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab8075-3753-46e4-8d17-28c83127c248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:48.309124 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab8075-3753-46e4-8d17-28c83127c248 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:48.309816 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ab8075-3753-46e4-8d17-28c83127c248 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:48.311788 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ab8075-3753-46e4-8d17-28c83127c248 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:48.341156 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1403/2832] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:40:48 2022] POST /identity/v3/projects => generated 369 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:40:48.345420 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87256725-70a1-41fc-97ba-9bd24c66e2f5 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:48.355766 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87256725-70a1-41fc-97ba-9bd24c66e2f5 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:48.415938 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047b885c-d59a-4a29-9e8d-88a667c7a6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:48.416613 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b885c-d59a-4a29-9e8d-88a667c7a6f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:48.416888 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b885c-d59a-4a29-9e8d-88a667c7a6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:48.417157 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b885c-d59a-4a29-9e8d-88a667c7a6f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:48.417856 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047b885c-d59a-4a29-9e8d-88a667c7a6f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:48.419833 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047b885c-d59a-4a29-9e8d-88a667c7a6f4 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:48.444002 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1430/2833] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:40:48 2022] POST /identity/v3/users => generated 285 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:40:48.448597 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ab8075-3753-46e4-8d17-28c83127c248 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:48.459671 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ab8075-3753-46e4-8d17-28c83127c248 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:48.464698 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5bdde7-c765-4c64-8796-8d3bd441af16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:48.465351 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5bdde7-c765-4c64-8796-8d3bd441af16 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:48.465630 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5bdde7-c765-4c64-8796-8d3bd441af16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:48.465925 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5bdde7-c765-4c64-8796-8d3bd441af16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:48.466647 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5bdde7-c765-4c64-8796-8d3bd441af16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:48.468312 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5bdde7-c765-4c64-8796-8d3bd441af16 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:48.479255 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1404/2834] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:40:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:40:48.483420 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047b885c-d59a-4a29-9e8d-88a667c7a6f4 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:48.494076 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047b885c-d59a-4a29-9e8d-88a667c7a6f4 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:48.499670 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15afeff-e4c1-41c6-8e86-07ee2727b511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:48.500328 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15afeff-e4c1-41c6-8e86-07ee2727b511 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:48.500610 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15afeff-e4c1-41c6-8e86-07ee2727b511 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:48.500874 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15afeff-e4c1-41c6-8e86-07ee2727b511 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:48.501603 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15afeff-e4c1-41c6-8e86-07ee2727b511 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:48.503283 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15afeff-e4c1-41c6-8e86-07ee2727b511 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:48.514001 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1431/2835] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:40:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:40:48.518392 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5bdde7-c765-4c64-8796-8d3bd441af16 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:48.533389 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5bdde7-c765-4c64-8796-8d3bd441af16 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:48.538910 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a792b3-ff7c-4009-8869-afe3bbfaee41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:48.539770 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a792b3-ff7c-4009-8869-afe3bbfaee41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:48.540054 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a792b3-ff7c-4009-8869-afe3bbfaee41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:48.540334 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a792b3-ff7c-4009-8869-afe3bbfaee41 admin admin] PATH_INFO: `/v3/projects/6dc8dbcff9fe4d9c836ab4153bf719e8/users/413af06c820f4bb49f55b968b6533d90/roles/c43aada0326446c4ade0ab1262918fa4` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:48.557297 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a792b3-ff7c-4009-8869-afe3bbfaee41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dc8dbcff9fe4d9c836ab4153bf719e8, user_id=413af06c820f4bb49f55b968b6533d90, role_id=c43aada0326446c4ade0ab1262918fa4)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:48.560057 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a792b3-ff7c-4009-8869-afe3bbfaee41 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:48.576155 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1405/2836] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:40:48 2022] PUT /identity/v3/projects/6dc8dbcff9fe4d9c836ab4153bf719e8/users/413af06c820f4bb49f55b968b6533d90/roles/c43aada0326446c4ade0ab1262918fa4 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:40:48.587599 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb370ce-40aa-421b-8202-2c7c1480367d None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:48.587884 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb370ce-40aa-421b-8202-2c7c1480367d None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:48.588162 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb370ce-40aa-421b-8202-2c7c1480367d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:48.615092 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-ffb370ce-40aa-421b-8202-2c7c1480367d None None] MFA Rules not processed for user `413af06c820f4bb49f55b968b6533d90`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:40:48.616334 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-ffb370ce-40aa-421b-8202-2c7c1480367d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:40:48.678736 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:40:48.685370 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1432/2837] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:40:48 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:40:48.689746 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a792b3-ff7c-4009-8869-afe3bbfaee41 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:48.741665 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:40:48.761404 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a792b3-ff7c-4009-8869-afe3bbfaee41 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:48.766261 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76e588-079f-4be4-819d-6dcd28c0d4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:48.766942 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76e588-079f-4be4-819d-6dcd28c0d4a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:48.767254 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76e588-079f-4be4-819d-6dcd28c0d4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:48.767554 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76e588-079f-4be4-819d-6dcd28c0d4a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:48.768272 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a76e588-079f-4be4-819d-6dcd28c0d4a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:48.770258 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a76e588-079f-4be4-819d-6dcd28c0d4a7 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:48.798437 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1406/2838] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:40:48 2022] POST /identity/v3/projects => generated 367 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:40:48.802593 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb370ce-40aa-421b-8202-2c7c1480367d None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:48.813717 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb370ce-40aa-421b-8202-2c7c1480367d None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:48.879433 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f777d24e-264f-4031-a964-a02678e37caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:48.880097 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777d24e-264f-4031-a964-a02678e37caf admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:48.880372 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777d24e-264f-4031-a964-a02678e37caf admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:48.880640 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777d24e-264f-4031-a964-a02678e37caf admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:48.881322 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f777d24e-264f-4031-a964-a02678e37caf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:48.883264 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f777d24e-264f-4031-a964-a02678e37caf admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:48.904389 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1433/2839] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:40:48 2022] POST /identity/v3/users => generated 290 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:40:48.908671 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76e588-079f-4be4-819d-6dcd28c0d4a7 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:48.920044 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76e588-079f-4be4-819d-6dcd28c0d4a7 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:48.924744 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d363ae-da46-4d9b-a283-a2dca4895817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:48.925421 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d363ae-da46-4d9b-a283-a2dca4895817 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:48.925690 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d363ae-da46-4d9b-a283-a2dca4895817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:48.925959 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d363ae-da46-4d9b-a283-a2dca4895817 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:48.926651 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d363ae-da46-4d9b-a283-a2dca4895817 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:48.928330 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d363ae-da46-4d9b-a283-a2dca4895817 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:48.939562 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1407/2840] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:40:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:40:48.943948 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f777d24e-264f-4031-a964-a02678e37caf admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:48.954700 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f777d24e-264f-4031-a964-a02678e37caf admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:48.964161 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34479835-f9b4-4a84-8d65-b43e660e0461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:48.964161 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34479835-f9b4-4a84-8d65-b43e660e0461 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:48.964161 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34479835-f9b4-4a84-8d65-b43e660e0461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:48.964161 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34479835-f9b4-4a84-8d65-b43e660e0461 admin admin] PATH_INFO: `/v3/projects/a2d039def32949b697377cd88c637940/users/5e867c55efaa47dfaee8b9eb3d74d9b6/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:48.977335 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34479835-f9b4-4a84-8d65-b43e660e0461 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2d039def32949b697377cd88c637940, user_id=5e867c55efaa47dfaee8b9eb3d74d9b6, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:48.980092 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34479835-f9b4-4a84-8d65-b43e660e0461 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:48.995171 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1434/2841] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:40:48 2022] PUT /identity/v3/projects/a2d039def32949b697377cd88c637940/users/5e867c55efaa47dfaee8b9eb3d74d9b6/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:40:48.999166 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d363ae-da46-4d9b-a283-a2dca4895817 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:49.009380 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d363ae-da46-4d9b-a283-a2dca4895817 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:49.067929 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d1cb27-5e09-4dd7-99ec-c2c8db1a7f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:49.068524 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1cb27-5e09-4dd7-99ec-c2c8db1a7f29 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:49.068796 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1cb27-5e09-4dd7-99ec-c2c8db1a7f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:49.069074 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1cb27-5e09-4dd7-99ec-c2c8db1a7f29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:49.069809 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d1cb27-5e09-4dd7-99ec-c2c8db1a7f29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:49.071501 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d1cb27-5e09-4dd7-99ec-c2c8db1a7f29 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:49.085234 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1408/2842] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:40:48 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:40:49.090345 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34479835-f9b4-4a84-8d65-b43e660e0461 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:49.104361 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34479835-f9b4-4a84-8d65-b43e660e0461 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:49.110931 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed42fb72-5d09-4213-9318-bd7c4c0a921e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:49.111934 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed42fb72-5d09-4213-9318-bd7c4c0a921e admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:49.112268 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed42fb72-5d09-4213-9318-bd7c4c0a921e admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:49.112533 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed42fb72-5d09-4213-9318-bd7c4c0a921e admin admin] PATH_INFO: `/v3/projects/a2d039def32949b697377cd88c637940/users/5e867c55efaa47dfaee8b9eb3d74d9b6/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:49.115154 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed42fb72-5d09-4213-9318-bd7c4c0a921e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2d039def32949b697377cd88c637940, user_id=5e867c55efaa47dfaee8b9eb3d74d9b6, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:49.118016 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed42fb72-5d09-4213-9318-bd7c4c0a921e admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:49.129984 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1435/2843] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:40:49 2022] PUT /identity/v3/projects/a2d039def32949b697377cd88c637940/users/5e867c55efaa47dfaee8b9eb3d74d9b6/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 03:40:49.140542 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70c1525-99f3-433d-beaa-4c75a2374ac9 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:49.140840 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70c1525-99f3-433d-beaa-4c75a2374ac9 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:49.141115 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70c1525-99f3-433d-beaa-4c75a2374ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:49.169640 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-a70c1525-99f3-433d-beaa-4c75a2374ac9 None None] MFA Rules not processed for user `5e867c55efaa47dfaee8b9eb3d74d9b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:40:49.170845 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a70c1525-99f3-433d-beaa-4c75a2374ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:40:49.246175 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1409/2844] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:40:49 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:40:49.258640 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed42fb72-5d09-4213-9318-bd7c4c0a921e admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:49.260509 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-ed42fb72-5d09-4213-9318-bd7c4c0a921e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:40:49.321466 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed42fb72-5d09-4213-9318-bd7c4c0a921e admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:49.325401 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c718488-8b79-49d4-b977-9d2807256188 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:49.326043 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c718488-8b79-49d4-b977-9d2807256188 service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:49.326318 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c718488-8b79-49d4-b977-9d2807256188 service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:49.326619 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c718488-8b79-49d4-b977-9d2807256188 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:49.335961 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c718488-8b79-49d4-b977-9d2807256188 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:49.337397 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c718488-8b79-49d4-b977-9d2807256188 service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:49.346988 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1436/2845] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:40:49 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:40:49.402406 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70c1525-99f3-433d-beaa-4c75a2374ac9 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:49.403885 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a70c1525-99f3-433d-beaa-4c75a2374ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:40:49.416723 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70c1525-99f3-433d-beaa-4c75a2374ac9 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:49.420588 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f9ec6-5263-43bf-a973-c714df967e6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:49.421234 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f9ec6-5263-43bf-a973-c714df967e6a service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:49.421513 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f9ec6-5263-43bf-a973-c714df967e6a service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:49.421785 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f9ec6-5263-43bf-a973-c714df967e6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:49.454974 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:40:49.485639 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799f9ec6-5263-43bf-a973-c714df967e6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:49.487139 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799f9ec6-5263-43bf-a973-c714df967e6a service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:49.496512 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1410/2846] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:40:49 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:40:52.849112 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c718488-8b79-49d4-b977-9d2807256188 service cinder] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:52.902431 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:40:52.914802 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c718488-8b79-49d4-b977-9d2807256188 service cinder] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:52.920208 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5789ca7-0c3b-4430-bc16-d682f5e8196b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:52.921086 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5789ca7-0c3b-4430-bc16-d682f5e8196b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:52.921367 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5789ca7-0c3b-4430-bc16-d682f5e8196b admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:52.921619 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5789ca7-0c3b-4430-bc16-d682f5e8196b admin admin] PATH_INFO: `/v3/users/413af06c820f4bb49f55b968b6533d90` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:52.922903 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5789ca7-0c3b-4430-bc16-d682f5e8196b admin admin] RBAC: Authorizing `identity:delete_user(user_id=413af06c820f4bb49f55b968b6533d90)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:52.924876 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5789ca7-0c3b-4430-bc16-d682f5e8196b admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:52.980803 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d5789ca7-0c3b-4430-bc16-d682f5e8196b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '413af06c820f4bb49f55b968b6533d90'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:52.981896 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d5789ca7-0c3b-4430-bc16-d682f5e8196b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '413af06c820f4bb49f55b968b6533d90'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:52.993923 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d5789ca7-0c3b-4430-bc16-d682f5e8196b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '413af06c820f4bb49f55b968b6533d90'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:52.994881 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d5789ca7-0c3b-4430-bc16-d682f5e8196b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '413af06c820f4bb49f55b968b6533d90'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:53.014066 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d5789ca7-0c3b-4430-bc16-d682f5e8196b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '413af06c820f4bb49f55b968b6533d90'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:53.029215 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1437/2847] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:40:52 2022] DELETE /identity/v3/users/413af06c820f4bb49f55b968b6533d90 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:40:53.034200 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67114dde-0a8c-4a5c-96c7-bf37ba3a90be None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:53.034755 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67114dde-0a8c-4a5c-96c7-bf37ba3a90be None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:53.034755 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67114dde-0a8c-4a5c-96c7-bf37ba3a90be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:53.054034 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-67114dde-0a8c-4a5c-96c7-bf37ba3a90be None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:40:53.055359 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-67114dde-0a8c-4a5c-96c7-bf37ba3a90be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:40:53.116999 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1411/2848] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:40:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:40:53.126844 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5789ca7-0c3b-4430-bc16-d682f5e8196b admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:53.129877 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-d5789ca7-0c3b-4430-bc16-d682f5e8196b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:40:53.193702 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5789ca7-0c3b-4430-bc16-d682f5e8196b admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:53.197665 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c81ab8-252f-4e7d-8130-309e3bb69aa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:53.198346 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c81ab8-252f-4e7d-8130-309e3bb69aa3 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:53.198599 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c81ab8-252f-4e7d-8130-309e3bb69aa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:53.199256 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c81ab8-252f-4e7d-8130-309e3bb69aa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:53.209673 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c81ab8-252f-4e7d-8130-309e3bb69aa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:53.211178 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c81ab8-252f-4e7d-8130-309e3bb69aa3 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:53.221504 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1438/2849] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:40:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:40:53.754139 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67114dde-0a8c-4a5c-96c7-bf37ba3a90be None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:53.756553 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-67114dde-0a8c-4a5c-96c7-bf37ba3a90be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:40:53.770103 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67114dde-0a8c-4a5c-96c7-bf37ba3a90be None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:53.780062 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b9484e-ddc0-42aa-87f6-a06fa378e93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:53.781530 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9484e-ddc0-42aa-87f6-a06fa378e93f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:53.781817 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9484e-ddc0-42aa-87f6-a06fa378e93f admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:53.782073 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9484e-ddc0-42aa-87f6-a06fa378e93f admin admin] PATH_INFO: `/v3/projects/6dc8dbcff9fe4d9c836ab4153bf719e8` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:53.783947 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b9484e-ddc0-42aa-87f6-a06fa378e93f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dc8dbcff9fe4d9c836ab4153bf719e8)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:53.786840 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b9484e-ddc0-42aa-87f6-a06fa378e93f admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:53.838911 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-b9b9484e-ddc0-42aa-87f6-a06fa378e93f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dc8dbcff9fe4d9c836ab4153bf719e8', 'request_id': 'req-b9b9484e-ddc0-42aa-87f6-a06fa378e93f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:53.844668 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-b9b9484e-ddc0-42aa-87f6-a06fa378e93f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dc8dbcff9fe4d9c836ab4153bf719e8', 'request_id': 'req-b9b9484e-ddc0-42aa-87f6-a06fa378e93f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:53.853106 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-b9b9484e-ddc0-42aa-87f6-a06fa378e93f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dc8dbcff9fe4d9c836ab4153bf719e8', 'request_id': 'req-b9b9484e-ddc0-42aa-87f6-a06fa378e93f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:53.864743 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-b9b9484e-ddc0-42aa-87f6-a06fa378e93f admin admin] The token cache is being invalidate because project 6dc8dbcff9fe4d9c836ab4153bf719e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:40:53.865034 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-b9b9484e-ddc0-42aa-87f6-a06fa378e93f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:53.865668 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-b9b9484e-ddc0-42aa-87f6-a06fa378e93f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:53.867254 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1412/2850] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:40:53 2022] DELETE /identity/v3/projects/6dc8dbcff9fe4d9c836ab4153bf719e8 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:40:53.871329 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c81ab8-252f-4e7d-8130-309e3bb69aa3 service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:53.882174 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c81ab8-252f-4e7d-8130-309e3bb69aa3 service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:53.947495 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803038d8-ff03-41be-b352-8d1f64257b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:53.948406 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803038d8-ff03-41be-b352-8d1f64257b5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:53.948682 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803038d8-ff03-41be-b352-8d1f64257b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:53.948950 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803038d8-ff03-41be-b352-8d1f64257b5f admin admin] PATH_INFO: `/v3/users/5e867c55efaa47dfaee8b9eb3d74d9b6` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:53.950213 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803038d8-ff03-41be-b352-8d1f64257b5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e867c55efaa47dfaee8b9eb3d74d9b6)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:53.952224 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803038d8-ff03-41be-b352-8d1f64257b5f admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:53.968514 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:40:54.001638 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-803038d8-ff03-41be-b352-8d1f64257b5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e867c55efaa47dfaee8b9eb3d74d9b6'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:54.002433 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-803038d8-ff03-41be-b352-8d1f64257b5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e867c55efaa47dfaee8b9eb3d74d9b6'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:54.012002 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-803038d8-ff03-41be-b352-8d1f64257b5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e867c55efaa47dfaee8b9eb3d74d9b6'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:54.012807 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-803038d8-ff03-41be-b352-8d1f64257b5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e867c55efaa47dfaee8b9eb3d74d9b6'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:54.025511 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-803038d8-ff03-41be-b352-8d1f64257b5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e867c55efaa47dfaee8b9eb3d74d9b6'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:54.041936 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1439/2851] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:40:53 2022] DELETE /identity/v3/users/5e867c55efaa47dfaee8b9eb3d74d9b6 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:40:54.124789 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b9484e-ddc0-42aa-87f6-a06fa378e93f admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:54.126326 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b9b9484e-ddc0-42aa-87f6-a06fa378e93f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:40:54.194638 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:40:54.202487 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b9484e-ddc0-42aa-87f6-a06fa378e93f admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:54.289062 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff13d3d-df12-4a25-a01b-9497d90b7ac0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dafc9be75a64db095fe08b9cbb04cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:54.290042 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff13d3d-df12-4a25-a01b-9497d90b7ac0 service placement] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:54.290438 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff13d3d-df12-4a25-a01b-9497d90b7ac0 service placement] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:54.290852 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff13d3d-df12-4a25-a01b-9497d90b7ac0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:54.293378 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-aff13d3d-df12-4a25-a01b-9497d90b7ac0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:40:54.305492 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff13d3d-df12-4a25-a01b-9497d90b7ac0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:54.307159 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff13d3d-df12-4a25-a01b-9497d90b7ac0 service placement] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:54.317515 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1413/2852] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:40:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 03:40:54.365768 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803038d8-ff03-41be-b352-8d1f64257b5f admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:54.368822 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-803038d8-ff03-41be-b352-8d1f64257b5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:40:54.448813 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803038d8-ff03-41be-b352-8d1f64257b5f admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:54.453955 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5157eb-59d1-4a57-9bbf-0470ccc2707f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:54.454971 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5157eb-59d1-4a57-9bbf-0470ccc2707f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:54.455260 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5157eb-59d1-4a57-9bbf-0470ccc2707f admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:54.455531 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5157eb-59d1-4a57-9bbf-0470ccc2707f admin admin] PATH_INFO: `/v3/projects/a2d039def32949b697377cd88c637940` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:54.456794 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5157eb-59d1-4a57-9bbf-0470ccc2707f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2d039def32949b697377cd88c637940)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:54.458783 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5157eb-59d1-4a57-9bbf-0470ccc2707f admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:54.515097 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-9a5157eb-59d1-4a57-9bbf-0470ccc2707f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2d039def32949b697377cd88c637940', 'request_id': 'req-9a5157eb-59d1-4a57-9bbf-0470ccc2707f'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:54.520491 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-9a5157eb-59d1-4a57-9bbf-0470ccc2707f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2d039def32949b697377cd88c637940', 'request_id': 'req-9a5157eb-59d1-4a57-9bbf-0470ccc2707f'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:54.526859 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-9a5157eb-59d1-4a57-9bbf-0470ccc2707f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2d039def32949b697377cd88c637940', 'request_id': 'req-9a5157eb-59d1-4a57-9bbf-0470ccc2707f'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:54.541218 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-9a5157eb-59d1-4a57-9bbf-0470ccc2707f admin admin] The token cache is being invalidate because project a2d039def32949b697377cd88c637940 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:40:54.541505 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-9a5157eb-59d1-4a57-9bbf-0470ccc2707f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:54.542111 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-9a5157eb-59d1-4a57-9bbf-0470ccc2707f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:54.544230 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1440/2853] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:40:54 2022] DELETE /identity/v3/projects/a2d039def32949b697377cd88c637940 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:40:54.549567 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e8dc7-afa6-4166-9dbe-15f42dd898eb None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:54.549854 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e8dc7-afa6-4166-9dbe-15f42dd898eb None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:54.550133 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e8dc7-afa6-4166-9dbe-15f42dd898eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:54.570812 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-634e8dc7-afa6-4166-9dbe-15f42dd898eb None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:40:54.572041 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-634e8dc7-afa6-4166-9dbe-15f42dd898eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:40:54.642737 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1414/2854] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:40:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:40:54.650682 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc29c5-a42d-4f28-87d7-830ee26c844a None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:54.650999 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc29c5-a42d-4f28-87d7-830ee26c844a None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:54.651294 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc29c5-a42d-4f28-87d7-830ee26c844a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:54.670839 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-abcc29c5-a42d-4f28-87d7-830ee26c844a None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:40:54.672079 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-abcc29c5-a42d-4f28-87d7-830ee26c844a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:40:54.680149 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1441/2855] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:40:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:40:54.684618 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634e8dc7-afa6-4166-9dbe-15f42dd898eb None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:54.694638 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634e8dc7-afa6-4166-9dbe-15f42dd898eb None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:54.700588 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d301a4f-8585-4a03-ac3a-454b96adf394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:54.701342 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d301a4f-8585-4a03-ac3a-454b96adf394 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:54.701727 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d301a4f-8585-4a03-ac3a-454b96adf394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:54.701998 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d301a4f-8585-4a03-ac3a-454b96adf394 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:54.702928 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d301a4f-8585-4a03-ac3a-454b96adf394 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:40:54.703302 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d301a4f-8585-4a03-ac3a-454b96adf394 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:54.705177 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d301a4f-8585-4a03-ac3a-454b96adf394 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:54.718902 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1415/2856] 10.222.0.60 () {58 vars in 1152 bytes} [Sat Jul 2 03:40:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:40:54.723935 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc29c5-a42d-4f28-87d7-830ee26c844a None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:54.734193 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc29c5-a42d-4f28-87d7-830ee26c844a None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:54.739358 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f1220a-2f2f-4e7e-bfb4-df743e5b0ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:54.740028 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f1220a-2f2f-4e7e-bfb4-df743e5b0ece admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:54.740305 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f1220a-2f2f-4e7e-bfb4-df743e5b0ece admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:54.740576 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f1220a-2f2f-4e7e-bfb4-df743e5b0ece admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:54.741269 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f1220a-2f2f-4e7e-bfb4-df743e5b0ece admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:54.743213 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f1220a-2f2f-4e7e-bfb4-df743e5b0ece admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:54.758763 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:DELETE=16,keystone:SELECT=81,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:40:54.775561 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1442/2857] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:40:54 2022] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:40:54.777091 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d301a4f-8585-4a03-ac3a-454b96adf394 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:54.787687 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d301a4f-8585-4a03-ac3a-454b96adf394 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:54.842783 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e19c5e-2062-4ae5-a774-3cc62fef10de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:54.843478 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e19c5e-2062-4ae5-a774-3cc62fef10de admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:54.843754 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e19c5e-2062-4ae5-a774-3cc62fef10de admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:54.844025 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e19c5e-2062-4ae5-a774-3cc62fef10de admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:54.844720 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e19c5e-2062-4ae5-a774-3cc62fef10de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:54.846656 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e19c5e-2062-4ae5-a774-3cc62fef10de admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:54.872398 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1416/2858] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:40:54 2022] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:40:54.873673 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f1220a-2f2f-4e7e-bfb4-df743e5b0ece admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:54.884637 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f1220a-2f2f-4e7e-bfb4-df743e5b0ece admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:54.889357 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691b9ae1-b9cd-4f8b-8563-03f0ae221991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:54.890015 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b9ae1-b9cd-4f8b-8563-03f0ae221991 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:54.890292 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b9ae1-b9cd-4f8b-8563-03f0ae221991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:54.890563 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b9ae1-b9cd-4f8b-8563-03f0ae221991 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:54.891317 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691b9ae1-b9cd-4f8b-8563-03f0ae221991 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:54.892906 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691b9ae1-b9cd-4f8b-8563-03f0ae221991 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:54.903789 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1443/2859] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:40:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:40:54.907977 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e19c5e-2062-4ae5-a774-3cc62fef10de admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:54.918514 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e19c5e-2062-4ae5-a774-3cc62fef10de admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:54.923453 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69046575-e646-4cd1-8ffd-2eda9dd8da60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:54.924126 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69046575-e646-4cd1-8ffd-2eda9dd8da60 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:54.924403 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69046575-e646-4cd1-8ffd-2eda9dd8da60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:54.924674 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69046575-e646-4cd1-8ffd-2eda9dd8da60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:54.925406 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69046575-e646-4cd1-8ffd-2eda9dd8da60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:54.927091 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69046575-e646-4cd1-8ffd-2eda9dd8da60 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:54.929439 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:40:54.940279 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1417/2860] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:40:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 03:40:54.944505 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691b9ae1-b9cd-4f8b-8563-03f0ae221991 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:54.954722 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691b9ae1-b9cd-4f8b-8563-03f0ae221991 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:54.960468 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd515c2-df76-41a1-b1df-c2a894d3d458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:54.961358 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd515c2-df76-41a1-b1df-c2a894d3d458 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:54.961643 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd515c2-df76-41a1-b1df-c2a894d3d458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:54.961920 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd515c2-df76-41a1-b1df-c2a894d3d458 admin admin] PATH_INFO: `/v3/projects/4b881eb5fe614442baebe36c380d673c/users/7b0198d5a0c64d07b421c296655ba248/roles/c43aada0326446c4ade0ab1262918fa4` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:54.977772 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd515c2-df76-41a1-b1df-c2a894d3d458 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b881eb5fe614442baebe36c380d673c, user_id=7b0198d5a0c64d07b421c296655ba248, role_id=c43aada0326446c4ade0ab1262918fa4)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:54.980483 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd515c2-df76-41a1-b1df-c2a894d3d458 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:54.994876 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1444/2861] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:40:54 2022] PUT /identity/v3/projects/4b881eb5fe614442baebe36c380d673c/users/7b0198d5a0c64d07b421c296655ba248/roles/c43aada0326446c4ade0ab1262918fa4 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 03:40:55.060479 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988539c-0353-4da7-a2b9-5093f088ef9f None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:55.060714 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988539c-0353-4da7-a2b9-5093f088ef9f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:55.060924 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988539c-0353-4da7-a2b9-5093f088ef9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:55.093416 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-c988539c-0353-4da7-a2b9-5093f088ef9f None None] MFA Rules not processed for user `7b0198d5a0c64d07b421c296655ba248`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:40:55.094649 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c988539c-0353-4da7-a2b9-5093f088ef9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:40:55.164199 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1418/2862] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:40:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:40:55.169049 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd515c2-df76-41a1-b1df-c2a894d3d458 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:55.236559 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd515c2-df76-41a1-b1df-c2a894d3d458 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:55.242099 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523274e-a3ef-4d14-a234-194701128791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:55.243633 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523274e-a3ef-4d14-a234-194701128791 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:55.244129 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523274e-a3ef-4d14-a234-194701128791 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:55.244521 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523274e-a3ef-4d14-a234-194701128791 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:55.245407 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6523274e-a3ef-4d14-a234-194701128791 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:55.248376 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6523274e-a3ef-4d14-a234-194701128791 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:55.281570 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1445/2863] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:40:55 2022] POST /identity/v3/projects => generated 381 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:40:55.285859 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c988539c-0353-4da7-a2b9-5093f088ef9f None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:55.299751 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c988539c-0353-4da7-a2b9-5093f088ef9f None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:55.381524 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c9f8a2-6b5e-4eb2-b625-0268f24f2222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:55.382300 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c9f8a2-6b5e-4eb2-b625-0268f24f2222 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:55.382657 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c9f8a2-6b5e-4eb2-b625-0268f24f2222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:55.383014 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c9f8a2-6b5e-4eb2-b625-0268f24f2222 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:55.383821 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c9f8a2-6b5e-4eb2-b625-0268f24f2222 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:55.386036 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c9f8a2-6b5e-4eb2-b625-0268f24f2222 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:55.412049 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1419/2864] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:40:55 2022] POST /identity/v3/users => generated 297 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 03:40:55.416199 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523274e-a3ef-4d14-a234-194701128791 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:55.426849 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523274e-a3ef-4d14-a234-194701128791 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:55.431494 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3cfd28-9d56-4fc8-8951-9bbe54505c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:55.432185 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3cfd28-9d56-4fc8-8951-9bbe54505c1d admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:55.432465 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3cfd28-9d56-4fc8-8951-9bbe54505c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:55.432736 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3cfd28-9d56-4fc8-8951-9bbe54505c1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:55.433484 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3cfd28-9d56-4fc8-8951-9bbe54505c1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:55.435090 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3cfd28-9d56-4fc8-8951-9bbe54505c1d admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:55.446122 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1446/2865] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:40:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 03:40:55.450567 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c9f8a2-6b5e-4eb2-b625-0268f24f2222 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:55.461617 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c9f8a2-6b5e-4eb2-b625-0268f24f2222 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:55.467026 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa8ee55-a851-4c1e-b0a5-bed8066059df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:55.467904 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8ee55-a851-4c1e-b0a5-bed8066059df admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:55.468182 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8ee55-a851-4c1e-b0a5-bed8066059df admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:55.468457 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8ee55-a851-4c1e-b0a5-bed8066059df admin admin] PATH_INFO: `/v3/projects/7d2450ec619541e592de76a71f6ff005/users/c827fd6884144c4d9f5d038870400860/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:55.484812 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa8ee55-a851-4c1e-b0a5-bed8066059df admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d2450ec619541e592de76a71f6ff005, user_id=c827fd6884144c4d9f5d038870400860, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:55.487725 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa8ee55-a851-4c1e-b0a5-bed8066059df admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:55.503158 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1420/2866] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:40:55 2022] PUT /identity/v3/projects/7d2450ec619541e592de76a71f6ff005/users/c827fd6884144c4d9f5d038870400860/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:40:55.506886 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3cfd28-9d56-4fc8-8951-9bbe54505c1d admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:55.518032 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3cfd28-9d56-4fc8-8951-9bbe54505c1d admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:55.579064 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a59e8b-5f22-4b28-a110-50359660c2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:55.579800 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a59e8b-5f22-4b28-a110-50359660c2d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:55.580078 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a59e8b-5f22-4b28-a110-50359660c2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:55.580356 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a59e8b-5f22-4b28-a110-50359660c2d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:55.581111 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a59e8b-5f22-4b28-a110-50359660c2d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:55.582895 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a59e8b-5f22-4b28-a110-50359660c2d9 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:55.593433 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1447/2867] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:40:55 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 03:40:55.597745 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa8ee55-a851-4c1e-b0a5-bed8066059df admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:55.608573 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa8ee55-a851-4c1e-b0a5-bed8066059df admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:55.614723 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3912f781-6c04-4e55-b3c2-c5944fc97955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:55.615710 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3912f781-6c04-4e55-b3c2-c5944fc97955 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:55.615989 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3912f781-6c04-4e55-b3c2-c5944fc97955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:55.616264 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3912f781-6c04-4e55-b3c2-c5944fc97955 admin admin] PATH_INFO: `/v3/projects/7d2450ec619541e592de76a71f6ff005/users/c827fd6884144c4d9f5d038870400860/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:55.618641 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3912f781-6c04-4e55-b3c2-c5944fc97955 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d2450ec619541e592de76a71f6ff005, user_id=c827fd6884144c4d9f5d038870400860, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:55.621498 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3912f781-6c04-4e55-b3c2-c5944fc97955 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:55.634718 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1421/2868] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:40:55 2022] PUT /identity/v3/projects/7d2450ec619541e592de76a71f6ff005/users/c827fd6884144c4d9f5d038870400860/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:40:55.645476 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067974d-7ba4-4191-951c-5db8682b2b5e None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:55.645762 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067974d-7ba4-4191-951c-5db8682b2b5e None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:55.646082 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067974d-7ba4-4191-951c-5db8682b2b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:55.680611 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-2067974d-7ba4-4191-951c-5db8682b2b5e None None] MFA Rules not processed for user `c827fd6884144c4d9f5d038870400860`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:40:55.682367 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-2067974d-7ba4-4191-951c-5db8682b2b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:40:55.702122 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:40:55.761526 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1448/2869] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:40:55 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:40:55.776237 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3912f781-6c04-4e55-b3c2-c5944fc97955 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:55.778154 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3912f781-6c04-4e55-b3c2-c5944fc97955 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:40:55.830110 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:40:55.849462 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3912f781-6c04-4e55-b3c2-c5944fc97955 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:55.854111 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c16daf-b316-4f58-a59e-26315a1541e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:55.855481 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c16daf-b316-4f58-a59e-26315a1541e0 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:55.855841 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c16daf-b316-4f58-a59e-26315a1541e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:55.856253 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c16daf-b316-4f58-a59e-26315a1541e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:55.867363 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c16daf-b316-4f58-a59e-26315a1541e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:55.868863 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c16daf-b316-4f58-a59e-26315a1541e0 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:55.879079 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1422/2870] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:40:55 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:40:55.984871 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2067974d-7ba4-4191-951c-5db8682b2b5e None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:55.995974 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2067974d-7ba4-4191-951c-5db8682b2b5e None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:56.000133 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf858e6e-edf5-485a-88be-64e2d4dea364 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:56.000794 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf858e6e-edf5-485a-88be-64e2d4dea364 service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:56.001093 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf858e6e-edf5-485a-88be-64e2d4dea364 service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:56.001347 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf858e6e-edf5-485a-88be-64e2d4dea364 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:56.063423 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf858e6e-edf5-485a-88be-64e2d4dea364 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:56.064891 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf858e6e-edf5-485a-88be-64e2d4dea364 service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:56.076425 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1449/2871] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:40:55 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:40:56.159723 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c16daf-b316-4f58-a59e-26315a1541e0 service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:56.163054 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-65c16daf-b316-4f58-a59e-26315a1541e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:40:56.226173 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c16daf-b316-4f58-a59e-26315a1541e0 service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:56.231296 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cdb50b-7fc1-4509-963f-a5f113a35b20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:56.231870 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cdb50b-7fc1-4509-963f-a5f113a35b20 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:56.232166 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cdb50b-7fc1-4509-963f-a5f113a35b20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:56.232429 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cdb50b-7fc1-4509-963f-a5f113a35b20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:56.234273 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a9cdb50b-7fc1-4509-963f-a5f113a35b20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:40:56.244920 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cdb50b-7fc1-4509-963f-a5f113a35b20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:56.246354 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cdb50b-7fc1-4509-963f-a5f113a35b20 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:56.255227 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1423/2872] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:40:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:40:57.012246 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf858e6e-edf5-485a-88be-64e2d4dea364 service cinder] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:57.015375 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-cf858e6e-edf5-485a-88be-64e2d4dea364 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:40:57.105577 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf858e6e-edf5-485a-88be-64e2d4dea364 service cinder] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:57.112756 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36282b8a-0471-49e5-8055-460d65e3b803 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13530240e2d446b6bf26a431d001362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:57.113430 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36282b8a-0471-49e5-8055-460d65e3b803 service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:57.113833 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36282b8a-0471-49e5-8055-460d65e3b803 service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:57.114114 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36282b8a-0471-49e5-8055-460d65e3b803 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:57.116243 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-36282b8a-0471-49e5-8055-460d65e3b803 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:40:57.130537 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36282b8a-0471-49e5-8055-460d65e3b803 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:57.132212 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36282b8a-0471-49e5-8055-460d65e3b803 service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:57.145717 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1450/2873] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:40:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:40:58.733023 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cdb50b-7fc1-4509-963f-a5f113a35b20 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:58.808701 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cdb50b-7fc1-4509-963f-a5f113a35b20 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:58.813884 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc39d346-bea2-4306-946b-1fc369d9e5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:58.814810 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39d346-bea2-4306-946b-1fc369d9e5ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:58.815149 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39d346-bea2-4306-946b-1fc369d9e5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:58.815511 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39d346-bea2-4306-946b-1fc369d9e5ea admin admin] PATH_INFO: `/v3/users/7b0198d5a0c64d07b421c296655ba248` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:58.816808 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc39d346-bea2-4306-946b-1fc369d9e5ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b0198d5a0c64d07b421c296655ba248)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:58.818822 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc39d346-bea2-4306-946b-1fc369d9e5ea admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:58.868110 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-bc39d346-bea2-4306-946b-1fc369d9e5ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b0198d5a0c64d07b421c296655ba248'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:58.868852 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-bc39d346-bea2-4306-946b-1fc369d9e5ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b0198d5a0c64d07b421c296655ba248'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:58.869498 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-bc39d346-bea2-4306-946b-1fc369d9e5ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b0198d5a0c64d07b421c296655ba248'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:58.884599 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-bc39d346-bea2-4306-946b-1fc369d9e5ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b0198d5a0c64d07b421c296655ba248'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:58.892825 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-bc39d346-bea2-4306-946b-1fc369d9e5ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b0198d5a0c64d07b421c296655ba248'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:58.907308 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1424/2874] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:40:58 2022] DELETE /identity/v3/users/7b0198d5a0c64d07b421c296655ba248 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:40:58.912355 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1250ba-a787-46fd-a807-1f98a7bdfdc4 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:58.912782 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1250ba-a787-46fd-a807-1f98a7bdfdc4 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:58.913066 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1250ba-a787-46fd-a807-1f98a7bdfdc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:58.931278 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-8a1250ba-a787-46fd-a807-1f98a7bdfdc4 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:40:58.932641 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-8a1250ba-a787-46fd-a807-1f98a7bdfdc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:40:58.967411 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:40:58.993881 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1451/2875] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:40:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:40:59.003607 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc39d346-bea2-4306-946b-1fc369d9e5ea admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:59.005266 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-bc39d346-bea2-4306-946b-1fc369d9e5ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:40:59.012277 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:40:59.084209 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc39d346-bea2-4306-946b-1fc369d9e5ea admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:59.088745 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac3646c-ebf8-45ff-8410-9f9a7dd5b4fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:59.089369 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3646c-ebf8-45ff-8410-9f9a7dd5b4fa service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:59.089649 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3646c-ebf8-45ff-8410-9f9a7dd5b4fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:59.089923 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3646c-ebf8-45ff-8410-9f9a7dd5b4fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:59.100221 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac3646c-ebf8-45ff-8410-9f9a7dd5b4fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:59.101666 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac3646c-ebf8-45ff-8410-9f9a7dd5b4fa service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:59.112022 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1425/2876] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:40:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:40:59.398798 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1250ba-a787-46fd-a807-1f98a7bdfdc4 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:59.400266 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-8a1250ba-a787-46fd-a807-1f98a7bdfdc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:40:59.414198 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1250ba-a787-46fd-a807-1f98a7bdfdc4 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:59.419897 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c9db8b-c1ab-43c9-a84c-7eb5d7bb0fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:59.420794 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c9db8b-c1ab-43c9-a84c-7eb5d7bb0fd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:59.421113 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c9db8b-c1ab-43c9-a84c-7eb5d7bb0fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:59.421392 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c9db8b-c1ab-43c9-a84c-7eb5d7bb0fd7 admin admin] PATH_INFO: `/v3/projects/4b881eb5fe614442baebe36c380d673c` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:59.422736 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c9db8b-c1ab-43c9-a84c-7eb5d7bb0fd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b881eb5fe614442baebe36c380d673c)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:59.424817 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c9db8b-c1ab-43c9-a84c-7eb5d7bb0fd7 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:59.480188 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-52c9db8b-c1ab-43c9-a84c-7eb5d7bb0fd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b881eb5fe614442baebe36c380d673c', 'request_id': 'req-52c9db8b-c1ab-43c9-a84c-7eb5d7bb0fd7'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:59.486485 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-52c9db8b-c1ab-43c9-a84c-7eb5d7bb0fd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b881eb5fe614442baebe36c380d673c', 'request_id': 'req-52c9db8b-c1ab-43c9-a84c-7eb5d7bb0fd7'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:59.493342 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-52c9db8b-c1ab-43c9-a84c-7eb5d7bb0fd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b881eb5fe614442baebe36c380d673c', 'request_id': 'req-52c9db8b-c1ab-43c9-a84c-7eb5d7bb0fd7'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:59.506957 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-52c9db8b-c1ab-43c9-a84c-7eb5d7bb0fd7 admin admin] The token cache is being invalidate because project 4b881eb5fe614442baebe36c380d673c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:40:59.507285 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-52c9db8b-c1ab-43c9-a84c-7eb5d7bb0fd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:59.507931 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-52c9db8b-c1ab-43c9-a84c-7eb5d7bb0fd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:59.509545 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1452/2877] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:40:59 2022] DELETE /identity/v3/projects/4b881eb5fe614442baebe36c380d673c => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:40:59.513707 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac3646c-ebf8-45ff-8410-9f9a7dd5b4fa service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:59.523945 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac3646c-ebf8-45ff-8410-9f9a7dd5b4fa service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:40:59.583677 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbdbfb0-a360-4e8d-aace-3841d9db674f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:40:59.584608 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbdbfb0-a360-4e8d-aace-3841d9db674f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:40:59.584890 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbdbfb0-a360-4e8d-aace-3841d9db674f admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:40:59.585160 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbdbfb0-a360-4e8d-aace-3841d9db674f admin admin] PATH_INFO: `/v3/users/c827fd6884144c4d9f5d038870400860` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:40:59.586519 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbdbfb0-a360-4e8d-aace-3841d9db674f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c827fd6884144c4d9f5d038870400860)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:40:59.588566 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbdbfb0-a360-4e8d-aace-3841d9db674f admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:40:59.641901 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-8dbdbfb0-a360-4e8d-aace-3841d9db674f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c827fd6884144c4d9f5d038870400860'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:59.642599 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-8dbdbfb0-a360-4e8d-aace-3841d9db674f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c827fd6884144c4d9f5d038870400860'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:59.643260 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-8dbdbfb0-a360-4e8d-aace-3841d9db674f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c827fd6884144c4d9f5d038870400860'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:59.656690 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-8dbdbfb0-a360-4e8d-aace-3841d9db674f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c827fd6884144c4d9f5d038870400860'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:59.666728 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-8dbdbfb0-a360-4e8d-aace-3841d9db674f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c827fd6884144c4d9f5d038870400860'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:40:59.682192 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1426/2878] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:40:59 2022] DELETE /identity/v3/users/c827fd6884144c4d9f5d038870400860 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 03:40:59.969585 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c9db8b-c1ab-43c9-a84c-7eb5d7bb0fd7 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:40:59.971799 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-52c9db8b-c1ab-43c9-a84c-7eb5d7bb0fd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:40:59.993138 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c9db8b-c1ab-43c9-a84c-7eb5d7bb0fd7 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:41:00.070845 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fd9ebc-c6c2-4f6b-866d-5a7a0c24c7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:41:00.071751 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd9ebc-c6c2-4f6b-866d-5a7a0c24c7d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:41:00.072032 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd9ebc-c6c2-4f6b-866d-5a7a0c24c7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:41:00.072331 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd9ebc-c6c2-4f6b-866d-5a7a0c24c7d5 admin admin] PATH_INFO: `/v3/projects/7d2450ec619541e592de76a71f6ff005` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:41:00.073541 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fd9ebc-c6c2-4f6b-866d-5a7a0c24c7d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d2450ec619541e592de76a71f6ff005)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:41:00.075488 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fd9ebc-c6c2-4f6b-866d-5a7a0c24c7d5 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:41:00.123276 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-71fd9ebc-c6c2-4f6b-866d-5a7a0c24c7d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d2450ec619541e592de76a71f6ff005', 'request_id': 'req-71fd9ebc-c6c2-4f6b-866d-5a7a0c24c7d5'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:41:00.130146 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-71fd9ebc-c6c2-4f6b-866d-5a7a0c24c7d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d2450ec619541e592de76a71f6ff005', 'request_id': 'req-71fd9ebc-c6c2-4f6b-866d-5a7a0c24c7d5'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:41:00.136847 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-71fd9ebc-c6c2-4f6b-866d-5a7a0c24c7d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d2450ec619541e592de76a71f6ff005', 'request_id': 'req-71fd9ebc-c6c2-4f6b-866d-5a7a0c24c7d5'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:41:00.139458 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:41:00.153521 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-71fd9ebc-c6c2-4f6b-866d-5a7a0c24c7d5 admin admin] The token cache is being invalidate because project 7d2450ec619541e592de76a71f6ff005 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:41:00.154300 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-71fd9ebc-c6c2-4f6b-866d-5a7a0c24c7d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:41:00.154925 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-71fd9ebc-c6c2-4f6b-866d-5a7a0c24c7d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:41:00.156792 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1453/2879] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:40:59 2022] DELETE /identity/v3/projects/7d2450ec619541e592de76a71f6ff005 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 03:41:00.162265 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df176d-c416-4757-9323-b780d52374e6 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:41:00.162753 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df176d-c416-4757-9323-b780d52374e6 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:41:00.162838 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df176d-c416-4757-9323-b780d52374e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:41:00.182361 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-69df176d-c416-4757-9323-b780d52374e6 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:41:00.183619 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-69df176d-c416-4757-9323-b780d52374e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:41:00.206328 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:41:00.264190 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1427/2880] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:41:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:41:00.272431 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c273ae4-ecf6-4863-8b53-d9a97bdfcd47 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:41:00.272724 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c273ae4-ecf6-4863-8b53-d9a97bdfcd47 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:41:00.273001 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c273ae4-ecf6-4863-8b53-d9a97bdfcd47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:41:00.292185 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-0c273ae4-ecf6-4863-8b53-d9a97bdfcd47 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:41:00.293408 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-0c273ae4-ecf6-4863-8b53-d9a97bdfcd47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:41:00.301438 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1454/2881] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:41:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:41:00.305734 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69df176d-c416-4757-9323-b780d52374e6 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:41:00.316242 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69df176d-c416-4757-9323-b780d52374e6 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:41:00.321212 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aad12d-1477-412d-b574-c0baa8263646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:41:00.321842 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aad12d-1477-412d-b574-c0baa8263646 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:41:00.322160 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aad12d-1477-412d-b574-c0baa8263646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:41:00.322429 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aad12d-1477-412d-b574-c0baa8263646 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:41:00.323197 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aad12d-1477-412d-b574-c0baa8263646 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 03:41:00.323510 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aad12d-1477-412d-b574-c0baa8263646 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:41:00.325139 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aad12d-1477-412d-b574-c0baa8263646 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:41:00.340752 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1428/2882] 10.222.0.60 () {58 vars in 1152 bytes} [Sat Jul 2 03:41:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 03:41:00.346446 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c273ae4-ecf6-4863-8b53-d9a97bdfcd47 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:41:00.363396 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c273ae4-ecf6-4863-8b53-d9a97bdfcd47 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:41:00.370374 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b634471-85b4-4a1d-8242-e1249ece2168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:41:00.370374 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b634471-85b4-4a1d-8242-e1249ece2168 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:41:00.370374 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b634471-85b4-4a1d-8242-e1249ece2168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:41:00.370721 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b634471-85b4-4a1d-8242-e1249ece2168 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:41:00.371364 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b634471-85b4-4a1d-8242-e1249ece2168 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:41:00.373293 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b634471-85b4-4a1d-8242-e1249ece2168 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:41:00.402771 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1455/2883] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:41:00 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 03:41:00.409065 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aad12d-1477-412d-b574-c0baa8263646 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:41:00.420039 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aad12d-1477-412d-b574-c0baa8263646 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:41:00.485426 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022ff1dd-9eee-481e-b014-4719409290c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:41:00.486394 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ff1dd-9eee-481e-b014-4719409290c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:41:00.486792 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ff1dd-9eee-481e-b014-4719409290c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:41:00.487316 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ff1dd-9eee-481e-b014-4719409290c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:41:00.488158 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022ff1dd-9eee-481e-b014-4719409290c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:41:00.490407 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022ff1dd-9eee-481e-b014-4719409290c8 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:41:00.514744 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1429/2884] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:41:00 2022] POST /identity/v3/users => generated 287 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:41:00.520233 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b634471-85b4-4a1d-8242-e1249ece2168 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:41:00.531987 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b634471-85b4-4a1d-8242-e1249ece2168 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:41:00.537821 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9608ba-4e52-41e5-8a77-19701221408d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:41:00.538509 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9608ba-4e52-41e5-8a77-19701221408d admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:41:00.538787 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9608ba-4e52-41e5-8a77-19701221408d admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:41:00.539046 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9608ba-4e52-41e5-8a77-19701221408d admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:41:00.539812 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9608ba-4e52-41e5-8a77-19701221408d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:41:00.541409 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9608ba-4e52-41e5-8a77-19701221408d admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:41:00.554724 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1456/2885] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:41:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:41:00.558984 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022ff1dd-9eee-481e-b014-4719409290c8 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:41:00.572448 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022ff1dd-9eee-481e-b014-4719409290c8 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:41:00.577724 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9473a91-4580-42b8-8161-bb92a62f0967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:41:00.578397 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9473a91-4580-42b8-8161-bb92a62f0967 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:41:00.578683 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9473a91-4580-42b8-8161-bb92a62f0967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:41:00.578961 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9473a91-4580-42b8-8161-bb92a62f0967 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:41:00.580743 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9473a91-4580-42b8-8161-bb92a62f0967 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:41:00.581355 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9473a91-4580-42b8-8161-bb92a62f0967 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:41:00.591857 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1430/2886] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:41:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:41:00.596485 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9608ba-4e52-41e5-8a77-19701221408d admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:41:00.607253 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9608ba-4e52-41e5-8a77-19701221408d admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:41:00.615580 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d10a62-d990-4396-a7c3-5eff0f30187a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:41:00.616497 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d10a62-d990-4396-a7c3-5eff0f30187a admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:41:00.616780 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d10a62-d990-4396-a7c3-5eff0f30187a admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:41:00.617056 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d10a62-d990-4396-a7c3-5eff0f30187a admin admin] PATH_INFO: `/v3/projects/a4b664d6be194ead9b56168c0e9f0d46/users/9293e50ec9734262a765767aa91714db/roles/c43aada0326446c4ade0ab1262918fa4` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:41:00.634563 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d10a62-d990-4396-a7c3-5eff0f30187a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4b664d6be194ead9b56168c0e9f0d46, user_id=9293e50ec9734262a765767aa91714db, role_id=c43aada0326446c4ade0ab1262918fa4)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:41:00.637314 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d10a62-d990-4396-a7c3-5eff0f30187a admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:41:00.654479 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1457/2887] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:41:00 2022] PUT /identity/v3/projects/a4b664d6be194ead9b56168c0e9f0d46/users/9293e50ec9734262a765767aa91714db/roles/c43aada0326446c4ade0ab1262918fa4 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:41:00.667413 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c01b9e9-9926-4d8a-809f-a60993138ead None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:41:00.667750 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c01b9e9-9926-4d8a-809f-a60993138ead None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:41:00.668150 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c01b9e9-9926-4d8a-809f-a60993138ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:41:00.696291 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-9c01b9e9-9926-4d8a-809f-a60993138ead None None] MFA Rules not processed for user `9293e50ec9734262a765767aa91714db`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:41:00.697504 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9c01b9e9-9926-4d8a-809f-a60993138ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:41:00.778613 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1431/2888] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:41:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:41:00.783477 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d10a62-d990-4396-a7c3-5eff0f30187a admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:41:00.857115 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d10a62-d990-4396-a7c3-5eff0f30187a admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:41:00.862565 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7320a4f8-d762-4fb7-a39a-b657a938fe82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:41:00.863280 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320a4f8-d762-4fb7-a39a-b657a938fe82 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:41:00.863584 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320a4f8-d762-4fb7-a39a-b657a938fe82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:41:00.863862 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320a4f8-d762-4fb7-a39a-b657a938fe82 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:41:00.864563 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7320a4f8-d762-4fb7-a39a-b657a938fe82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:41:00.866480 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7320a4f8-d762-4fb7-a39a-b657a938fe82 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:41:00.897486 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1458/2889] 10.222.0.60 () {60 vars in 1152 bytes} [Sat Jul 2 03:41:00 2022] POST /identity/v3/projects => generated 375 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:41:00.901782 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c01b9e9-9926-4d8a-809f-a60993138ead None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:41:00.913414 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c01b9e9-9926-4d8a-809f-a60993138ead None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:41:00.933161 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:41:00.976428 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f8534c-2727-46e7-8e4d-1254982cfe40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:41:00.977104 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8534c-2727-46e7-8e4d-1254982cfe40 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:41:00.977388 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8534c-2727-46e7-8e4d-1254982cfe40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:41:00.977660 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8534c-2727-46e7-8e4d-1254982cfe40 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:41:00.978353 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f8534c-2727-46e7-8e4d-1254982cfe40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:41:00.980324 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f8534c-2727-46e7-8e4d-1254982cfe40 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:41:01.011114 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1432/2890] 10.222.0.60 () {60 vars in 1143 bytes} [Sat Jul 2 03:41:00 2022] POST /identity/v3/users => generated 294 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 03:41:01.017762 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7320a4f8-d762-4fb7-a39a-b657a938fe82 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:41:01.032144 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7320a4f8-d762-4fb7-a39a-b657a938fe82 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:41:01.038380 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321cfe26-1901-4152-961c-79441b47d098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:41:01.039049 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321cfe26-1901-4152-961c-79441b47d098 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:41:01.039362 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321cfe26-1901-4152-961c-79441b47d098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:41:01.039639 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321cfe26-1901-4152-961c-79441b47d098 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:41:01.040382 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321cfe26-1901-4152-961c-79441b47d098 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:41:01.041990 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321cfe26-1901-4152-961c-79441b47d098 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:41:01.053827 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1459/2891] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:41:01 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:41:01.058199 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f8534c-2727-46e7-8e4d-1254982cfe40 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:41:01.069795 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f8534c-2727-46e7-8e4d-1254982cfe40 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:41:01.075943 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a71be1-9e05-48cb-a9bb-2717bd4b2118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:41:01.076873 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a71be1-9e05-48cb-a9bb-2717bd4b2118 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:41:01.077207 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a71be1-9e05-48cb-a9bb-2717bd4b2118 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:41:01.077530 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a71be1-9e05-48cb-a9bb-2717bd4b2118 admin admin] PATH_INFO: `/v3/projects/ac622d5b3d2945fc88e130f6f38df574/users/53e3beddb6b545c8ae5a3623b00fc317/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:41:01.095251 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a71be1-9e05-48cb-a9bb-2717bd4b2118 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac622d5b3d2945fc88e130f6f38df574, user_id=53e3beddb6b545c8ae5a3623b00fc317, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:41:01.097940 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a71be1-9e05-48cb-a9bb-2717bd4b2118 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:41:01.114257 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1433/2892] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:41:01 2022] PUT /identity/v3/projects/ac622d5b3d2945fc88e130f6f38df574/users/53e3beddb6b545c8ae5a3623b00fc317/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:41:01.118385 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321cfe26-1901-4152-961c-79441b47d098 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:41:01.129450 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321cfe26-1901-4152-961c-79441b47d098 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:41:01.200550 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd2bd5f-bf59-4e6b-a392-4d501ef5d43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:41:01.201217 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd2bd5f-bf59-4e6b-a392-4d501ef5d43a admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:41:01.201493 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd2bd5f-bf59-4e6b-a392-4d501ef5d43a admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:41:01.201767 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd2bd5f-bf59-4e6b-a392-4d501ef5d43a admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:41:01.202546 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd2bd5f-bf59-4e6b-a392-4d501ef5d43a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:41:01.204180 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd2bd5f-bf59-4e6b-a392-4d501ef5d43a admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:41:01.209731 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:41:01.216330 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1460/2893] 10.222.0.60 () {58 vars in 1121 bytes} [Sat Jul 2 03:41:01 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 03:41:01.221637 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a71be1-9e05-48cb-a9bb-2717bd4b2118 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:41:01.237838 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a71be1-9e05-48cb-a9bb-2717bd4b2118 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:41:01.243647 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b17a3-57a4-4961-90e7-946fbd2d5df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:41:01.244611 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b17a3-57a4-4961-90e7-946fbd2d5df3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:41:01.244892 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b17a3-57a4-4961-90e7-946fbd2d5df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:41:01.245168 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b17a3-57a4-4961-90e7-946fbd2d5df3 admin admin] PATH_INFO: `/v3/projects/ac622d5b3d2945fc88e130f6f38df574/users/53e3beddb6b545c8ae5a3623b00fc317/roles/5dcd130cda6c490595e862dc2348e83d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:41:01.248316 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15b17a3-57a4-4961-90e7-946fbd2d5df3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac622d5b3d2945fc88e130f6f38df574, user_id=53e3beddb6b545c8ae5a3623b00fc317, role_id=5dcd130cda6c490595e862dc2348e83d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:41:01.252453 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15b17a3-57a4-4961-90e7-946fbd2d5df3 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:41:01.264974 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1434/2894] 10.222.0.60 () {60 vars in 1482 bytes} [Sat Jul 2 03:41:01 2022] PUT /identity/v3/projects/ac622d5b3d2945fc88e130f6f38df574/users/53e3beddb6b545c8ae5a3623b00fc317/roles/5dcd130cda6c490595e862dc2348e83d => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:41:01.276278 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565f063-1be5-4c14-83ad-469c05de84b0 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:41:01.276624 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565f063-1be5-4c14-83ad-469c05de84b0 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:41:01.277084 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565f063-1be5-4c14-83ad-469c05de84b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:41:01.308070 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-f565f063-1be5-4c14-83ad-469c05de84b0 None None] MFA Rules not processed for user `53e3beddb6b545c8ae5a3623b00fc317`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:41:01.310003 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-f565f063-1be5-4c14-83ad-469c05de84b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:41:01.406780 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1461/2895] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:41:01 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:41:01.420430 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b17a3-57a4-4961-90e7-946fbd2d5df3 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:41:01.422739 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d15b17a3-57a4-4961-90e7-946fbd2d5df3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:41:01.483936 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b17a3-57a4-4961-90e7-946fbd2d5df3 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:41:01.487647 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b2f16-dcc5-4d6b-a2c2-a1fbeab6fb2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7c2bef2013546cd882013cdcb4cd929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:41:01.488302 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b2f16-dcc5-4d6b-a2c2-a1fbeab6fb2f service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:41:01.488663 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b2f16-dcc5-4d6b-a2c2-a1fbeab6fb2f service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:41:01.488927 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b2f16-dcc5-4d6b-a2c2-a1fbeab6fb2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:41:01.548339 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2b2f16-dcc5-4d6b-a2c2-a1fbeab6fb2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:41:01.549796 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2b2f16-dcc5-4d6b-a2c2-a1fbeab6fb2f service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:41:01.559012 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1435/2896] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:41:01 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:41:03.492324 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f565f063-1be5-4c14-83ad-469c05de84b0 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:41:03.493837 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-f565f063-1be5-4c14-83ad-469c05de84b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:41:03.573546 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f565f063-1be5-4c14-83ad-469c05de84b0 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:41:03.580032 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a9e9cd-e403-445d-81a2-2fb77fc394c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13530240e2d446b6bf26a431d001362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:41:03.580693 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9e9cd-e403-445d-81a2-2fb77fc394c4 service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:41:03.580978 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9e9cd-e403-445d-81a2-2fb77fc394c4 service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:41:03.581252 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9e9cd-e403-445d-81a2-2fb77fc394c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:41:03.583043 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-18a9e9cd-e403-445d-81a2-2fb77fc394c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:41:03.595331 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a9e9cd-e403-445d-81a2-2fb77fc394c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:41:03.596912 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a9e9cd-e403-445d-81a2-2fb77fc394c4 service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:41:03.607531 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1462/2897] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:41:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:41:04.128024 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b2f16-dcc5-4d6b-a2c2-a1fbeab6fb2f service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:41:04.165253 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:41:04.202568 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b2f16-dcc5-4d6b-a2c2-a1fbeab6fb2f service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:41:04.207375 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1f6a89-1d3d-441c-8c1e-d7dc6da000a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:41:04.208246 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f6a89-1d3d-441c-8c1e-d7dc6da000a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:41:04.208521 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f6a89-1d3d-441c-8c1e-d7dc6da000a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:41:04.208793 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f6a89-1d3d-441c-8c1e-d7dc6da000a9 admin admin] PATH_INFO: `/v3/users/9293e50ec9734262a765767aa91714db` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:41:04.210057 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1f6a89-1d3d-441c-8c1e-d7dc6da000a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9293e50ec9734262a765767aa91714db)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:41:04.212030 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1f6a89-1d3d-441c-8c1e-d7dc6da000a9 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:41:04.259927 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-fb1f6a89-1d3d-441c-8c1e-d7dc6da000a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9293e50ec9734262a765767aa91714db'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:41:04.260654 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-fb1f6a89-1d3d-441c-8c1e-d7dc6da000a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9293e50ec9734262a765767aa91714db'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:41:04.261353 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-fb1f6a89-1d3d-441c-8c1e-d7dc6da000a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9293e50ec9734262a765767aa91714db'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:41:04.274078 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-fb1f6a89-1d3d-441c-8c1e-d7dc6da000a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9293e50ec9734262a765767aa91714db'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:41:04.280792 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-fb1f6a89-1d3d-441c-8c1e-d7dc6da000a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9293e50ec9734262a765767aa91714db'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:41:04.293929 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1436/2898] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:41:04 2022] DELETE /identity/v3/users/9293e50ec9734262a765767aa91714db => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:41:04.298712 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af782474-12dd-4c40-8519-c1937f720870 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:41:04.299002 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af782474-12dd-4c40-8519-c1937f720870 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:41:04.299301 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af782474-12dd-4c40-8519-c1937f720870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:41:04.317352 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-af782474-12dd-4c40-8519-c1937f720870 None None] MFA Rules not processed for user `6fcf66469a4a46abb312bd46ef8e4455`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:41:04.318573 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-af782474-12dd-4c40-8519-c1937f720870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:41:04.385484 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1463/2899] 10.222.0.60 () {58 vars in 957 bytes} [Sat Jul 2 03:41:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:41:04.392191 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1f6a89-1d3d-441c-8c1e-d7dc6da000a9 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:41:04.393710 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-fb1f6a89-1d3d-441c-8c1e-d7dc6da000a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:41:04.451928 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1f6a89-1d3d-441c-8c1e-d7dc6da000a9 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:41:04.456583 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b262300d-fa27-4b58-b600-9e9ec58bce39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:41:04.457234 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b262300d-fa27-4b58-b600-9e9ec58bce39 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:41:04.457515 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b262300d-fa27-4b58-b600-9e9ec58bce39 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:41:04.457789 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b262300d-fa27-4b58-b600-9e9ec58bce39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:41:04.467565 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b262300d-fa27-4b58-b600-9e9ec58bce39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:41:04.469016 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b262300d-fa27-4b58-b600-9e9ec58bce39 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:41:04.480213 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1437/2900] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:41:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:41:04.752064 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af782474-12dd-4c40-8519-c1937f720870 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:41:04.753738 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-af782474-12dd-4c40-8519-c1937f720870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:41:04.766156 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af782474-12dd-4c40-8519-c1937f720870 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:41:04.771517 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3d8dcd-4610-486b-8450-7ecace1198fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:41:04.772487 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d8dcd-4610-486b-8450-7ecace1198fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:41:04.772776 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d8dcd-4610-486b-8450-7ecace1198fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:41:04.773053 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d8dcd-4610-486b-8450-7ecace1198fd admin admin] PATH_INFO: `/v3/projects/a4b664d6be194ead9b56168c0e9f0d46` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:41:04.774659 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3d8dcd-4610-486b-8450-7ecace1198fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4b664d6be194ead9b56168c0e9f0d46)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:41:04.776758 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3d8dcd-4610-486b-8450-7ecace1198fd admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:41:04.783788 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:41:04.828412 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-ad3d8dcd-4610-486b-8450-7ecace1198fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4b664d6be194ead9b56168c0e9f0d46', 'request_id': 'req-ad3d8dcd-4610-486b-8450-7ecace1198fd'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:41:04.834525 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-ad3d8dcd-4610-486b-8450-7ecace1198fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4b664d6be194ead9b56168c0e9f0d46', 'request_id': 'req-ad3d8dcd-4610-486b-8450-7ecace1198fd'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:41:04.841009 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-ad3d8dcd-4610-486b-8450-7ecace1198fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4b664d6be194ead9b56168c0e9f0d46', 'request_id': 'req-ad3d8dcd-4610-486b-8450-7ecace1198fd'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:41:04.855151 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-ad3d8dcd-4610-486b-8450-7ecace1198fd admin admin] The token cache is being invalidate because project a4b664d6be194ead9b56168c0e9f0d46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:41:04.855446 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-ad3d8dcd-4610-486b-8450-7ecace1198fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:41:04.856067 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-ad3d8dcd-4610-486b-8450-7ecace1198fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:41:04.857677 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1464/2901] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:41:04 2022] DELETE /identity/v3/projects/a4b664d6be194ead9b56168c0e9f0d46 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:41:04.861871 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b262300d-fa27-4b58-b600-9e9ec58bce39 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:41:04.872150 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b262300d-fa27-4b58-b600-9e9ec58bce39 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:41:04.920785 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:41:04.932961 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0de2b5-044b-4b1c-8ba4-64efc448ac1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:41:04.933884 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0de2b5-044b-4b1c-8ba4-64efc448ac1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:41:04.934169 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0de2b5-044b-4b1c-8ba4-64efc448ac1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:41:04.934734 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0de2b5-044b-4b1c-8ba4-64efc448ac1b admin admin] PATH_INFO: `/v3/users/53e3beddb6b545c8ae5a3623b00fc317` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:41:04.936093 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0de2b5-044b-4b1c-8ba4-64efc448ac1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=53e3beddb6b545c8ae5a3623b00fc317)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:41:04.938055 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0de2b5-044b-4b1c-8ba4-64efc448ac1b admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:41:04.985984 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4c0de2b5-044b-4b1c-8ba4-64efc448ac1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53e3beddb6b545c8ae5a3623b00fc317'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:41:04.986621 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4c0de2b5-044b-4b1c-8ba4-64efc448ac1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53e3beddb6b545c8ae5a3623b00fc317'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:41:04.987246 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4c0de2b5-044b-4b1c-8ba4-64efc448ac1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53e3beddb6b545c8ae5a3623b00fc317'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:41:04.998794 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4c0de2b5-044b-4b1c-8ba4-64efc448ac1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53e3beddb6b545c8ae5a3623b00fc317'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:41:05.005302 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4c0de2b5-044b-4b1c-8ba4-64efc448ac1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53e3beddb6b545c8ae5a3623b00fc317'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:41:05.018863 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1438/2902] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:41:04 2022] DELETE /identity/v3/users/53e3beddb6b545c8ae5a3623b00fc317 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 03:41:05.300884 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3d8dcd-4610-486b-8450-7ecace1198fd admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:41:05.302848 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-ad3d8dcd-4610-486b-8450-7ecace1198fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:41:05.316518 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3d8dcd-4610-486b-8450-7ecace1198fd admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:41:05.375886 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b86ce-9d28-4d35-a318-36cc84bc0768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:41:05.376793 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b86ce-9d28-4d35-a318-36cc84bc0768 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:41:05.377076 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b86ce-9d28-4d35-a318-36cc84bc0768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:41:05.377349 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b86ce-9d28-4d35-a318-36cc84bc0768 admin admin] PATH_INFO: `/v3/projects/ac622d5b3d2945fc88e130f6f38df574` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:41:05.378790 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4b86ce-9d28-4d35-a318-36cc84bc0768 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac622d5b3d2945fc88e130f6f38df574)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:41:05.380754 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4b86ce-9d28-4d35-a318-36cc84bc0768 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:41:05.428528 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-df4b86ce-9d28-4d35-a318-36cc84bc0768 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac622d5b3d2945fc88e130f6f38df574', 'request_id': 'req-df4b86ce-9d28-4d35-a318-36cc84bc0768'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:41:05.434560 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-df4b86ce-9d28-4d35-a318-36cc84bc0768 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac622d5b3d2945fc88e130f6f38df574', 'request_id': 'req-df4b86ce-9d28-4d35-a318-36cc84bc0768'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:41:05.441600 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-df4b86ce-9d28-4d35-a318-36cc84bc0768 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac622d5b3d2945fc88e130f6f38df574', 'request_id': 'req-df4b86ce-9d28-4d35-a318-36cc84bc0768'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:41:05.455996 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-df4b86ce-9d28-4d35-a318-36cc84bc0768 admin admin] The token cache is being invalidate because project ac622d5b3d2945fc88e130f6f38df574 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:41:05.456277 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-df4b86ce-9d28-4d35-a318-36cc84bc0768 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:41:05.456917 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-df4b86ce-9d28-4d35-a318-36cc84bc0768 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:41:05.458513 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1465/2903] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:41:05 2022] DELETE /identity/v3/projects/ac622d5b3d2945fc88e130f6f38df574 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:41:06.350916 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0de2b5-044b-4b1c-8ba4-64efc448ac1b admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:41:06.352658 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4c0de2b5-044b-4b1c-8ba4-64efc448ac1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:41:06.415019 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0de2b5-044b-4b1c-8ba4-64efc448ac1b admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:41:06.464439 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe004b8a-7d40-41ad-8b04-cca4dee27e31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:41:06.465087 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe004b8a-7d40-41ad-8b04-cca4dee27e31 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:41:06.465368 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe004b8a-7d40-41ad-8b04-cca4dee27e31 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:41:06.465644 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe004b8a-7d40-41ad-8b04-cca4dee27e31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:41:06.467637 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-fe004b8a-7d40-41ad-8b04-cca4dee27e31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:41:06.514769 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:41:06.539314 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe004b8a-7d40-41ad-8b04-cca4dee27e31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:41:06.540860 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe004b8a-7d40-41ad-8b04-cca4dee27e31 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:41:06.550693 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1439/2904] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:41:06 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:41:15.453160 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=73,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:41:16.546379 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=11 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:43:36.279246 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b86ce-9d28-4d35-a318-36cc84bc0768 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:43:36.280992 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-df4b86ce-9d28-4d35-a318-36cc84bc0768 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:43:36.439862 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b86ce-9d28-4d35-a318-36cc84bc0768 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:43:36.445936 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b21f35-94d3-427b-9967-935525370177 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dafc9be75a64db095fe08b9cbb04cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:43:36.446587 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b21f35-94d3-427b-9967-935525370177 service placement] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:43:36.446866 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b21f35-94d3-427b-9967-935525370177 service placement] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:43:36.447157 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b21f35-94d3-427b-9967-935525370177 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:43:36.449364 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-23b21f35-94d3-427b-9967-935525370177 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:43:36.461556 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b21f35-94d3-427b-9967-935525370177 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:43:36.463195 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b21f35-94d3-427b-9967-935525370177 service placement] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:43:36.473590 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1466/2905] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:43:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:43:37.392978 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe004b8a-7d40-41ad-8b04-cca4dee27e31 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:43:37.394734 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-fe004b8a-7d40-41ad-8b04-cca4dee27e31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:43:37.459892 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe004b8a-7d40-41ad-8b04-cca4dee27e31 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:43:37.464570 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2923fbb9-7ad0-4993-9ab7-d2d12a135e8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:43:37.465245 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2923fbb9-7ad0-4993-9ab7-d2d12a135e8d service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:43:37.465549 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2923fbb9-7ad0-4993-9ab7-d2d12a135e8d service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:43:37.465790 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2923fbb9-7ad0-4993-9ab7-d2d12a135e8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:43:37.467964 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2923fbb9-7ad0-4993-9ab7-d2d12a135e8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:43:37.478251 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2923fbb9-7ad0-4993-9ab7-d2d12a135e8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:43:37.479724 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2923fbb9-7ad0-4993-9ab7-d2d12a135e8d service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:43:37.488343 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1440/2906] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:43:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:43:37.602868 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7af619-38d2-4168-8f55-a75663c500ff None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:43:37.603488 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7af619-38d2-4168-8f55-a75663c500ff None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:43:37.603488 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7af619-38d2-4168-8f55-a75663c500ff None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:43:37.604845 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1467/2907] 10.222.0.60 () {54 vars in 921 bytes} [Sat Jul 2 03:43:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:43:37.611539 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da7fc9-328a-4bd2-9029-ce1b30ab30ff None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:43:37.611826 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da7fc9-328a-4bd2-9029-ce1b30ab30ff None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:43:37.612099 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da7fc9-328a-4bd2-9029-ce1b30ab30ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:43:37.672568 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-20da7fc9-328a-4bd2-9029-ce1b30ab30ff None None] MFA Rules not processed for user `b0e8a3ba6f84477bb9b4780918f357c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:43:37.673798 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-20da7fc9-328a-4bd2-9029-ce1b30ab30ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:43:37.680855 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1441/2908] 10.222.0.60 () {58 vars in 1018 bytes} [Sat Jul 2 03:43:37 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:43:37.694133 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7af619-38d2-4168-8f55-a75663c500ff None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:43:37.705951 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7af619-38d2-4168-8f55-a75663c500ff None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:43:37.710325 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f039a7-34ef-4308-aee5-ef4f4edd79e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:43:37.710966 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f039a7-34ef-4308-aee5-ef4f4edd79e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:43:37.711397 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f039a7-34ef-4308-aee5-ef4f4edd79e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:43:37.711679 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f039a7-34ef-4308-aee5-ef4f4edd79e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:43:37.719396 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f039a7-34ef-4308-aee5-ef4f4edd79e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:43:37.720823 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f039a7-34ef-4308-aee5-ef4f4edd79e3 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:43:37.729474 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1468/2909] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:43:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:43:37.818011 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91abc6-32b0-49ea-8b4c-099f64557041 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:43:37.818334 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91abc6-32b0-49ea-8b4c-099f64557041 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:43:37.818644 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91abc6-32b0-49ea-8b4c-099f64557041 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:43:37.820147 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1442/2910] 10.222.0.60 () {54 vars in 921 bytes} [Sat Jul 2 03:43:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 03:43:37.825785 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864dbea-0d12-4abf-9fc4-f96cafcd174c None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:43:37.826040 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864dbea-0d12-4abf-9fc4-f96cafcd174c None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:43:37.826337 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864dbea-0d12-4abf-9fc4-f96cafcd174c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:43:37.879363 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-f864dbea-0d12-4abf-9fc4-f96cafcd174c None None] MFA Rules not processed for user `13530240e2d446b6bf26a431d001362a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 03:43:37.881133 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-f864dbea-0d12-4abf-9fc4-f96cafcd174c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:43:37.926517 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:43:37.971042 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1469/2911] 10.222.0.60 () {58 vars in 1018 bytes} [Sat Jul 2 03:43:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 03:43:37.983835 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a91abc6-32b0-49ea-8b4c-099f64557041 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:43:37.985745 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5a91abc6-32b0-49ea-8b4c-099f64557041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:43:37.999007 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a91abc6-32b0-49ea-8b4c-099f64557041 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:43:38.002601 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b39854-370f-4292-af3b-af2a551ca674 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:43:38.003267 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b39854-370f-4292-af3b-af2a551ca674 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:43:38.003545 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b39854-370f-4292-af3b-af2a551ca674 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:43:38.003815 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b39854-370f-4292-af3b-af2a551ca674 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:43:38.014784 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b39854-370f-4292-af3b-af2a551ca674 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:43:38.016268 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b39854-370f-4292-af3b-af2a551ca674 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:43:38.027177 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1443/2912] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:43:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:43:47.968222 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=18 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:43:48.022602 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=51 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:45:14.228868 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f864dbea-0d12-4abf-9fc4-f96cafcd174c None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:45:14.232665 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-f864dbea-0d12-4abf-9fc4-f96cafcd174c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:45:14.247255 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f864dbea-0d12-4abf-9fc4-f96cafcd174c None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:45:14.254496 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ddc77-2cd1-4eb2-a57f-627e46e598e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13530240e2d446b6bf26a431d001362a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:45:14.255713 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ddc77-2cd1-4eb2-a57f-627e46e598e9 service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:45:14.256148 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ddc77-2cd1-4eb2-a57f-627e46e598e9 service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:45:14.256636 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ddc77-2cd1-4eb2-a57f-627e46e598e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:45:14.259243 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-490ddc77-2cd1-4eb2-a57f-627e46e598e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:45:14.272819 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490ddc77-2cd1-4eb2-a57f-627e46e598e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:45:14.274429 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490ddc77-2cd1-4eb2-a57f-627e46e598e9 service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:45:14.290655 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1470/2913] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:45:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:45:14.417580 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b39854-370f-4292-af3b-af2a551ca674 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:45:14.426751 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b39854-370f-4292-af3b-af2a551ca674 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:45:14.430666 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc33daf-62ab-4ec2-aa62-a84d2000bd46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:45:14.431331 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc33daf-62ab-4ec2-aa62-a84d2000bd46 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:45:14.431611 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc33daf-62ab-4ec2-aa62-a84d2000bd46 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:45:14.431882 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc33daf-62ab-4ec2-aa62-a84d2000bd46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:45:14.433714 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2cc33daf-62ab-4ec2-aa62-a84d2000bd46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:45:14.447849 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc33daf-62ab-4ec2-aa62-a84d2000bd46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:45:14.449336 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc33daf-62ab-4ec2-aa62-a84d2000bd46 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:45:14.461078 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1444/2914] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:45:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:45:15.649422 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ddc77-2cd1-4eb2-a57f-627e46e598e9 service nova] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:45:15.659726 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ddc77-2cd1-4eb2-a57f-627e46e598e9 service nova] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:45:15.664892 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f215c8ca-2b81-426c-85cc-777a99be6ec4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:45:15.665364 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215c8ca-2b81-426c-85cc-777a99be6ec4 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:45:15.665628 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215c8ca-2b81-426c-85cc-777a99be6ec4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:45:15.665903 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215c8ca-2b81-426c-85cc-777a99be6ec4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:45:15.668099 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-f215c8ca-2b81-426c-85cc-777a99be6ec4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:45:15.683584 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f215c8ca-2b81-426c-85cc-777a99be6ec4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:45:15.685045 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f215c8ca-2b81-426c-85cc-777a99be6ec4 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:45:15.696899 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1471/2915] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:45:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:45:21.392713 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc33daf-62ab-4ec2-aa62-a84d2000bd46 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:45:21.405652 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc33daf-62ab-4ec2-aa62-a84d2000bd46 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:45:21.411504 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87abd5e1-7556-4d5a-91b2-a9a729b3660e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dafc9be75a64db095fe08b9cbb04cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:45:21.412091 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87abd5e1-7556-4d5a-91b2-a9a729b3660e service placement] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:45:21.412368 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87abd5e1-7556-4d5a-91b2-a9a729b3660e service placement] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:45:21.412642 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87abd5e1-7556-4d5a-91b2-a9a729b3660e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:45:21.415459 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-87abd5e1-7556-4d5a-91b2-a9a729b3660e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:45:21.432050 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87abd5e1-7556-4d5a-91b2-a9a729b3660e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:45:21.434718 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87abd5e1-7556-4d5a-91b2-a9a729b3660e service placement] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:45:21.448162 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1445/2916] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:45:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:45:23.813463 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f215c8ca-2b81-426c-85cc-777a99be6ec4 service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:45:23.822578 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f215c8ca-2b81-426c-85cc-777a99be6ec4 service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:45:23.827361 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0657efab-0c18-4a0a-b04e-c320e1057bae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e8a3ba6f84477bb9b4780918f357c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:45:23.828005 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0657efab-0c18-4a0a-b04e-c320e1057bae service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:45:23.828272 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0657efab-0c18-4a0a-b04e-c320e1057bae service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:45:23.828549 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0657efab-0c18-4a0a-b04e-c320e1057bae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:45:23.830551 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-0657efab-0c18-4a0a-b04e-c320e1057bae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:45:23.919859 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0657efab-0c18-4a0a-b04e-c320e1057bae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:45:23.921312 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0657efab-0c18-4a0a-b04e-c320e1057bae service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:45:23.944216 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1472/2917] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:45:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:45:24.773678 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87abd5e1-7556-4d5a-91b2-a9a729b3660e service placement] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:45:24.775286 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-87abd5e1-7556-4d5a-91b2-a9a729b3660e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:45:24.789498 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87abd5e1-7556-4d5a-91b2-a9a729b3660e service placement] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:45:24.794528 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01480d-2966-4092-9ab6-f281e76333d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:45:24.795430 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01480d-2966-4092-9ab6-f281e76333d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:45:24.795708 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01480d-2966-4092-9ab6-f281e76333d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:45:24.795986 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01480d-2966-4092-9ab6-f281e76333d1 admin admin] PATH_INFO: `/v3/users/089580e581824803aeb276a0e51df138` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:45:24.797238 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb01480d-2966-4092-9ab6-f281e76333d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=089580e581824803aeb276a0e51df138)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:45:24.799211 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb01480d-2966-4092-9ab6-f281e76333d1 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:45:24.857649 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-cb01480d-2966-4092-9ab6-f281e76333d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '089580e581824803aeb276a0e51df138'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:45:24.858532 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-cb01480d-2966-4092-9ab6-f281e76333d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '089580e581824803aeb276a0e51df138'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:45:24.859752 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-cb01480d-2966-4092-9ab6-f281e76333d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '089580e581824803aeb276a0e51df138'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:45:24.877311 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-cb01480d-2966-4092-9ab6-f281e76333d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '089580e581824803aeb276a0e51df138'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:45:24.884425 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-cb01480d-2966-4092-9ab6-f281e76333d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '089580e581824803aeb276a0e51df138'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:45:24.898645 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1446/2918] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:45:24 2022] DELETE /identity/v3/users/089580e581824803aeb276a0e51df138 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:45:25.074143 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0657efab-0c18-4a0a-b04e-c320e1057bae service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:45:25.084193 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0657efab-0c18-4a0a-b04e-c320e1057bae service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:45:25.143581 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd4659d-deea-4913-b474-d70b48922c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:45:25.144361 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4659d-deea-4913-b474-d70b48922c3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:45:25.144640 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4659d-deea-4913-b474-d70b48922c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:45:25.144900 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4659d-deea-4913-b474-d70b48922c3d admin admin] PATH_INFO: `/v3/projects/133ac514bbe14f1c9409c37b321bb68d` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:45:25.146079 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd4659d-deea-4913-b474-d70b48922c3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=133ac514bbe14f1c9409c37b321bb68d)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:45:25.148073 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd4659d-deea-4913-b474-d70b48922c3d admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:45:25.189833 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:45:25.197411 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-8dd4659d-deea-4913-b474-d70b48922c3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '133ac514bbe14f1c9409c37b321bb68d', 'request_id': 'req-8dd4659d-deea-4913-b474-d70b48922c3d'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:45:25.203792 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-8dd4659d-deea-4913-b474-d70b48922c3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '133ac514bbe14f1c9409c37b321bb68d', 'request_id': 'req-8dd4659d-deea-4913-b474-d70b48922c3d'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:45:25.210354 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-8dd4659d-deea-4913-b474-d70b48922c3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '133ac514bbe14f1c9409c37b321bb68d', 'request_id': 'req-8dd4659d-deea-4913-b474-d70b48922c3d'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:45:25.226862 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-8dd4659d-deea-4913-b474-d70b48922c3d admin admin] The token cache is being invalidate because project 133ac514bbe14f1c9409c37b321bb68d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:45:25.227180 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-8dd4659d-deea-4913-b474-d70b48922c3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:45:25.227827 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-8dd4659d-deea-4913-b474-d70b48922c3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:45:25.229409 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1473/2919] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:45:25 2022] DELETE /identity/v3/projects/133ac514bbe14f1c9409c37b321bb68d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:45:25.233621 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01480d-2966-4092-9ab6-f281e76333d1 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:45:25.235142 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-cb01480d-2966-4092-9ab6-f281e76333d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:45:25.248729 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01480d-2966-4092-9ab6-f281e76333d1 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:45:25.309512 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e92a9-f3ca-48df-a0bc-04a9a078a0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:45:25.310449 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e92a9-f3ca-48df-a0bc-04a9a078a0d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:45:25.310717 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e92a9-f3ca-48df-a0bc-04a9a078a0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:45:25.311011 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e92a9-f3ca-48df-a0bc-04a9a078a0d9 admin admin] PATH_INFO: `/v3/users/0fa95665222d4abe92b714481e02b207` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:45:25.312327 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701e92a9-f3ca-48df-a0bc-04a9a078a0d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fa95665222d4abe92b714481e02b207)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:45:25.314265 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701e92a9-f3ca-48df-a0bc-04a9a078a0d9 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:45:25.361443 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-701e92a9-f3ca-48df-a0bc-04a9a078a0d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fa95665222d4abe92b714481e02b207'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:45:25.362097 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-701e92a9-f3ca-48df-a0bc-04a9a078a0d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fa95665222d4abe92b714481e02b207'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:45:25.362700 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-701e92a9-f3ca-48df-a0bc-04a9a078a0d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fa95665222d4abe92b714481e02b207'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:45:25.363890 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:45:25.379707 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-701e92a9-f3ca-48df-a0bc-04a9a078a0d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fa95665222d4abe92b714481e02b207'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:45:25.386742 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-701e92a9-f3ca-48df-a0bc-04a9a078a0d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fa95665222d4abe92b714481e02b207'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:45:25.402434 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1447/2920] 10.222.0.60 () {58 vars in 1223 bytes} [Sat Jul 2 03:45:25 2022] DELETE /identity/v3/users/0fa95665222d4abe92b714481e02b207 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:45:25.588758 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd4659d-deea-4913-b474-d70b48922c3d admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:45:25.590295 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-8dd4659d-deea-4913-b474-d70b48922c3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:45:25.603931 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd4659d-deea-4913-b474-d70b48922c3d admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:45:25.667736 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70eb6f9-ef63-4981-a40d-b4887df5fca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcf66469a4a46abb312bd46ef8e4455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5b36ebb11744ee2a29802eb5f4d8e11', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:45:25.668505 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70eb6f9-ef63-4981-a40d-b4887df5fca2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:45:25.668789 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70eb6f9-ef63-4981-a40d-b4887df5fca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:45:25.669063 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70eb6f9-ef63-4981-a40d-b4887df5fca2 admin admin] PATH_INFO: `/v3/projects/c24106a2c5494c32800eddb9d2dc7796` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:45:25.670226 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70eb6f9-ef63-4981-a40d-b4887df5fca2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c24106a2c5494c32800eddb9d2dc7796)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:45:25.672460 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70eb6f9-ef63-4981-a40d-b4887df5fca2 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:45:25.727113 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-a70eb6f9-ef63-4981-a40d-b4887df5fca2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c24106a2c5494c32800eddb9d2dc7796', 'request_id': 'req-a70eb6f9-ef63-4981-a40d-b4887df5fca2'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:45:25.735113 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-a70eb6f9-ef63-4981-a40d-b4887df5fca2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c24106a2c5494c32800eddb9d2dc7796', 'request_id': 'req-a70eb6f9-ef63-4981-a40d-b4887df5fca2'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:45:25.741875 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-a70eb6f9-ef63-4981-a40d-b4887df5fca2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c24106a2c5494c32800eddb9d2dc7796', 'request_id': 'req-a70eb6f9-ef63-4981-a40d-b4887df5fca2'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:45:25.755905 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-a70eb6f9-ef63-4981-a40d-b4887df5fca2 admin admin] The token cache is being invalidate because project c24106a2c5494c32800eddb9d2dc7796 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 03:45:25.756295 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-a70eb6f9-ef63-4981-a40d-b4887df5fca2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:45:25.756968 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-a70eb6f9-ef63-4981-a40d-b4887df5fca2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 03:45:25.758550 dv-cinder-846842-9-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1474/2921] 10.222.0.60 () {58 vars in 1232 bytes} [Sat Jul 2 03:45:25 2022] DELETE /identity/v3/projects/c24106a2c5494c32800eddb9d2dc7796 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 03:45:35.399652 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=12,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:45:35.753196 dv-cinder-846842-9-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=60,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 03:48:50.960528 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e92a9-f3ca-48df-a0bc-04a9a078a0d9 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 03:48:50.962062 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-701e92a9-f3ca-48df-a0bc-04a9a078a0d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:48:51.048821 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e92a9-f3ca-48df-a0bc-04a9a078a0d9 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 03:48:51.112514 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a93fdc-466d-4357-8038-90c5d2862f86 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dafc9be75a64db095fe08b9cbb04cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e09dc5d9d4904c2b89b0cabed237d55e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 03:48:51.113151 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a93fdc-466d-4357-8038-90c5d2862f86 service placement] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 03:48:51.113497 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a93fdc-466d-4357-8038-90c5d2862f86 service placement] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 03:48:51.113773 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a93fdc-466d-4357-8038-90c5d2862f86 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 03:48:51.115819 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e8a93fdc-466d-4357-8038-90c5d2862f86 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 03:48:51.127752 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a93fdc-466d-4357-8038-90c5d2862f86 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 03:48:51.129356 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a93fdc-466d-4357-8038-90c5d2862f86 service placement] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 03:48:51.139388 dv-cinder-846842-9-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1448/2922] 10.222.0.60 () {60 vars in 1365 bytes} [Sat Jul 2 03:48:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 03:49:01.135348 dv-cinder-846842-9-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=58 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}